[2025-10-16T17:00:01.467962] [INFO ] [MAIN ] Using last completed trading day: 2025-10-16 [2025-10-16T17:00:01.650204] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-16T17:00:01.650388] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-16T17:00:01.863037] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-16T17:00:01.863347] [WARN ] [STATE ] State set to: RUNNING [2025-10-16T17:00:01.863423] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-16T17:00:01.863466] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-16T17:00:01.863547] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-16T17:00:01.863581] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-16T17:00:03.636186] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-16T17:00:03.636475] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-16T17:00:03.636789] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-16T17:00:03.637384] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-16T17:00:03.637445] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-16T17:00:03.637479] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-16T17:00:03.637545] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-16T17:00:03.637579] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-16T17:00:03.637609] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-16T17:00:03.638040] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-16T17:00:03.638093] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-16T17:00:03.638254] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-16T17:00:03.638290] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-16T17:00:03.638322] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-16T17:00:03.638354] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-16T17:00:03.660747] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-16T17:00:03.684634] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-16T17:00:03.684948] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-16T17:00:03.684991] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-16T17:00:03.685024] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-16T17:00:03.685097] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-16T17:00:03.685590] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-16T17:00:03.685691] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-16T17:00:03.685762] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-10-16T17:00:03.685825] [INFO ] [MAIN ] Running in parallel mode [2025-10-16T17:00:03.686102] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-10-16T17:00:04.348962] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.394553] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.439436] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.445923] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-16T17:00:04.454708] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-16T17:00:04.454800] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.454951] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.472687] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.472579] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:04.473035] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.473260] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-16T17:00:04.473163] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-16T17:00:04.473592] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-16T17:00:04.473465] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-16T17:00:04.473358] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-16T17:00:04.473735] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-16T17:00:04.473950] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-16T17:00:04.485491] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-16T17:00:04.473876] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-16T17:00:04.597226] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-16T17:00:04.677329] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-16T17:00:04.680722] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-16T17:00:05.063479] [DEBUG] [LOCAL ] A: Loaded 50779 existing records from primary storage. [2025-10-16T17:00:05.162596] [INFO ] [MAIN ] A: Loaded 50779 existing records. [2025-10-16T17:00:05.478321] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.542682] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-16T17:00:05.659013] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.676046] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-16T17:00:05.800503] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:05.808678] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-16T17:00:05.829193] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:05.830423] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-16T17:00:05.830478] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-16T17:00:05.830884] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-16T17:00:05.830943] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-16T17:00:06.121072] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T17:00:06.111533] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:00:06.125984] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-16T17:00:06.136997] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-16T17:00:06.166512] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:00:06.185973] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-16T17:00:06.209557] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:00:06.209464] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:06.210011] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-16T17:00:06.210369] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-16T17:00:06.211275] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-16T17:00:06.211348] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-16T17:00:06.211394] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-16T17:00:06.211441] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 39m 40s. Rate: 23.8 symbols/min [2025-10-16T17:00:06.391027] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:06.445145] [DEBUG] [LOCAL ] AAP: Loaded 51846 existing records from primary storage. [2025-10-16T17:00:06.445458] [INFO ] [MAIN ] AAP: Loaded 51846 existing records. [2025-10-16T17:00:06.548248] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:00:06.555049] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-16T17:00:06.629217] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:06.629406] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-16T17:00:06.629460] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-16T17:00:06.630578] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-16T17:00:06.630670] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-16T17:00:06.999985] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:07.000314] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-16T17:00:07.060694] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T17:00:07.061739] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-16T17:00:07.391409] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T17:00:07.392361] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-16T17:00:07.654070] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-16T17:00:07.659798] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-16T17:00:07.663117] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T17:00:07.679935] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-16T17:00:08.021163] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T17:00:08.022106] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-16T17:00:08.062307] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:00:08.072317] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-16T17:00:08.254596] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-16T17:00:08.255899] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-16T17:00:08.599297] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T17:00:08.600358] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-16T17:00:08.630739] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:00:08.641419] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-16T17:00:09.001248] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-16T17:00:09.002358] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-16T17:00:09.241713] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T17:00:09.242587] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-16T17:00:09.564810] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:00:09.574602] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-16T17:00:09.592119] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T17:00:09.593208] [INFO ] [REMOTE ] AAM: Full fetch complete (926 records). [2025-10-16T17:00:09.593481] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-16T17:00:09.593908] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:00:09.593991] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:00:09.594036] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:00:09.594100] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-16T17:00:09.594163] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-16T17:00:09.594202] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-16T17:00:09.594242] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-16T17:00:09.603626] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AAM took 5.8s. Estimated remaining: 1h 56m 44s. Rate: 20.3 symbols/min [2025-10-16T17:00:09.688743] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:00:09.728449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-16T17:00:09.817611] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:09.850368] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:00:09.863344] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-16T17:00:09.887940] [DEBUG] [LOCAL ] AAT: Loaded 30450 existing records from primary storage. [2025-10-16T17:00:09.888219] [INFO ] [MAIN ] AAT: Loaded 30450 existing records. [2025-10-16T17:00:10.096259] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:10.096499] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-16T17:00:10.096550] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-16T17:00:10.097358] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-16T17:00:10.097422] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-16T17:00:10.632280] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:10.632696] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-16T17:00:10.914195] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:00:10.929156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-16T17:00:11.382570] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:00:11.393125] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-16T17:00:11.660715] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T17:00:11.671021] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-16T17:00:11.905213] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:00:11.911147] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-16T17:00:12.379093] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:00:12.391603] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-16T17:00:12.897631] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:00:12.908840] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-16T17:00:13.050611] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T17:00:13.056117] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-16T17:00:13.491409] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:00:13.505327] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-16T17:00:13.989943] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:00:14.001861] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-16T17:00:14.521994] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:00:14.527759] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-16T17:00:14.809161] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:00:14.823542] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-16T17:00:15.308670] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:00:15.321162] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-16T17:00:15.549410] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T17:00:15.561704] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-16T17:00:15.860159] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:00:15.866587] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-16T17:00:16.268050] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:00:16.281330] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-16T17:00:17.261857] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:00:17.274736] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-16T17:00:17.493544] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:00:17.504796] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-16T17:00:17.888534] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:00:17.899581] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-16T17:00:19.167477] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-10-16T17:00:19.176080] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-16T17:00:19.316698] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T17:00:19.327828] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-16T17:00:19.771458] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:00:19.784998] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-16T17:00:19.932840] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-16T17:00:19.948117] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-16T17:00:20.434679] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:00:20.441347] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-16T17:00:20.950609] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:00:20.961910] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-16T17:00:21.416965] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T17:00:21.423592] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-16T17:00:21.510962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:00:21.522972] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-16T17:00:21.635137] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:00:21.647894] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-16T17:00:22.581422] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T17:00:22.595324] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-16T17:00:22.817468] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:00:22.825096] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-16T17:00:23.043089] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:00:23.054192] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-16T17:00:23.312187] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:00:23.324565] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-16T17:00:23.717046] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:00:23.724704] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-16T17:00:24.421598] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:00:24.431268] [INFO ] [REMOTE ] A: Full fetch complete (73471 records). [2025-10-16T17:00:24.431513] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-16T17:00:24.793197] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:00:24.837340] [INFO ] [REMOTE ] AAP: Full fetch complete (75218 records). [2025-10-16T17:00:24.857212] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-16T17:00:24.960445] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:00:24.966178] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-16T17:00:24.972234] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-16T17:00:25.017289] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-16T17:00:25.004902] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-16T17:00:25.023700] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-16T17:00:25.173505] [DEBUG] [LOCAL ] A: Trimmed 73471 records to 51164 (keeping 200 days of data) [2025-10-16T17:00:25.471133] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-16T17:00:25.472579] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-16T17:00:25.478343] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-16T17:00:25.478782] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-16T17:00:25.591225] [DEBUG] [LOCAL ] AAP: Trimmed 75218 records to 52218 (keeping 200 days of data) [2025-10-16T17:00:25.728207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-16T17:00:25.774355] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-16T17:00:25.884697] [DEBUG] [LOCAL ] A: Primary data saved (51164 records). [2025-10-16T17:00:25.887635] [INFO ] [MAIN ] A: Full history saved. [2025-10-16T17:00:25.888360] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. A took 22.2s. Estimated remaining: 4h 51m 50s. Rate: 8.1 symbols/min [2025-10-16T17:00:26.184116] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:26.194087] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-16T17:00:26.194711] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-16T17:00:26.196912] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-16T17:00:26.201590] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-16T17:00:26.201721] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-16T17:00:26.201782] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-16T17:00:26.382394] [DEBUG] [LOCAL ] AAP: Primary data saved (52218 records). [2025-10-16T17:00:26.387280] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-16T17:00:26.414528] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AAP took 20.2s. Estimated remaining: 3h 43m 58s. Rate: 10.6 symbols/min [2025-10-16T17:00:26.457492] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:00:26.580342] [INFO ] [REMOTE ] AAT: Full fetch complete (42964 records). [2025-10-16T17:00:26.633108] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-16T17:00:26.868337] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:26.885937] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-16T17:00:26.942189] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-16T17:00:26.955279] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-16T17:00:26.955036] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:26.955482] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-16T17:00:26.966396] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-16T17:00:26.971566] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-16T17:00:26.976800] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-16T17:00:27.271383] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:00:27.316567] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-16T17:00:27.381424] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:00:27.396520] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-16T17:00:27.479414] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:00:27.545330] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-16T17:00:27.556891] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-16T17:00:27.557707] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-16T17:00:27.557225] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-16T17:00:27.558211] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-16T17:00:27.563769] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-16T17:00:27.563603] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-16T17:00:27.569166] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-16T17:00:27.569244] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 8m 12s. Rate: 12.6 symbols/min [2025-10-16T17:00:27.657528] [DEBUG] [LOCAL ] AAT: Trimmed 42964 records to 30661 (keeping 200 days of data) [2025-10-16T17:00:27.743813] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:27.754625] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-16T17:00:27.929351] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:27.936773] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-16T17:00:27.940364] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-16T17:00:27.948430] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-16T17:00:27.950983] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-16T17:00:27.951162] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-16T17:00:27.952928] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-16T17:00:28.099380] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-16T17:00:28.136964] [INFO ] [REMOTE ] AA: Full fetch complete (77723 records). [2025-10-16T17:00:28.150949] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-16T17:00:28.231033] [DEBUG] [LOCAL ] AAT: Primary data saved (30661 records). [2025-10-16T17:00:28.313553] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-16T17:00:28.385527] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAT took 18.8s. Estimated remaining: 2h 42m 8s. Rate: 14.6 symbols/min [2025-10-16T17:00:28.972057] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:28.986326] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-16T17:00:28.980587] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:29.075360] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-16T17:00:29.075739] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-16T17:00:29.076747] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-16T17:00:29.076961] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-16T17:00:29.079087] [DEBUG] [LOCAL ] AA: Trimmed 77723 records to 54011 (keeping 200 days of data) [2025-10-16T17:00:29.197980] [DEBUG] [LOCAL ] ABCB: Loaded 30489 existing records from primary storage. [2025-10-16T17:00:29.200556] [INFO ] [MAIN ] ABCB: Loaded 30489 existing records. [2025-10-16T17:00:29.391843] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:29.394613] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-16T17:00:29.394746] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-16T17:00:29.399204] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-16T17:00:29.405634] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-16T17:00:29.471522] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T17:00:29.599879] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-16T17:00:29.918177] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:29.919372] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-16T17:00:30.018312] [DEBUG] [LOCAL ] AA: Primary data saved (54011 records). [2025-10-16T17:00:30.018469] [INFO ] [MAIN ] AA: Full history saved. [2025-10-16T17:00:30.020219] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AA took 26.3s. Estimated remaining: 2h 28m 6s. Rate: 15.9 symbols/min [2025-10-16T17:00:30.200460] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:30.250619] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-16T17:00:30.251012] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-10-16T17:00:30.432811] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:30.433055] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-16T17:00:30.433102] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-16T17:00:30.433937] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-16T17:00:30.433994] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-16T17:00:30.803115] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:30.803891] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-16T17:00:30.840037] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:00:30.851097] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-16T17:00:30.970341] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:00:30.978056] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-16T17:00:31.012692] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:00:31.019423] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-16T17:00:31.846362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:00:31.853207] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-16T17:00:32.421151] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:00:32.430406] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-16T17:00:32.506809] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:00:32.518281] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-16T17:00:32.668704] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T17:00:32.674812] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-16T17:00:32.827395] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:00:32.838084] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-16T17:00:33.786218] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T17:00:33.796200] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-16T17:00:33.886565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:00:33.893777] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-16T17:00:33.981833] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T17:00:33.992125] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-16T17:00:34.790280] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T17:00:34.801033] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-16T17:00:34.965195] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:00:34.975143] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-16T17:00:35.282985] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:00:35.291304] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-16T17:00:35.921820] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T17:00:35.926300] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:00:35.938594] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-16T17:00:35.940075] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-16T17:00:36.145389] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:00:36.151677] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-16T17:00:36.637186] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:00:36.648424] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-16T17:00:36.661238] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:00:36.666001] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-16T17:00:36.865276] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T17:00:36.870928] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-16T17:00:37.363091] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:00:37.374213] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-16T17:00:37.798293] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T17:00:37.804674] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-16T17:00:37.935980] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:00:37.943318] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-16T17:00:38.507327] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T17:00:38.544605] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-16T17:00:38.546027] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:00:38.559576] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-16T17:00:38.780813] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:00:38.787883] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-16T17:00:38.947592] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:00:38.959041] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-16T17:00:39.778907] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T17:00:39.785013] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-16T17:00:40.183582] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:00:40.195878] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-16T17:00:40.634749] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T17:00:40.656730] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-16T17:00:40.659563] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:00:40.663956] [INFO ] [REMOTE ] AB: Full fetch complete (44477 records). [2025-10-16T17:00:40.664114] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-16T17:00:41.127811] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:00:41.126266] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-16T17:00:41.127953] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-16T17:00:41.139515] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-16T17:00:41.139626] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-16T17:00:41.140628] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-16T17:00:41.142097] [DEBUG] [LOCAL ] AB: Trimmed 44477 records to 25663 (keeping 200 days of data) [2025-10-16T17:00:41.337987] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T17:00:41.344417] [DEBUG] [LOCAL ] AB: Primary data saved (25663 records). [2025-10-16T17:00:41.344737] [INFO ] [MAIN ] AB: Full history saved. [2025-10-16T17:00:41.344849] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AB took 14.9s. Estimated remaining: 3h 5m 14s. Rate: 12.7 symbols/min [2025-10-16T17:00:41.344971] [INFO ] [REMOTE ] ABCB: Full fetch complete (44830 records). [2025-10-16T17:00:41.357106] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-16T17:00:41.660560] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:41.847563] [DEBUG] [LOCAL ] ABG: Loaded 18383 existing records from primary storage. [2025-10-16T17:00:41.853742] [INFO ] [MAIN ] ABG: Loaded 18383 existing records. [2025-10-16T17:00:42.056563] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-16T17:00:42.066942] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-16T17:00:42.072749] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-16T17:00:42.096702] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-16T17:00:42.131325] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:42.131920] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-16T17:00:42.132048] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-16T17:00:42.132458] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-16T17:00:42.132526] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-16T17:00:42.165042] [DEBUG] [LOCAL ] ABCB: Trimmed 44830 records to 30801 (keeping 200 days of data) [2025-10-16T17:00:42.628450] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:42.630805] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-16T17:00:42.711269] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T17:00:42.743139] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-16T17:00:42.760224] [DEBUG] [LOCAL ] ABCB: Primary data saved (30801 records). [2025-10-16T17:00:42.760856] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-16T17:00:42.760968] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. ABCB took 14.3s. Estimated remaining: 2h 50m 46s. Rate: 13.8 symbols/min [2025-10-16T17:00:42.933405] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:42.933661] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-16T17:00:42.933726] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-16T17:00:42.933919] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-16T17:00:42.933991] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-16T17:00:42.934144] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-16T17:00:42.934240] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-16T17:00:43.260540] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T17:00:43.327020] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-16T17:00:43.359013] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:43.359424] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-16T17:00:43.702917] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:00:43.706202] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-16T17:00:44.405223] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:00:44.411279] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-16T17:00:44.911708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T17:00:44.924593] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-16T17:00:44.938136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:00:44.943095] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-16T17:00:45.003245] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:00:45.015018] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-16T17:00:45.364256] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:00:45.370348] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-16T17:00:46.095687] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:00:46.099979] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-16T17:00:46.177980] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:00:46.183160] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-16T17:00:46.475668] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T17:00:46.487508] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-16T17:00:46.881365] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:00:46.894610] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-16T17:00:47.278802] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T17:00:47.285864] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-16T17:00:47.316390] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T17:00:47.322178] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-16T17:00:48.372322] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:00:48.380741] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-16T17:00:48.435590] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T17:00:48.442607] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-16T17:00:48.601528] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T17:00:48.613035] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-16T17:00:48.680513] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:00:48.692346] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-16T17:00:49.356455] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T17:00:49.363374] [INFO ] [REMOTE ] ABBV: Full fetch complete (77456 records). [2025-10-16T17:00:49.363527] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-16T17:00:49.377890] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:00:49.378120] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:00:49.378222] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:00:49.379364] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:00:49.378878] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-16T17:00:49.384559] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-16T17:00:49.385080] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-16T17:00:49.385369] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-16T17:00:49.385451] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-16T17:00:49.386263] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABBV took 21.8s. Estimated remaining: 2h 59m 41s. Rate: 13.1 symbols/min [2025-10-16T17:00:49.452397] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:00:49.497939] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-16T17:00:49.579156] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:49.628638] [DEBUG] [LOCAL ] ABR: Loaded 51966 existing records from primary storage. [2025-10-16T17:00:49.628987] [INFO ] [MAIN ] ABR: Loaded 51966 existing records. [2025-10-16T17:00:49.805605] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:49.805813] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-16T17:00:49.805871] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-16T17:00:49.806073] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-16T17:00:49.806129] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-16T17:00:50.154855] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:50.155201] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-16T17:00:50.166735] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T17:00:50.170726] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-16T17:00:50.418850] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:00:50.425667] [INFO ] [REMOTE ] ABEV: Full fetch complete (77353 records). [2025-10-16T17:00:50.425787] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-16T17:00:50.845796] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-16T17:00:50.847410] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:00:50.846396] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-16T17:00:50.859761] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-16T17:00:50.861516] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-16T17:00:50.860750] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-16T17:00:50.870704] [DEBUG] [LOCAL ] ABEV: Trimmed 77353 records to 53668 (keeping 200 days of data) [2025-10-16T17:00:50.879468] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T17:00:50.948068] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-16T17:00:51.201203] [DEBUG] [LOCAL ] ABEV: Primary data saved (53668 records). [2025-10-16T17:00:51.201337] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-16T17:00:51.201414] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABEV took 21.2s. Estimated remaining: 2h 49m 46s. Rate: 13.9 symbols/min [2025-10-16T17:00:51.367402] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:51.416518] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-10-16T17:00:51.416842] [INFO ] [MAIN ] ABT: Loaded 53621 existing records. [2025-10-16T17:00:51.593605] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:51.593835] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-16T17:00:51.593901] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-16T17:00:51.594138] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-16T17:00:51.594193] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-16T17:00:51.943632] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:51.943913] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-16T17:00:52.079212] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:00:52.089337] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-16T17:00:52.137095] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T17:00:52.141495] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-16T17:00:52.423839] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T17:00:52.431011] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-16T17:00:52.826343] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T17:00:52.830338] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-16T17:00:53.454025] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:00:53.464616] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-16T17:00:53.687430] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:00:53.689968] [INFO ] [REMOTE ] ABG: Full fetch complete (26661 records). [2025-10-16T17:00:53.690046] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-16T17:00:53.824461] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:00:53.920415] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-16T17:00:54.145390] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-16T17:00:54.174888] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-16T17:00:54.175484] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-16T17:00:54.177132] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-16T17:00:54.176585] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-16T17:00:54.177313] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-16T17:00:54.179828] [DEBUG] [LOCAL ] ABG: Trimmed 26661 records to 18453 (keeping 200 days of data) [2025-10-16T17:00:54.286865] [DEBUG] [LOCAL ] ABG: Primary data saved (18453 records). [2025-10-16T17:00:54.287021] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-16T17:00:54.287102] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 12.9s. Estimated remaining: 2h 45m 39s. Rate: 14.2 symbols/min [2025-10-16T17:00:54.458670] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:54.480539] [DEBUG] [LOCAL ] ACA: Loaded 22955 existing records from primary storage. [2025-10-16T17:00:54.480851] [INFO ] [MAIN ] ACA: Loaded 22955 existing records. [2025-10-16T17:00:54.671300] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:54.671579] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-16T17:00:54.671677] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-16T17:00:54.671891] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-16T17:00:54.671950] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-16T17:00:55.032780] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:55.033219] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-16T17:00:55.495438] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:00:55.506609] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-16T17:00:55.593955] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:00:55.606386] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-16T17:00:55.642695] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:00:55.652605] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-16T17:00:55.840568] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T17:00:55.845046] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-16T17:00:56.594171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T17:00:56.609900] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:00:56.610556] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-16T17:00:56.615616] [INFO ] [REMOTE ] ABM: Full fetch complete (44951 records). [2025-10-16T17:00:56.615746] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-16T17:00:56.997081] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-16T17:00:56.997160] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-16T17:00:56.997679] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-16T17:00:56.997764] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-16T17:00:56.998771] [DEBUG] [LOCAL ] ABM: Trimmed 44951 records to 32403 (keeping 200 days of data) [2025-10-16T17:00:57.191019] [DEBUG] [LOCAL ] ABM: Primary data saved (32403 records). [2025-10-16T17:00:57.191151] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-16T17:00:57.191221] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABM took 14.4s. Estimated remaining: 2h 41m 37s. Rate: 14.6 symbols/min [2025-10-16T17:00:57.370337] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:00:57.399860] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:00:57.410237] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-16T17:00:57.437996] [DEBUG] [LOCAL ] ACCO: Loaded 37070 existing records from primary storage. [2025-10-16T17:00:57.438264] [INFO ] [MAIN ] ACCO: Loaded 37070 existing records. [2025-10-16T17:00:57.632119] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:00:57.632843] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-16T17:00:57.633191] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-16T17:00:57.646185] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-16T17:00:57.646601] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:00:57.646778] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-16T17:00:57.706351] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-16T17:00:58.025425] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:00:58.042915] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-16T17:00:58.055233] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-16T17:00:58.066406] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-16T17:00:59.004706] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:00:59.003193] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T17:00:59.022605] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-16T17:00:59.022365] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-16T17:00:59.171192] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:00:59.178728] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-16T17:00:59.473873] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:00:59.485254] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-16T17:01:00.194875] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:01:00.200946] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-16T17:01:00.432175] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:01:00.439731] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-16T17:01:00.671129] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T17:01:00.742807] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-16T17:01:01.032214] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T17:01:01.358397] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T17:01:01.478594] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:01:01.542774] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-16T17:01:02.325351] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:01:02.342771] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-16T17:01:03.144044] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T17:01:03.142975] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-16T17:01:03.754544] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:01:03.942824] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-16T17:01:04.577420] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T17:01:04.742817] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-16T17:01:05.292709] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:01:05.542799] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-16T17:01:05.576436] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T17:01:06.342846] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-16T17:01:07.109885] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:01:07.142839] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-16T17:01:07.867350] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:01:07.942835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-16T17:01:08.713929] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:01:08.742772] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-16T17:01:09.446977] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:01:09.542816] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-16T17:01:10.100842] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T17:01:10.342859] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-16T17:01:11.049982] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:01:11.142856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-16T17:01:11.942813] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-16T17:01:12.455053] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T17:01:12.483884] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:01:12.742825] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-16T17:01:13.034235] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T17:01:13.542808] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-16T17:01:13.840269] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:01:14.342862] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-16T17:01:15.142898] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-16T17:01:15.506089] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:01:15.525931] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:01:15.529562] [INFO ] [REMOTE ] ACA: Full fetch complete (34089 records). [2025-10-16T17:01:15.529850] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-16T17:01:15.530857] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:01:15.530971] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:01:15.531051] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:01:15.531161] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-16T17:01:15.531264] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-16T17:01:15.531341] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-16T17:01:15.532153] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-16T17:01:15.532288] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ACA took 21.2s. Estimated remaining: 3h 21m 26s. Rate: 11.7 symbols/min [2025-10-16T17:01:15.710527] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:15.737481] [DEBUG] [LOCAL ] ACEL: Loaded 26736 existing records from primary storage. [2025-10-16T17:01:15.737798] [INFO ] [MAIN ] ACEL: Loaded 26736 existing records. [2025-10-16T17:01:15.917223] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:15.917445] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-16T17:01:15.917497] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-16T17:01:15.917764] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-16T17:01:15.917822] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-16T17:01:15.949296] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-16T17:01:16.317464] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:16.642338] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:01:16.742844] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-16T17:01:17.542849] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-16T17:01:17.627626] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:01:17.636116] [INFO ] [REMOTE ] ABR: Full fetch complete (75436 records). [2025-10-16T17:01:17.636435] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-16T17:01:18.089083] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-16T17:01:18.089316] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-16T17:01:18.090262] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-16T17:01:18.090330] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-16T17:01:18.091868] [DEBUG] [LOCAL ] ABR: Trimmed 75436 records to 52354 (keeping 200 days of data) [2025-10-16T17:01:18.204564] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:01:18.342814] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-16T17:01:18.436472] [DEBUG] [LOCAL ] ABR: Primary data saved (52354 records). [2025-10-16T17:01:18.436617] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-16T17:01:18.436730] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ABR took 29.1s. Estimated remaining: 3h 15m 31s. Rate: 12.0 symbols/min [2025-10-16T17:01:18.605932] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:18.606107] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-16T17:01:18.606144] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-16T17:01:18.606256] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-16T17:01:18.606297] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-16T17:01:18.606337] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-16T17:01:18.606367] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-16T17:01:18.962175] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:19.116099] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T17:01:19.142814] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-16T17:01:19.473683] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T17:01:19.942890] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-16T17:01:20.742892] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-16T17:01:21.422298] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:01:21.542777] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-16T17:01:21.750709] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:01:21.758952] [INFO ] [REMOTE ] ABT: Full fetch complete (77764 records). [2025-10-16T17:01:21.759179] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-16T17:01:22.172218] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-10-16T17:01:22.228900] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-16T17:01:22.229002] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-16T17:01:22.229802] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-16T17:01:22.229865] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-16T17:01:22.231321] [DEBUG] [LOCAL ] ABT: Trimmed 77764 records to 54011 (keeping 200 days of data) [2025-10-16T17:01:22.346839] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-16T17:01:22.567337] [DEBUG] [LOCAL ] ABT: Primary data saved (54011 records). [2025-10-16T17:01:22.567467] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-16T17:01:22.568186] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABT took 31.4s. Estimated remaining: 3h 13m 21s. Rate: 12.2 symbols/min [2025-10-16T17:01:22.739820] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:22.762726] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T17:01:22.812077] [DEBUG] [LOCAL ] ACI: Loaded 53282 existing records from primary storage. [2025-10-16T17:01:22.812375] [INFO ] [MAIN ] ACI: Loaded 53282 existing records. [2025-10-16T17:01:22.986970] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:22.987205] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-16T17:01:22.987261] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-16T17:01:22.987598] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-16T17:01:22.987684] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-16T17:01:23.146735] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-16T17:01:23.359572] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:23.679845] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:01:23.684450] [INFO ] [REMOTE ] ACCO: Full fetch complete (54099 records). [2025-10-16T17:01:23.684568] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-16T17:01:23.947940] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-16T17:01:24.073821] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-16T17:01:24.073908] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-16T17:01:24.074493] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-16T17:01:24.074605] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-16T17:01:24.075957] [DEBUG] [LOCAL ] ACCO: Trimmed 54099 records to 37310 (keeping 200 days of data) [2025-10-16T17:01:24.287476] [DEBUG] [LOCAL ] ACCO: Primary data saved (37310 records). [2025-10-16T17:01:24.287634] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-16T17:01:24.287755] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 27.1s. Estimated remaining: 3h 5m 52s. Rate: 12.7 symbols/min [2025-10-16T17:01:24.460879] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:24.501964] [DEBUG] [LOCAL ] ACM: Loaded 42993 existing records from primary storage. [2025-10-16T17:01:24.502266] [INFO ] [MAIN ] ACM: Loaded 42993 existing records. [2025-10-16T17:01:24.685758] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:24.685959] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-16T17:01:24.686007] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-16T17:01:24.686220] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-16T17:01:24.686278] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-16T17:01:24.751547] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-16T17:01:25.057924] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:25.542795] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-16T17:01:25.647794] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:01:25.674469] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:01:25.718002] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-16T17:01:26.342821] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-16T17:01:27.142808] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-16T17:01:27.413108] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T17:01:27.942826] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-16T17:01:28.380439] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:01:28.742796] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-16T17:01:28.836047] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-16T17:01:29.245556] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T17:01:29.542834] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-16T17:01:29.718954] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:01:30.342935] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-16T17:01:31.147996] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-16T17:01:31.169398] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:01:31.903499] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T17:01:31.942778] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-16T17:01:32.742829] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-16T17:01:33.465037] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:01:33.542806] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-16T17:01:34.097750] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-16T17:01:34.183412] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:01:34.342824] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-16T17:01:34.731744] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:01:35.142878] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-16T17:01:35.942821] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-16T17:01:36.670069] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-16T17:01:36.723808] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:01:36.742784] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-16T17:01:37.430116] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T17:01:37.542861] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-16T17:01:38.224312] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:01:38.322275] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:01:38.342814] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-16T17:01:39.142859] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-16T17:01:39.495318] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T17:01:39.942820] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-16T17:01:40.742830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-16T17:01:41.468141] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:01:41.542789] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-16T17:01:41.718304] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-16T17:01:41.971739] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:01:42.342819] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-16T17:01:43.060704] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:01:43.142790] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-16T17:01:43.278777] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T17:01:43.942817] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-16T17:01:44.742802] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-16T17:01:44.833454] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:01:45.542866] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-16T17:01:45.837466] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:01:45.841638] [INFO ] [REMOTE ] ACEL: Full fetch complete (38894 records). [2025-10-16T17:01:45.841771] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-16T17:01:46.225443] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-16T17:01:46.225567] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-16T17:01:46.226145] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-16T17:01:46.226249] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-16T17:01:46.227707] [DEBUG] [LOCAL ] ACEL: Trimmed 38894 records to 26895 (keeping 200 days of data) [2025-10-16T17:01:46.349709] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-16T17:01:46.424201] [DEBUG] [LOCAL ] ACEL: Primary data saved (26895 records). [2025-10-16T17:01:46.424398] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-16T17:01:46.424503] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACEL took 30.9s. Estimated remaining: 3h 43m 39s. Rate: 10.5 symbols/min [2025-10-16T17:01:46.607789] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:46.662724] [DEBUG] [LOCAL ] ACN: Loaded 53439 existing records from primary storage. [2025-10-16T17:01:46.663263] [INFO ] [MAIN ] ACN: Loaded 53439 existing records. [2025-10-16T17:01:46.855787] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:46.856192] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-16T17:01:46.856358] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-16T17:01:46.856745] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-16T17:01:46.856814] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-16T17:01:47.089153] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-10-16T17:01:47.212343] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:01:47.254222] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-16T17:01:47.343122] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:47.676355] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:01:47.942821] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-16T17:01:48.742819] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-16T17:01:49.542789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-16T17:01:49.716177] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-16T17:01:49.780854] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:01:50.328975] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:01:50.342770] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-16T17:01:50.804193] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:01:51.142855] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-16T17:01:51.817446] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T17:01:51.942863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-16T17:01:52.742863] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-16T17:01:52.911903] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:01:53.542844] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-16T17:01:53.575379] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:01:54.342877] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-16T17:01:54.931628] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T17:01:55.142862] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-16T17:01:55.327146] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:01:55.911116] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:01:55.942840] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-16T17:01:56.742855] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-16T17:01:56.820210] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:01:56.825878] [INFO ] [REMOTE ] ACM: Full fetch complete (63156 records). [2025-10-16T17:01:56.826030] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-16T17:01:57.206020] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-16T17:01:57.206103] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-16T17:01:57.206724] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-16T17:01:57.206790] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-16T17:01:57.208167] [DEBUG] [LOCAL ] ACM: Trimmed 63156 records to 43294 (keeping 200 days of data) [2025-10-16T17:01:57.472192] [DEBUG] [LOCAL ] ACM: Primary data saved (43294 records). [2025-10-16T17:01:57.472352] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-16T17:01:57.473698] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACM took 33.2s. Estimated remaining: 3h 54m 34s. Rate: 10.0 symbols/min [2025-10-16T17:01:57.547948] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-16T17:01:57.640789] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:01:57.671486] [DEBUG] [LOCAL ] ACP: Loaded 30939 existing records from primary storage. [2025-10-16T17:01:57.671775] [INFO ] [MAIN ] ACP: Loaded 30939 existing records. [2025-10-16T17:01:57.844360] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:01:57.844600] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-16T17:01:57.844683] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-16T17:01:57.844984] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-16T17:01:57.845044] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-16T17:01:58.195554] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:01:58.342797] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-16T17:01:58.720039] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-16T17:01:58.838595] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T17:01:59.142811] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-16T17:01:59.486604] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T17:01:59.493499] [INFO ] [REMOTE ] ACI: Full fetch complete (77228 records). [2025-10-16T17:01:59.493637] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-16T17:01:59.891435] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-16T17:01:59.891587] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-16T17:01:59.892878] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-16T17:01:59.893027] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-16T17:01:59.895189] [DEBUG] [LOCAL ] ACI: Trimmed 77228 records to 53672 (keeping 200 days of data) [2025-10-16T17:01:59.964024] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-16T17:02:00.041377] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:02:00.279800] [DEBUG] [LOCAL ] ACI: Primary data saved (53672 records). [2025-10-16T17:02:00.280001] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-16T17:02:00.280620] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 37.7s. Estimated remaining: 3h 48m 14s. Rate: 10.3 symbols/min [2025-10-16T17:02:00.449852] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:00.458957] [DEBUG] [LOCAL ] ACR: Loaded 5445 existing records from primary storage. [2025-10-16T17:02:00.459178] [INFO ] [MAIN ] ACR: Loaded 5445 existing records. [2025-10-16T17:02:00.652164] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:00.652443] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-16T17:02:00.652518] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-16T17:02:00.652750] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-16T17:02:00.652818] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-16T17:02:00.752823] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-16T17:02:01.020697] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:01.544042] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T17:02:01.544230] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-16T17:02:01.901630] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T17:02:02.200215] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T17:02:02.342887] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-16T17:02:02.457075] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-16T17:02:02.465041] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-16T17:02:02.465189] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-16T17:02:02.892194] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-16T17:02:02.892498] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-16T17:02:02.893291] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-16T17:02:02.893355] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-16T17:02:02.894834] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-16T17:02:03.159868] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-16T17:02:03.210072] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-16T17:02:03.210211] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-16T17:02:03.210286] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACHR took 44.8s. Estimated remaining: 3h 42m 44s. Rate: 10.5 symbols/min [2025-10-16T17:02:03.378269] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:03.397009] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:02:03.430890] [DEBUG] [LOCAL ] ACRE: Loaded 33640 existing records from primary storage. [2025-10-16T17:02:03.431173] [INFO ] [MAIN ] ACRE: Loaded 33640 existing records. [2025-10-16T17:02:03.605954] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:03.606210] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-16T17:02:03.606268] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-16T17:02:03.607075] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-16T17:02:03.607135] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-16T17:02:03.856272] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T17:02:03.947388] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-16T17:02:03.961150] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:04.742839] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-16T17:02:05.542838] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-16T17:02:05.580572] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:02:06.178516] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:02:06.210606] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:02:06.342835] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-16T17:02:07.142867] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-16T17:02:07.816763] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:02:07.942822] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-16T17:02:08.609553] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:02:08.742840] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-16T17:02:09.302325] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:02:09.542825] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-16T17:02:09.903051] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:02:10.335979] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:02:10.342761] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-16T17:02:11.069597] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T17:02:11.142821] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-16T17:02:11.942820] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-16T17:02:12.148757] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:02:12.743209] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-16T17:02:13.541125] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:02:13.544381] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-16T17:02:13.796687] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T17:02:14.342852] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-16T17:02:14.464534] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T17:02:15.142811] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-16T17:02:15.863584] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:02:15.920422] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:02:15.942781] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-16T17:02:16.742834] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-16T17:02:17.044579] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T17:02:17.439194] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T17:02:17.542843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-16T17:02:18.181556] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T17:02:18.342842] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-16T17:02:19.142830] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-16T17:02:19.954063] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-16T17:02:19.970541] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:02:20.382624] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T17:02:20.742791] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-16T17:02:20.884609] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:02:21.542831] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-16T17:02:22.067853] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:02:22.342836] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-16T17:02:22.809464] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:02:23.142898] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-16T17:02:23.942843] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-16T17:02:24.394949] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:02:24.640058] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:02:24.644477] [INFO ] [REMOTE ] ACR: Full fetch complete (8533 records). [2025-10-16T17:02:24.646495] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-16T17:02:24.645158] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-16T17:02:24.747965] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-16T17:02:25.031451] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-16T17:02:25.031551] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-16T17:02:25.031783] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-16T17:02:25.031845] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-16T17:02:25.032322] [DEBUG] [LOCAL ] ACR: Trimmed 8533 records to 5466 (keeping 200 days of data) [2025-10-16T17:02:25.063831] [DEBUG] [LOCAL ] ACR: Primary data saved (5466 records). [2025-10-16T17:02:25.063964] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-16T17:02:25.064046] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACR took 24.8s. Estimated remaining: 4h 11m 22s. Rate: 9.3 symbols/min [2025-10-16T17:02:25.237869] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:25.247713] [DEBUG] [LOCAL ] ACV: Loaded 7659 existing records from primary storage. [2025-10-16T17:02:25.247943] [INFO ] [MAIN ] ACV: Loaded 7659 existing records. [2025-10-16T17:02:25.431955] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:25.432232] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-16T17:02:25.432295] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-16T17:02:25.432441] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-16T17:02:25.432482] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-16T17:02:25.547972] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-16T17:02:25.799641] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:25.821351] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:02:26.342834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-16T17:02:27.099542] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:02:27.105961] [INFO ] [REMOTE ] ACP: Full fetch complete (46580 records). [2025-10-16T17:02:27.106139] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-16T17:02:27.147931] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-16T17:02:27.525636] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-16T17:02:27.525774] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-16T17:02:27.526297] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-16T17:02:27.526342] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-16T17:02:27.527362] [DEBUG] [LOCAL ] ACP: Trimmed 46580 records to 31216 (keeping 200 days of data) [2025-10-16T17:02:27.705460] [DEBUG] [LOCAL ] ACP: Primary data saved (31216 records). [2025-10-16T17:02:27.705616] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-16T17:02:27.705734] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACP took 30.2s. Estimated remaining: 4h 4m 50s. Rate: 9.6 symbols/min [2025-10-16T17:02:27.871825] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:27.915027] [DEBUG] [LOCAL ] ACVA: Loaded 49299 existing records from primary storage. [2025-10-16T17:02:27.915355] [INFO ] [MAIN ] ACVA: Loaded 49299 existing records. [2025-10-16T17:02:27.956946] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-16T17:02:28.098707] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:28.099713] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-16T17:02:28.099801] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-16T17:02:28.100577] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-16T17:02:28.100636] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-16T17:02:28.464084] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:28.483188] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T17:02:28.572700] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T17:02:28.584890] [INFO ] [REMOTE ] ACN: Full fetch complete (77378 records). [2025-10-16T17:02:28.585090] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T17:02:28.585304] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-16T17:02:28.746760] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-16T17:02:28.990508] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-16T17:02:28.990589] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-16T17:02:28.991311] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-16T17:02:28.991380] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-16T17:02:28.992866] [DEBUG] [LOCAL ] ACN: Trimmed 77378 records to 53829 (keeping 200 days of data) [2025-10-16T17:02:29.335907] [DEBUG] [LOCAL ] ACN: Primary data saved (53829 records). [2025-10-16T17:02:29.336051] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-16T17:02:29.336131] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACN took 42.9s. Estimated remaining: 3h 57m 11s. Rate: 9.9 symbols/min [2025-10-16T17:02:29.509273] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:29.509434] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-16T17:02:29.509472] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-16T17:02:29.509581] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-16T17:02:29.509624] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-16T17:02:29.509702] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-16T17:02:29.509748] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-16T17:02:29.552700] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-16T17:02:29.877792] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:30.103569] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:02:30.285945] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:02:30.342816] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-16T17:02:31.142846] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-16T17:02:31.432119] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:02:31.942823] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-16T17:02:32.584369] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:02:32.742836] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-16T17:02:33.195245] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:02:33.542864] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-16T17:02:34.271906] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:02:34.342810] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-16T17:02:34.635316] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:02:34.640001] [INFO ] [REMOTE ] ACRE: Full fetch complete (49909 records). [2025-10-16T17:02:34.640150] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-16T17:02:35.054960] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-16T17:02:35.055076] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-16T17:02:35.055621] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-16T17:02:35.055699] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-16T17:02:35.056819] [DEBUG] [LOCAL ] ACRE: Trimmed 49909 records to 33901 (keeping 200 days of data) [2025-10-16T17:02:35.143074] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-16T17:02:35.261431] [DEBUG] [LOCAL ] ACRE: Primary data saved (33901 records). [2025-10-16T17:02:35.261584] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-16T17:02:35.261703] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACRE took 32.1s. Estimated remaining: 3h 56m 52s. Rate: 9.9 symbols/min [2025-10-16T17:02:35.454307] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:35.505459] [DEBUG] [LOCAL ] ADC: Loaded 46389 existing records from primary storage. [2025-10-16T17:02:35.505807] [INFO ] [MAIN ] ADC: Loaded 46389 existing records. [2025-10-16T17:02:35.685069] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:35.685326] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-16T17:02:35.685379] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-16T17:02:35.685564] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-16T17:02:35.685604] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-16T17:02:35.794777] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:02:35.946815] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-16T17:02:36.057209] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:36.090462] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T17:02:36.466260] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T17:02:36.742839] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-16T17:02:37.542813] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-16T17:02:38.316366] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:02:38.342769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-16T17:02:38.429141] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:02:39.142827] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-16T17:02:39.179172] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:02:39.327444] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:02:39.327762] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-16T17:02:39.327851] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:02:39.327902] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-16T17:02:39.327964] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:02:39.328039] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-16T17:02:39.328166] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-16T17:02:39.328224] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-16T17:02:39.328270] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-16T17:02:39.328326] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. AD took 10.0s. Estimated remaining: 3h 53m 46s. Rate: 10.0 symbols/min [2025-10-16T17:02:39.520184] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:39.520404] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-16T17:02:39.520449] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-16T17:02:39.520561] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-16T17:02:39.520604] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-16T17:02:39.520677] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-16T17:02:39.520732] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-16T17:02:39.886608] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:39.942775] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-16T17:02:40.742837] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-16T17:02:41.542813] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-16T17:02:41.811364] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T17:02:41.890789] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T17:02:42.342835] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-16T17:02:43.142804] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-16T17:02:43.235063] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:02:43.558986] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:02:43.814444] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:02:43.942801] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-16T17:02:44.742813] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-16T17:02:45.332884] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T17:02:45.542821] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-16T17:02:45.630788] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:02:46.342835] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-16T17:02:47.088126] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:02:47.123913] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:02:47.142795] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-16T17:02:47.942876] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-16T17:02:47.972322] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:02:48.742890] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-16T17:02:49.393249] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:02:49.542889] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-16T17:02:49.858481] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:02:50.342837] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-16T17:02:51.070455] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:02:51.142836] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-16T17:02:51.786800] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:02:51.942829] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-16T17:02:52.213339] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:02:52.215324] [INFO ] [REMOTE ] ACV: Full fetch complete (10426 records). [2025-10-16T17:02:52.215394] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-16T17:02:52.573087] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-16T17:02:52.573167] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-16T17:02:52.573372] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-16T17:02:52.573412] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-16T17:02:52.573875] [DEBUG] [LOCAL ] ACV: Trimmed 10426 records to 7694 (keeping 200 days of data) [2025-10-16T17:02:52.619910] [DEBUG] [LOCAL ] ACV: Primary data saved (7694 records). [2025-10-16T17:02:52.620038] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-16T17:02:52.620118] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACV took 27.6s. Estimated remaining: 4h 4m 13s. Rate: 9.6 symbols/min [2025-10-16T17:02:52.747909] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-16T17:02:52.797309] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:02:52.852010] [DEBUG] [LOCAL ] ADM: Loaded 53398 existing records from primary storage. [2025-10-16T17:02:52.852347] [INFO ] [MAIN ] ADM: Loaded 53398 existing records. [2025-10-16T17:02:53.028032] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:02:53.028295] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-16T17:02:53.028347] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-16T17:02:53.028635] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-16T17:02:53.028734] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-16T17:02:53.403324] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:02:53.542810] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-16T17:02:53.620004] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:02:54.175236] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:02:54.342857] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-16T17:02:55.142823] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-16T17:02:55.393688] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:02:55.553793] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:02:55.942839] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-16T17:02:56.188176] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:02:56.742832] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-16T17:02:57.450108] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:02:57.542850] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-16T17:02:57.924214] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:02:58.342823] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-16T17:02:58.975796] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:02:59.142851] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-16T17:02:59.634083] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:02:59.942873] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-16T17:03:00.444103] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:03:00.742775] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-16T17:03:01.216330] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T17:03:01.542856] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-16T17:03:02.342801] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-16T17:03:02.372482] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T17:03:02.379105] [INFO ] [REMOTE ] ACVA: Full fetch complete (70911 records). [2025-10-16T17:03:02.379269] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-16T17:03:02.769322] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-16T17:03:02.769416] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-16T17:03:02.770172] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-16T17:03:02.770236] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-16T17:03:02.771685] [DEBUG] [LOCAL ] ACVA: Trimmed 70911 records to 49671 (keeping 200 days of data) [2025-10-16T17:03:03.076614] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:03:03.094907] [DEBUG] [LOCAL ] ACVA: Primary data saved (49671 records). [2025-10-16T17:03:03.095037] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-16T17:03:03.095114] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACVA took 35.4s. Estimated remaining: 4h 9m 60s. Rate: 9.4 symbols/min [2025-10-16T17:03:03.150615] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-16T17:03:03.275908] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:03.322949] [DEBUG] [LOCAL ] ADNT: Loaded 46787 existing records from primary storage. [2025-10-16T17:03:03.323321] [INFO ] [MAIN ] ADNT: Loaded 46787 existing records. [2025-10-16T17:03:03.507661] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:03.507884] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-16T17:03:03.507938] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-16T17:03:03.508256] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-16T17:03:03.508354] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-16T17:03:03.869835] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:03.942772] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-16T17:03:04.352201] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:03:04.742867] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-16T17:03:04.798554] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:03:05.240353] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:03:05.542835] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-16T17:03:06.130831] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:03:06.342852] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-16T17:03:07.142802] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-16T17:03:07.370230] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T17:03:07.438130] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:03:07.942828] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-16T17:03:08.311170] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:03:08.742809] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-16T17:03:09.518482] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:03:09.524122] [INFO ] [REMOTE ] ADCT: Full fetch complete (51554 records). [2025-10-16T17:03:09.524225] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-16T17:03:09.555128] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-16T17:03:09.924805] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-16T17:03:09.924928] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-16T17:03:09.925448] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-16T17:03:09.925490] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-16T17:03:09.926512] [DEBUG] [LOCAL ] ADCT: Trimmed 51554 records to 35639 (keeping 200 days of data) [2025-10-16T17:03:10.115040] [DEBUG] [LOCAL ] ADCT: Primary data saved (35639 records). [2025-10-16T17:03:10.115191] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-16T17:03:10.115286] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ADCT took 30.8s. Estimated remaining: 4h 10m 43s. Rate: 9.3 symbols/min [2025-10-16T17:03:10.282399] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:10.330981] [DEBUG] [LOCAL ] ADT: Loaded 53443 existing records from primary storage. [2025-10-16T17:03:10.331298] [INFO ] [MAIN ] ADT: Loaded 53443 existing records. [2025-10-16T17:03:10.362015] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-16T17:03:10.509588] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:10.509907] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-16T17:03:10.510024] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-16T17:03:10.510323] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-16T17:03:10.510379] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-16T17:03:10.877556] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:10.911577] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T17:03:11.095718] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:03:11.142768] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-16T17:03:11.648551] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:03:11.942826] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-16T17:03:12.742811] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-16T17:03:12.948418] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:03:13.350626] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:03:13.542804] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-16T17:03:14.342787] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-16T17:03:14.661281] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:03:14.760571] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:03:15.142855] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-16T17:03:15.677344] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:03:15.682893] [INFO ] [REMOTE ] ADC: Full fetch complete (66159 records). [2025-10-16T17:03:15.683021] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-16T17:03:15.683693] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:03:15.683784] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:03:15.683826] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:03:15.683888] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-16T17:03:15.683950] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-16T17:03:15.683984] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-16T17:03:15.684161] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-16T17:03:15.684251] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 40.4s. Estimated remaining: 4h 9m 29s. Rate: 9.4 symbols/min [2025-10-16T17:03:15.850481] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:15.877108] [DEBUG] [LOCAL ] ADX: Loaded 27657 existing records from primary storage. [2025-10-16T17:03:15.877358] [INFO ] [MAIN ] ADX: Loaded 27657 existing records. [2025-10-16T17:03:15.950626] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-16T17:03:16.062387] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:16.062604] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-16T17:03:16.062681] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-16T17:03:16.062952] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-16T17:03:16.063010] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-16T17:03:16.423902] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:16.742788] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-16T17:03:17.183385] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T17:03:17.542880] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-16T17:03:17.580088] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:03:18.220824] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:03:18.342874] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-16T17:03:19.113134] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T17:03:19.142774] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-16T17:03:19.327069] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:03:19.942816] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-16T17:03:20.742847] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-16T17:03:20.864918] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T17:03:20.940830] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:03:21.542815] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-16T17:03:22.136499] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:03:22.342819] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-16T17:03:22.831345] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:03:23.142813] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-16T17:03:23.731954] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:03:23.942817] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-16T17:03:24.742796] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-16T17:03:24.860053] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:03:25.244225] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T17:03:25.542805] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-16T17:03:26.342814] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-16T17:03:26.621987] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T17:03:27.039273] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:03:27.142833] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-16T17:03:27.942840] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-16T17:03:28.110190] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:03:28.173886] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:03:28.742809] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-16T17:03:29.542777] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-16T17:03:29.632407] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T17:03:29.767465] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T17:03:30.342835] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-16T17:03:31.142787] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-16T17:03:31.544719] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:03:31.578180] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:03:31.942850] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-16T17:03:32.604893] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:03:32.742795] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-16T17:03:33.424409] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:03:33.542874] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-16T17:03:34.229846] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:03:34.235549] [INFO ] [REMOTE ] ADNT: Full fetch complete (67979 records). [2025-10-16T17:03:34.235736] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-16T17:03:34.347918] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-16T17:03:34.628591] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-16T17:03:34.628699] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-16T17:03:34.629424] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-16T17:03:34.629489] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-16T17:03:34.630845] [DEBUG] [LOCAL ] ADNT: Trimmed 67979 records to 47055 (keeping 200 days of data) [2025-10-16T17:03:34.894590] [DEBUG] [LOCAL ] ADNT: Primary data saved (47055 records). [2025-10-16T17:03:34.894737] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-16T17:03:34.894822] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADNT took 31.8s. Estimated remaining: 4h 25m 29s. Rate: 8.8 symbols/min [2025-10-16T17:03:35.066421] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:35.110624] [DEBUG] [LOCAL ] AEE: Loaded 50164 existing records from primary storage. [2025-10-16T17:03:35.110972] [INFO ] [MAIN ] AEE: Loaded 50164 existing records. [2025-10-16T17:03:35.153019] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-16T17:03:35.329477] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:35.331441] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:03:35.342282] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-16T17:03:35.342430] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-16T17:03:35.343001] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-16T17:03:35.343214] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-16T17:03:35.715853] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T17:03:35.720113] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:35.942791] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-16T17:03:36.742787] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-16T17:03:36.938842] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:03:37.509111] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T17:03:37.542783] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-16T17:03:37.584211] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:03:38.342858] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-16T17:03:38.902230] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:03:39.142851] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-16T17:03:39.764325] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:03:39.768475] [INFO ] [REMOTE ] ADX: Full fetch complete (41925 records). [2025-10-16T17:03:39.768565] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-16T17:03:39.944497] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-16T17:03:40.064893] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:03:40.108031] [INFO ] [REMOTE ] ADM: Full fetch complete (77056 records). [2025-10-16T17:03:40.129945] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-16T17:03:40.170358] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-16T17:03:40.170175] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:03:40.170539] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-16T17:03:40.171058] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-16T17:03:40.171137] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-16T17:03:40.170488] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:03:40.171318] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:03:40.171392] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-16T17:03:40.171757] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-16T17:03:40.171900] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-10-16T17:03:40.172241] [DEBUG] [LOCAL ] ADX: Trimmed 41925 records to 27929 (keeping 200 days of data) [2025-10-16T17:03:40.172274] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-10-16T17:03:40.172980] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 47.6s. Estimated remaining: 4h 23m 30s. Rate: 8.9 symbols/min [2025-10-16T17:03:40.445375] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:40.446736] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-16T17:03:40.447076] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-16T17:03:40.447990] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-16T17:03:40.448525] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-16T17:03:40.449902] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-16T17:03:40.450455] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-16T17:03:40.744371] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-16T17:03:40.873555] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:40.900913] [DEBUG] [LOCAL ] ADX: Primary data saved (27929 records). [2025-10-16T17:03:40.901022] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-16T17:03:40.901093] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADX took 25.2s. Estimated remaining: 4h 16m 16s. Rate: 9.1 symbols/min [2025-10-16T17:03:41.066153] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:41.108054] [DEBUG] [LOCAL ] AEG: Loaded 49572 existing records from primary storage. [2025-10-16T17:03:41.108343] [INFO ] [MAIN ] AEG: Loaded 49572 existing records. [2025-10-16T17:03:41.283699] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:41.283920] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-16T17:03:41.283973] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-16T17:03:41.284313] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-16T17:03:41.284354] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-16T17:03:41.547688] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-16T17:03:41.643172] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:41.697163] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T17:03:41.960546] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:03:42.197441] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T17:03:42.342819] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-16T17:03:43.142809] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-16T17:03:43.942779] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-16T17:03:44.036092] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:03:44.458702] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T17:03:44.491806] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:03:44.742779] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-16T17:03:45.542809] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-16T17:03:46.022416] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T17:03:46.342807] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-16T17:03:46.928586] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:03:47.142797] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-16T17:03:47.798070] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T17:03:47.942826] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-16T17:03:47.992155] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:03:48.742833] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-16T17:03:49.349791] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:03:49.458245] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:03:49.542790] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-16T17:03:50.049305] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T17:03:50.342831] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-16T17:03:51.142856] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-16T17:03:51.942786] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-16T17:03:52.206131] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T17:03:52.481131] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T17:03:52.742839] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-16T17:03:52.786742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:03:53.542817] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-16T17:03:54.234924] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:03:54.342833] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-16T17:03:54.582997] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T17:03:55.142821] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-16T17:03:55.942795] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-16T17:03:56.221518] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:03:56.228612] [INFO ] [REMOTE ] ADT: Full fetch complete (77366 records). [2025-10-16T17:03:56.228795] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-16T17:03:56.646548] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-16T17:03:56.647569] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T17:03:56.647657] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-16T17:03:56.651205] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-16T17:03:56.651353] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-16T17:03:56.652958] [DEBUG] [LOCAL ] ADT: Trimmed 77366 records to 53829 (keeping 200 days of data) [2025-10-16T17:03:56.678823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:03:56.745453] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-16T17:03:56.998602] [DEBUG] [LOCAL ] ADT: Primary data saved (53829 records). [2025-10-16T17:03:56.998771] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-16T17:03:56.998878] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 46.9s. Estimated remaining: 4h 27m 3s. Rate: 8.7 symbols/min [2025-10-16T17:03:57.168154] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:03:57.223961] [DEBUG] [LOCAL ] AEM: Loaded 53478 existing records from primary storage. [2025-10-16T17:03:57.224499] [INFO ] [MAIN ] AEM: Loaded 53478 existing records. [2025-10-16T17:03:57.442597] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:03:57.442915] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-16T17:03:57.442987] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-16T17:03:57.443594] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-16T17:03:57.443725] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-16T17:03:57.549478] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-16T17:03:57.578300] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:03:57.996140] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:03:58.342836] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-16T17:03:59.142822] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-16T17:03:59.447184] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:03:59.940110] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:03:59.949949] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-16T17:04:00.666809] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T17:04:00.742798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-16T17:04:01.542906] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-16T17:04:01.619460] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:04:02.342858] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-16T17:04:02.650350] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T17:04:02.879431] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:04:03.119681] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T17:04:03.142764] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-16T17:04:03.677289] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T17:04:03.678547] [INFO ] [REMOTE ] AEFC: Full fetch complete (11763 records). [2025-10-16T17:04:03.678631] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-16T17:04:03.682251] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:04:03.682406] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:04:03.682473] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:04:03.682545] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-16T17:04:03.682610] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-16T17:04:03.682679] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-16T17:04:03.682749] [DEBUG] [LOCAL ] AEFC: No derivative data file found to delete. [2025-10-16T17:04:03.682819] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 23.5s. Estimated remaining: 4h 26m 44s. Rate: 8.8 symbols/min [2025-10-16T17:04:03.857613] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:03.857825] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-10-16T17:04:03.857869] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-10-16T17:04:03.857980] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-16T17:04:03.858022] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-16T17:04:03.858065] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-16T17:04:03.858099] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-16T17:04:03.948011] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-16T17:04:04.218193] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:04.742830] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-16T17:04:05.542776] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-16T17:04:05.694030] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T17:04:06.008374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:04:06.342854] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-16T17:04:07.142851] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-16T17:04:07.465002] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:04:07.826173] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T17:04:07.833055] [INFO ] [REMOTE ] AEE: Full fetch complete (72991 records). [2025-10-16T17:04:07.833228] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-16T17:04:07.947943] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-16T17:04:08.231929] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-16T17:04:08.232272] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-16T17:04:08.233111] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-16T17:04:08.233181] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-16T17:04:08.234729] [DEBUG] [LOCAL ] AEE: Trimmed 72991 records to 50542 (keeping 200 days of data) [2025-10-16T17:04:08.537119] [DEBUG] [LOCAL ] AEE: Primary data saved (50542 records). [2025-10-16T17:04:08.537262] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-16T17:04:08.537353] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. AEE took 33.6s. Estimated remaining: 4h 24m 28s. Rate: 8.8 symbols/min [2025-10-16T17:04:08.708030] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:08.751899] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-16T17:04:08.755330] [DEBUG] [LOCAL ] AER: Loaded 48137 existing records from primary storage. [2025-10-16T17:04:08.755605] [INFO ] [MAIN ] AER: Loaded 48137 existing records. [2025-10-16T17:04:08.942913] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:08.943277] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-16T17:04:08.943345] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-16T17:04:08.957206] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-16T17:04:08.978151] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-16T17:04:09.040010] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T17:04:09.367473] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:09.542783] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-16T17:04:09.925135] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T17:04:10.227716] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T17:04:10.342805] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-16T17:04:11.142795] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-16T17:04:11.301731] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:04:11.942798] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-16T17:04:12.084562] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T17:04:12.742849] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-16T17:04:13.122412] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T17:04:13.542798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-16T17:04:13.621407] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:04:14.342868] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-16T17:04:14.456095] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T17:04:15.142821] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-16T17:04:15.585275] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T17:04:15.654268] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T17:04:15.942816] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-16T17:04:16.539840] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:04:16.742814] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-16T17:04:17.232557] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:04:17.542833] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-16T17:04:18.342863] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-16T17:04:18.549999] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:04:18.708793] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:04:19.142807] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-16T17:04:19.942812] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-16T17:04:20.135948] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:04:20.147237] [INFO ] [REMOTE ] AEG: Full fetch complete (70562 records). [2025-10-16T17:04:20.147578] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-16T17:04:20.560023] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-16T17:04:20.560152] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-16T17:04:20.561201] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-16T17:04:20.561284] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-16T17:04:20.563525] [DEBUG] [LOCAL ] AEG: Trimmed 70562 records to 49936 (keeping 200 days of data) [2025-10-16T17:04:20.752699] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-16T17:04:20.887103] [DEBUG] [LOCAL ] AEG: Primary data saved (49936 records). [2025-10-16T17:04:20.887481] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-16T17:04:20.887600] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEG took 40.0s. Estimated remaining: 4h 30m 11s. Rate: 8.6 symbols/min [2025-10-16T17:04:21.094192] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T17:04:21.548042] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-16T17:04:21.567805] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T17:04:22.342835] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-16T17:04:22.441578] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:04:23.142849] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-16T17:04:23.423397] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:04:23.942819] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-16T17:04:24.161809] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:04:24.705715] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:04:24.742786] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-16T17:04:25.542798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-16T17:04:25.884893] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T17:04:26.082442] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:04:26.342861] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-16T17:04:27.142803] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-16T17:04:27.378429] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:04:27.686865] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:04:27.942824] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-16T17:04:28.742836] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-16T17:04:28.985001] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:04:29.542836] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-16T17:04:29.701672] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:04:30.342840] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-16T17:04:30.467586] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:04:31.142799] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-16T17:04:31.512913] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:04:31.831888] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:04:31.942782] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-16T17:04:32.715669] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:04:32.722420] [INFO ] [REMOTE ] AEM: Full fetch complete (77433 records). [2025-10-16T17:04:32.722543] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-16T17:04:32.754479] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-16T17:04:33.138733] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-16T17:04:33.138814] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-16T17:04:33.139559] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-16T17:04:33.139621] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-16T17:04:33.141071] [DEBUG] [LOCAL ] AEM: Trimmed 77433 records to 53868 (keeping 200 days of data) [2025-10-16T17:04:33.498702] [DEBUG] [LOCAL ] AEM: Primary data saved (53868 records). [2025-10-16T17:04:33.505026] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-16T17:04:33.505117] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEM took 36.5s. Estimated remaining: 4h 35m 51s. Rate: 8.5 symbols/min [2025-10-16T17:04:33.506593] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:04:33.542764] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-16T17:04:34.588610] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:04:34.595488] [INFO ] [REMOTE ] AEO: Full fetch complete (77645 records). [2025-10-16T17:04:34.595613] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-16T17:04:34.989351] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-16T17:04:34.989499] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-16T17:04:34.990318] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-16T17:04:34.990400] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-16T17:04:35.006462] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:04:35.013035] [INFO ] [REMOTE ] AER: Full fetch complete (69925 records). [2025-10-16T17:04:35.012902] [DEBUG] [LOCAL ] AEO: Trimmed 77645 records to 53956 (keeping 200 days of data) [2025-10-16T17:04:35.013227] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-16T17:04:35.512734] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-16T17:04:35.513553] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-16T17:04:35.514828] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-16T17:04:35.514906] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-16T17:04:35.520201] [DEBUG] [LOCAL ] AER: Trimmed 69925 records to 48455 (keeping 200 days of data) [2025-10-16T17:04:36.053978] [DEBUG] [LOCAL ] AEO: Primary data saved (53956 records). [2025-10-16T17:04:36.054603] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-16T17:04:36.055217] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEO took 32.4s. Estimated remaining: 4h 31m 12s. Rate: 8.6 symbols/min [2025-10-16T17:04:36.062039] [DEBUG] [LOCAL ] AER: Primary data saved (48455 records). [2025-10-16T17:04:36.062177] [INFO ] [MAIN ] AER: Full history saved. [2025-10-16T17:04:36.062890] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AER took 27.5s. Estimated remaining: 4h 24m 19s. Rate: 8.8 symbols/min [2025-10-16T17:04:36.620809] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.746854] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.761850] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.765340] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:36.765760] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-16T17:04:36.766075] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-16T17:04:36.766327] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-10-16T17:04:36.766276] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-16T17:04:36.766621] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-16T17:04:36.766419] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-10-16T17:04:36.767015] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-16T17:04:36.766900] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-16T17:04:36.767142] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-16T17:04:36.767230] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-16T17:04:36.773066] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-16T17:04:36.797116] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-16T17:04:37.094208] [DEBUG] [LOCAL ] AESI: Loaded 49739 existing records from primary storage. [2025-10-16T17:04:37.148840] [INFO ] [MAIN ] AESI: Loaded 49739 existing records. [2025-10-16T17:04:37.387932] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-16T17:04:37.407526] [INFO ] [MAIN ] AES: Loaded 53669 existing records. [2025-10-16T17:04:37.667106] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:37.763357] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-16T17:04:37.833715] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:37.888757] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-16T17:04:37.897208] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-16T17:04:37.947125] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-16T17:04:37.951309] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-16T17:04:37.951132] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.004469] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:38.004999] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-16T17:04:38.028509] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-16T17:04:38.050182] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-16T17:04:38.065127] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-16T17:04:38.065668] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-16T17:04:38.065534] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:04:38.107245] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-16T17:04:38.136704] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:04:38.153492] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-16T17:04:38.164317] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:04:38.164503] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-16T17:04:38.234053] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-16T17:04:38.283782] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-16T17:04:38.343559] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-16T17:04:38.343758] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AEXA took 2.3s. Estimated remaining: 4h 19m 55s. Rate: 9.0 symbols/min [2025-10-16T17:04:38.961678] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.966031] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-16T17:04:38.965617] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:38.988621] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:38.990354] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-16T17:04:39.001434] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T17:04:39.004677] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-16T17:04:39.046305] [DEBUG] [LOCAL ] AFG: Loaded 32218 existing records from primary storage. [2025-10-16T17:04:39.046671] [INFO ] [MAIN ] AFG: Loaded 32218 existing records. [2025-10-16T17:04:39.226347] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:04:39.226629] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-16T17:04:39.226722] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-16T17:04:39.226922] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-16T17:04:39.226960] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-16T17:04:39.574011] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:39.574411] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-16T17:04:39.582265] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T17:04:39.585238] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-16T17:04:40.296901] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:04:40.305885] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-16T17:04:40.325966] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T17:04:40.555121] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T17:04:40.679289] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:04:40.742852] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-16T17:04:41.423721] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:04:41.542864] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-16T17:04:42.287949] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:04:42.342802] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-16T17:04:43.026238] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:04:43.142843] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-16T17:04:43.942872] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-16T17:04:44.329093] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-16T17:04:44.430786] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:04:44.580445] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T17:04:44.742861] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-16T17:04:45.542823] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-16T17:04:46.342827] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-16T17:04:46.815965] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T17:04:46.949258] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:04:46.973177] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T17:04:47.142873] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-16T17:04:47.942827] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-16T17:04:48.742857] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-16T17:04:48.946600] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:04:49.439399] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-16T17:04:49.542833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-16T17:04:49.901309] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:04:50.128146] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T17:04:50.342816] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-16T17:04:50.947790] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T17:04:51.142807] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-16T17:04:51.942819] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-16T17:04:52.571429] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T17:04:52.742902] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-16T17:04:53.542875] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-16T17:04:53.586159] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:04:54.078802] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:04:54.282121] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T17:04:54.342812] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-16T17:04:55.142776] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-16T17:04:55.212946] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T17:04:55.942841] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-16T17:04:56.742824] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-16T17:04:57.170377] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:04:57.255250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:04:57.542821] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-16T17:04:58.068564] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:04:58.342834] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-16T17:04:58.461122] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:04:58.462983] [INFO ] [REMOTE ] AFB: Full fetch complete (16517 records). [2025-10-16T17:04:58.463057] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-16T17:04:58.817572] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-16T17:04:58.817676] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-16T17:04:58.817942] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-16T17:04:58.817983] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-16T17:04:58.818538] [DEBUG] [LOCAL ] AFB: Trimmed 16517 records to 11274 (keeping 200 days of data) [2025-10-16T17:04:58.885412] [DEBUG] [LOCAL ] AFB: Primary data saved (11274 records). [2025-10-16T17:04:58.885545] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-16T17:04:58.885614] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AFB took 22.8s. Estimated remaining: 4h 32m 35s. Rate: 8.5 symbols/min [2025-10-16T17:04:59.057640] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:04:59.057863] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-16T17:04:59.057918] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-16T17:04:59.058056] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-16T17:04:59.058111] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-16T17:04:59.058157] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-16T17:04:59.058192] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-16T17:04:59.151098] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-16T17:04:59.432032] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:04:59.662121] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:04:59.942827] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-16T17:05:00.349108] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:05:00.742826] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-16T17:05:01.400901] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:05:01.513627] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T17:05:01.542781] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-16T17:05:02.343010] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-16T17:05:03.133757] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:05:03.142759] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-16T17:05:03.725502] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:05:03.942811] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-16T17:05:04.636810] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T17:05:04.742878] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-16T17:05:05.542820] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-16T17:05:05.650120] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:05:05.731200] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T17:05:06.015891] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T17:05:06.342801] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-16T17:05:07.142808] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-16T17:05:07.942795] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-16T17:05:08.027356] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:05:08.037492] [INFO ] [REMOTE ] AESI: Full fetch complete (71329 records). [2025-10-16T17:05:08.037674] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-16T17:05:08.420477] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-16T17:05:08.420561] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-16T17:05:08.421267] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-16T17:05:08.421332] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-16T17:05:08.422752] [DEBUG] [LOCAL ] AESI: Trimmed 71329 records to 50127 (keeping 200 days of data) [2025-10-16T17:05:08.719791] [DEBUG] [LOCAL ] AESI: Primary data saved (50127 records). [2025-10-16T17:05:08.719913] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-16T17:05:08.719989] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AESI took 32.7s. Estimated remaining: 4h 35m 0s. Rate: 8.5 symbols/min [2025-10-16T17:05:08.751012] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-16T17:05:08.907126] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:08.912778] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-16T17:05:08.912976] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-16T17:05:09.154497] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:05:09.152942] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:09.168685] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-16T17:05:09.169736] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-16T17:05:09.172760] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-16T17:05:09.172880] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-16T17:05:09.172696] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T17:05:09.269493] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T17:05:09.549358] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-16T17:05:09.568294] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:10.342846] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-16T17:05:11.142856] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-16T17:05:11.480028] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T17:05:11.485223] [INFO ] [REMOTE ] AFG: Full fetch complete (46730 records). [2025-10-16T17:05:11.485420] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-16T17:05:11.594744] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T17:05:11.818203] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T17:05:11.925040] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-16T17:05:11.925113] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-16T17:05:11.925591] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-16T17:05:11.925631] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-16T17:05:11.926662] [DEBUG] [LOCAL ] AFG: Trimmed 46730 records to 32434 (keeping 200 days of data) [2025-10-16T17:05:11.980986] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-16T17:05:12.131294] [DEBUG] [LOCAL ] AFG: Primary data saved (32434 records). [2025-10-16T17:05:12.131486] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-16T17:05:12.131586] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AFG took 33.8s. Estimated remaining: 4h 31m 39s. Rate: 8.6 symbols/min [2025-10-16T17:05:12.304298] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:12.308438] [DEBUG] [LOCAL ] AFGD: Loaded 1772 existing records from primary storage. [2025-10-16T17:05:12.308596] [INFO ] [MAIN ] AFGD: Loaded 1772 existing records. [2025-10-16T17:05:12.487047] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:12.487281] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-16T17:05:12.487329] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-16T17:05:12.487454] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-16T17:05:12.487494] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-16T17:05:12.746846] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-16T17:05:12.780882] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T17:05:12.864690] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:13.542820] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-16T17:05:14.086581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:05:14.342789] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-16T17:05:14.831134] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:05:14.832497] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T17:05:15.142819] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-16T17:05:15.942863] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-16T17:05:16.333930] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T17:05:16.742865] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-16T17:05:17.195636] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T17:05:17.357211] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-16T17:05:17.364058] [INFO ] [REMOTE ] AES: Full fetch complete (77847 records). [2025-10-16T17:05:17.364213] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-16T17:05:17.556778] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-16T17:05:17.756389] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-16T17:05:17.756478] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-16T17:05:17.757288] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-16T17:05:17.757358] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-16T17:05:17.758872] [DEBUG] [LOCAL ] AES: Trimmed 77847 records to 54059 (keeping 200 days of data) [2025-10-16T17:05:17.974797] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:05:18.094125] [DEBUG] [LOCAL ] AES: Primary data saved (54059 records). [2025-10-16T17:05:18.094282] [INFO ] [MAIN ] AES: Full history saved. [2025-10-16T17:05:18.094367] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AES took 42.0s. Estimated remaining: 4h 30m 37s. Rate: 8.6 symbols/min [2025-10-16T17:05:18.270277] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:18.274961] [DEBUG] [LOCAL ] AFGE: Loaded 2374 existing records from primary storage. [2025-10-16T17:05:18.275137] [INFO ] [MAIN ] AFGE: Loaded 2374 existing records. [2025-10-16T17:05:18.347953] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-16T17:05:18.465315] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:18.465556] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-16T17:05:18.465607] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-16T17:05:18.465793] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-16T17:05:18.465851] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-16T17:05:18.866479] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:18.870500] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T17:05:19.142804] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-16T17:05:19.474143] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-16T17:05:19.942803] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-16T17:05:20.251581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-16T17:05:20.742812] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-16T17:05:21.177377] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:05:21.542869] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-16T17:05:22.080365] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T17:05:22.342831] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-16T17:05:22.793426] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T17:05:23.142803] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-16T17:05:23.589242] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T17:05:23.942837] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-16T17:05:24.439869] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:05:24.742819] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-16T17:05:25.200112] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:05:25.542846] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-16T17:05:26.152146] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:05:26.342862] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-16T17:05:26.886998] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:05:26.887789] [INFO ] [REMOTE ] AFGB: Full fetch complete (3543 records). [2025-10-16T17:05:26.887857] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-16T17:05:26.888198] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:05:26.888280] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:05:26.888323] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:05:26.888362] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-16T17:05:26.888415] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-16T17:05:26.888449] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-16T17:05:26.888537] [DEBUG] [LOCAL ] AFGB: No derivative data file found to delete. [2025-10-16T17:05:26.888607] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGB took 28.0s. Estimated remaining: 4h 32m 2s. Rate: 8.5 symbols/min [2025-10-16T17:05:27.060485] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:27.112322] [DEBUG] [LOCAL ] AFL: Loaded 53190 existing records from primary storage. [2025-10-16T17:05:27.112636] [INFO ] [MAIN ] AFL: Loaded 53190 existing records. [2025-10-16T17:05:27.147946] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-16T17:05:27.302253] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:27.302468] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-16T17:05:27.302516] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-16T17:05:27.303441] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-16T17:05:27.303511] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-16T17:05:27.580729] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:05:27.666914] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:27.942809] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-16T17:05:28.355830] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T17:05:28.742813] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-16T17:05:29.301034] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:05:29.542857] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-16T17:05:29.975612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T17:05:30.342865] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-16T17:05:31.142831] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-16T17:05:31.641184] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T17:05:31.942794] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-16T17:05:32.227731] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:05:32.515492] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:05:32.742851] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-16T17:05:33.183404] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:05:33.542808] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-16T17:05:33.949604] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T17:05:33.950415] [INFO ] [REMOTE ] AFGC: Full fetch complete (3666 records). [2025-10-16T17:05:33.950486] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-16T17:05:34.295938] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-16T17:05:34.296012] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-16T17:05:34.296131] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-16T17:05:34.296168] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-16T17:05:34.296503] [DEBUG] [LOCAL ] AFGC: Trimmed 3666 records to 2570 (keeping 200 days of data) [2025-10-16T17:05:34.312252] [DEBUG] [LOCAL ] AFGC: Primary data saved (2570 records). [2025-10-16T17:05:34.312337] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-16T17:05:34.312410] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGC took 25.6s. Estimated remaining: 4h 32m 14s. Rate: 8.5 symbols/min [2025-10-16T17:05:34.343735] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-16T17:05:34.481917] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:34.482070] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-16T17:05:34.482106] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-16T17:05:34.482215] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-16T17:05:34.482256] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-16T17:05:34.482296] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-16T17:05:34.482328] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-16T17:05:34.825597] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:35.142813] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-16T17:05:35.831765] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:05:35.942777] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-16T17:05:36.057228] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:05:36.476091] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:05:36.742850] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-16T17:05:37.542822] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-16T17:05:37.966844] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T17:05:38.342831] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-16T17:05:38.466450] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T17:05:38.653183] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T17:05:39.142800] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-16T17:05:39.474098] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T17:05:39.942805] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-16T17:05:40.442591] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T17:05:40.742816] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-16T17:05:41.542854] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-16T17:05:41.881298] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-16T17:05:42.342801] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-16T17:05:42.712342] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T17:05:42.775686] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-16T17:05:43.142796] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-16T17:05:43.560588] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T17:05:43.942828] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-16T17:05:44.742830] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-16T17:05:45.542823] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-16T17:05:45.892062] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T17:05:45.931517] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-16T17:05:46.306382] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:05:46.342829] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-16T17:05:47.142850] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-16T17:05:47.942923] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-16T17:05:48.161510] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T17:05:48.654006] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:05:48.742836] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-16T17:05:49.107900] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T17:05:49.308832] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:05:49.542884] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-16T17:05:49.972636] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T17:05:49.973361] [INFO ] [REMOTE ] AFGD: Full fetch complete (2936 records). [2025-10-16T17:05:49.973429] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-16T17:05:50.346683] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-16T17:05:50.372044] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-16T17:05:50.372122] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-16T17:05:50.372261] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-16T17:05:50.372315] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-16T17:05:50.372753] [DEBUG] [LOCAL ] AFGD: Trimmed 2936 records to 1786 (keeping 200 days of data) [2025-10-16T17:05:50.383623] [DEBUG] [LOCAL ] AFGD: Primary data saved (1786 records). [2025-10-16T17:05:50.383714] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-16T17:05:50.383829] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGD took 38.3s. Estimated remaining: 4h 39m 24s. Rate: 8.3 symbols/min [2025-10-16T17:05:50.564054] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:50.606629] [DEBUG] [LOCAL ] AGCO: Loaded 42395 existing records from primary storage. [2025-10-16T17:05:50.606943] [INFO ] [MAIN ] AGCO: Loaded 42395 existing records. [2025-10-16T17:05:50.831107] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:50.831304] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-16T17:05:50.831351] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-16T17:05:50.831523] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-16T17:05:50.831563] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-16T17:05:51.147880] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-16T17:05:51.206786] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:51.942797] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-16T17:05:52.030468] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:05:52.190542] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-16T17:05:52.742817] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-16T17:05:53.177775] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T17:05:53.178513] [INFO ] [REMOTE ] AFGE: Full fetch complete (3395 records). [2025-10-16T17:05:53.178581] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-16T17:05:53.511419] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-16T17:05:53.564299] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-16T17:05:53.618700] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-16T17:05:53.618820] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-16T17:05:53.618975] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-16T17:05:53.619053] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-16T17:05:53.619415] [DEBUG] [LOCAL ] AFGE: Trimmed 3395 records to 2380 (keeping 200 days of data) [2025-10-16T17:05:53.634667] [DEBUG] [LOCAL ] AFGE: Primary data saved (2380 records). [2025-10-16T17:05:53.634766] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-16T17:05:53.634839] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGE took 35.5s. Estimated remaining: 4h 36m 9s. Rate: 8.4 symbols/min [2025-10-16T17:05:53.811265] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:05:53.829506] [DEBUG] [LOCAL ] AGD: Loaded 19317 existing records from primary storage. [2025-10-16T17:05:53.829774] [INFO ] [MAIN ] AGD: Loaded 19317 existing records. [2025-10-16T17:05:54.032098] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:05:54.032334] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-16T17:05:54.032407] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-16T17:05:54.032889] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-16T17:05:54.032948] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-16T17:05:54.347977] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-16T17:05:54.410277] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:05:55.142787] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-16T17:05:55.376786] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T17:05:55.942886] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-16T17:05:56.498561] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:05:56.664977] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-16T17:05:56.742827] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-16T17:05:57.543525] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-16T17:05:57.543455] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:05:58.342829] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-16T17:05:58.470569] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:05:59.142857] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-16T17:05:59.352460] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:05:59.395136] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:05:59.942864] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-16T17:06:00.668588] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:06:00.742777] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-16T17:06:01.196315] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:06:01.542812] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-16T17:06:02.342882] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-16T17:06:02.805183] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T17:06:03.020364] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:06:03.142786] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-16T17:06:03.211600] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:06:03.942822] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-16T17:06:04.637729] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:06:04.742813] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-16T17:06:05.542811] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-16T17:06:05.604673] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:06:06.176596] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:06:06.183365] [INFO ] [REMOTE ] AFL: Full fetch complete (77073 records). [2025-10-16T17:06:06.183471] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-16T17:06:06.354689] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-16T17:06:06.571341] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-16T17:06:06.571414] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-16T17:06:06.572159] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-16T17:06:06.572222] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-16T17:06:06.573561] [DEBUG] [LOCAL ] AFL: Trimmed 77073 records to 53580 (keeping 200 days of data) [2025-10-16T17:06:06.901387] [DEBUG] [LOCAL ] AFL: Primary data saved (53580 records). [2025-10-16T17:06:06.901546] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-16T17:06:06.902301] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 40.0s. Estimated remaining: 4h 40m 46s. Rate: 8.3 symbols/min [2025-10-16T17:06:07.070326] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:07.079311] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:06:07.127764] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-16T17:06:07.128061] [INFO ] [MAIN ] AGI: Loaded 53424 existing records. [2025-10-16T17:06:07.148419] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-16T17:06:07.307004] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:07.307187] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-16T17:06:07.307233] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-16T17:06:07.308152] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-16T17:06:07.308231] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-16T17:06:07.658575] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:07.830428] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T17:06:07.942774] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-16T17:06:08.184005] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T17:06:08.742876] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-16T17:06:09.542773] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-16T17:06:09.650971] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:06:10.342783] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-16T17:06:10.416585] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T17:06:10.536510] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:06:11.142816] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-16T17:06:11.937555] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:06:11.948009] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-16T17:06:12.529717] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:06:12.742817] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-16T17:06:13.542792] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-16T17:06:13.807989] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:06:14.213928] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-16T17:06:14.342851] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-16T17:06:14.991111] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:06:15.018491] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:06:15.142846] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-16T17:06:15.942811] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-16T17:06:16.706334] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T17:06:16.742791] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-16T17:06:17.080145] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T17:06:17.542821] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-16T17:06:18.167484] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:06:18.349743] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-16T17:06:18.351799] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:06:19.142813] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-16T17:06:19.942816] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-16T17:06:20.356850] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:06:20.360739] [INFO ] [REMOTE ] AGD: Full fetch complete (26579 records). [2025-10-16T17:06:20.360886] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-16T17:06:20.755005] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-16T17:06:20.752931] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-16T17:06:20.756280] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-16T17:06:20.756774] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-16T17:06:20.756858] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-16T17:06:20.758067] [DEBUG] [LOCAL ] AGD: Trimmed 26579 records to 19404 (keeping 200 days of data) [2025-10-16T17:06:20.779161] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-16T17:06:20.870154] [INFO ] [REMOTE ] AG: Full fetch complete (77780 records). [2025-10-16T17:06:20.895738] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-16T17:06:20.904681] [DEBUG] [LOCAL ] AGD: Primary data saved (19404 records). [2025-10-16T17:06:20.904920] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-16T17:06:20.905014] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGD took 27.3s. Estimated remaining: 4h 45m 45s. Rate: 8.1 symbols/min [2025-10-16T17:06:21.210967] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:21.519065] [DEBUG] [LOCAL ] AGL: Loaded 52580 existing records from primary storage. [2025-10-16T17:06:21.541099] [INFO ] [MAIN ] AGL: Loaded 52580 existing records. [2025-10-16T17:06:21.541398] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-16T17:06:21.572260] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-16T17:06:21.578703] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-16T17:06:21.597502] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-16T17:06:21.659962] [DEBUG] [LOCAL ] AG: Trimmed 77780 records to 54033 (keeping 200 days of data) [2025-10-16T17:06:21.798242] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:21.825161] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-16T17:06:21.825894] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-16T17:06:21.834728] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-16T17:06:21.838847] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-16T17:06:21.899971] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T17:06:22.064394] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-16T17:06:22.392124] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:22.392472] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-16T17:06:22.476074] [DEBUG] [LOCAL ] AG: Primary data saved (54033 records). [2025-10-16T17:06:22.476246] [INFO ] [MAIN ] AG: Full history saved. [2025-10-16T17:06:22.476326] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AG took 48.2s. Estimated remaining: 4h 41m 18s. Rate: 8.2 symbols/min [2025-10-16T17:06:22.647057] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:22.660190] [DEBUG] [LOCAL ] AGM: Loaded 10719 existing records from primary storage. [2025-10-16T17:06:22.660460] [INFO ] [MAIN ] AGM: Loaded 10719 existing records. [2025-10-16T17:06:22.861565] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-16T17:06:22.874828] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:22.886562] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-16T17:06:22.886629] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-16T17:06:22.886895] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-16T17:06:22.886952] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-16T17:06:23.151939] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-16T17:06:23.231446] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:23.727679] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:06:23.942826] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-16T17:06:24.346706] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:06:24.742875] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-16T17:06:25.119862] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:06:25.532062] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T17:06:25.542766] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-16T17:06:26.059912] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:06:26.342804] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-16T17:06:27.147919] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-16T17:06:27.162482] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:06:27.171105] [INFO ] [REMOTE ] AGCO: Full fetch complete (61670 records). [2025-10-16T17:06:27.171259] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-16T17:06:27.561910] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-16T17:06:27.562040] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-16T17:06:27.562728] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-16T17:06:27.562819] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-16T17:06:27.564363] [DEBUG] [LOCAL ] AGCO: Trimmed 61670 records to 42651 (keeping 200 days of data) [2025-10-16T17:06:27.716341] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:06:27.862147] [DEBUG] [LOCAL ] AGCO: Primary data saved (42651 records). [2025-10-16T17:06:27.862238] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-16T17:06:27.863090] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGCO took 37.5s. Estimated remaining: 4h 39m 48s. Rate: 8.3 symbols/min [2025-10-16T17:06:27.947957] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-16T17:06:28.038830] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:28.069179] [DEBUG] [LOCAL ] AGO: Loaded 27929 existing records from primary storage. [2025-10-16T17:06:28.069449] [INFO ] [MAIN ] AGO: Loaded 27929 existing records. [2025-10-16T17:06:28.186940] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T17:06:28.266882] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:28.267092] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-16T17:06:28.267140] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-16T17:06:28.267772] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-16T17:06:28.267830] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-16T17:06:28.627575] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:28.742856] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-16T17:06:29.418787] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:06:29.542815] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-16T17:06:29.923176] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:06:30.342860] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-16T17:06:31.142803] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-16T17:06:31.249053] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:06:31.369144] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:06:31.772463] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:06:31.942830] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-16T17:06:32.742850] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-16T17:06:33.424194] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T17:06:33.542822] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-16T17:06:33.750870] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:06:34.128461] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:06:34.342811] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-16T17:06:35.142796] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-16T17:06:35.447600] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T17:06:35.942825] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-16T17:06:36.742782] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-16T17:06:36.760318] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T17:06:37.439128] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T17:06:37.542822] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-16T17:06:38.065678] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:06:38.342833] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-16T17:06:39.142794] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-16T17:06:39.267621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:06:39.339178] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T17:06:39.942798] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-16T17:06:39.960149] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:06:40.742873] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-16T17:06:41.406343] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:06:41.542831] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-16T17:06:41.841782] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:06:42.342878] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-16T17:06:43.142770] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-16T17:06:43.420389] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T17:06:43.638455] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T17:06:43.942867] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-16T17:06:44.740216] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:06:44.745036] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-16T17:06:44.974392] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:06:45.542771] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-16T17:06:45.590296] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:06:46.177066] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T17:06:46.342893] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-16T17:06:46.868794] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T17:06:47.142843] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-16T17:06:47.942844] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-16T17:06:48.605985] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T17:06:48.742788] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-16T17:06:49.008067] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:06:49.542863] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-16T17:06:50.342859] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-16T17:06:50.612317] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:06:50.695247] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T17:06:51.142881] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-16T17:06:51.658062] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:06:51.661237] [INFO ] [REMOTE ] AGM: Full fetch complete (13276 records). [2025-10-16T17:06:51.661357] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-16T17:06:51.948507] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-16T17:06:52.043575] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-16T17:06:52.043691] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-16T17:06:52.043941] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-16T17:06:52.043983] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-16T17:06:52.044730] [DEBUG] [LOCAL ] AGM: Trimmed 13276 records to 10792 (keeping 200 days of data) [2025-10-16T17:06:52.111212] [DEBUG] [LOCAL ] AGM: Primary data saved (10792 records). [2025-10-16T17:06:52.111349] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-16T17:06:52.111429] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 29.6s. Estimated remaining: 4h 51m 49s. Rate: 7.9 symbols/min [2025-10-16T17:06:52.277794] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:52.307266] [DEBUG] [LOCAL ] AGRO: Loaded 33087 existing records from primary storage. [2025-10-16T17:06:52.307523] [INFO ] [MAIN ] AGRO: Loaded 33087 existing records. [2025-10-16T17:06:52.485384] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:52.485760] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-16T17:06:52.485906] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-16T17:06:52.486547] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-16T17:06:52.486606] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-16T17:06:52.603900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:06:52.747893] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-16T17:06:52.864444] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:53.542859] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-16T17:06:53.596254] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:06:53.603604] [INFO ] [REMOTE ] AGL: Full fetch complete (75889 records). [2025-10-16T17:06:53.603816] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-16T17:06:53.780790] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:06:54.035165] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-16T17:06:54.035258] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-16T17:06:54.036210] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-16T17:06:54.036283] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-16T17:06:54.037864] [DEBUG] [LOCAL ] AGL: Trimmed 75889 records to 52970 (keeping 200 days of data) [2025-10-16T17:06:54.344386] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-16T17:06:54.358997] [DEBUG] [LOCAL ] AGL: Primary data saved (52970 records). [2025-10-16T17:06:54.359097] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-16T17:06:54.359189] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGL took 33.5s. Estimated remaining: 4h 47m 58s. Rate: 8.0 symbols/min [2025-10-16T17:06:54.588445] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:54.624956] [DEBUG] [LOCAL ] AGX: Loaded 32884 existing records from primary storage. [2025-10-16T17:06:54.625288] [INFO ] [MAIN ] AGX: Loaded 32884 existing records. [2025-10-16T17:06:54.818478] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:54.818716] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-16T17:06:54.818773] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-16T17:06:54.819167] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-16T17:06:54.819224] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-16T17:06:55.148620] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-16T17:06:55.173217] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:55.509490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:06:55.950471] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:06:55.947508] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-16T17:06:56.337769] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:06:56.342249] [INFO ] [REMOTE ] AGO: Full fetch complete (39721 records). [2025-10-16T17:06:56.342396] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-16T17:06:56.722843] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-16T17:06:56.722967] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-16T17:06:56.723401] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-16T17:06:56.723444] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-16T17:06:56.724561] [DEBUG] [LOCAL ] AGO: Trimmed 39721 records to 28168 (keeping 200 days of data) [2025-10-16T17:06:56.777924] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-16T17:06:56.896461] [DEBUG] [LOCAL ] AGO: Primary data saved (28168 records). [2025-10-16T17:06:56.896635] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-16T17:06:56.896781] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 29.0s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-10-16T17:06:57.064296] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:57.102296] [DEBUG] [LOCAL ] AHH: Loaded 40527 existing records from primary storage. [2025-10-16T17:06:57.102621] [INFO ] [MAIN ] AHH: Loaded 40527 existing records. [2025-10-16T17:06:57.294479] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:06:57.294705] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-16T17:06:57.294760] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-16T17:06:57.294956] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-16T17:06:57.295012] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-16T17:06:57.547903] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-16T17:06:57.649223] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:57.916146] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:06:57.923468] [INFO ] [REMOTE ] AGI: Full fetch complete (77257 records). [2025-10-16T17:06:57.923750] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-16T17:06:58.123898] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:06:58.357451] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-16T17:06:58.361309] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-16T17:06:58.362114] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-16T17:06:58.362887] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-16T17:06:58.362950] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-16T17:06:58.364370] [DEBUG] [LOCAL ] AGI: Trimmed 77257 records to 53813 (keeping 200 days of data) [2025-10-16T17:06:58.680949] [DEBUG] [LOCAL ] AGI: Primary data saved (53813 records). [2025-10-16T17:06:58.681093] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-16T17:06:58.681172] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGI took 51.8s. Estimated remaining: 4h 40m 33s. Rate: 8.2 symbols/min [2025-10-16T17:06:58.849685] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:06:58.849979] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-16T17:06:58.850055] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-16T17:06:58.850164] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-16T17:06:58.850205] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-16T17:06:58.850246] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-16T17:06:58.850277] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-16T17:06:59.142869] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-16T17:06:59.144359] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:06:59.228311] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:06:59.942826] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-16T17:06:59.998698] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:07:00.254061] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:07:00.254519] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-16T17:07:00.254638] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:07:00.254752] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-16T17:07:00.254828] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:07:00.254914] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-16T17:07:00.254999] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-16T17:07:00.255050] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-16T17:07:00.255104] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-16T17:07:00.255171] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AHL took 1.6s. Estimated remaining: 4h 36m 38s. Rate: 8.4 symbols/min [2025-10-16T17:07:00.466706] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:00.490054] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:07:00.541730] [DEBUG] [LOCAL ] AHR: Loaded 49077 existing records from primary storage. [2025-10-16T17:07:00.542056] [INFO ] [MAIN ] AHR: Loaded 49077 existing records. [2025-10-16T17:07:00.736049] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:00.736298] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-16T17:07:00.736358] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-16T17:07:00.736669] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-16T17:07:00.736728] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-16T17:07:00.747984] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-16T17:07:01.091797] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:01.542863] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-16T17:07:02.342828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-16T17:07:02.690808] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T17:07:03.131622] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:07:03.142775] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-16T17:07:03.905717] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T17:07:03.942820] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-16T17:07:04.663675] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:07:04.742773] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-16T17:07:05.316495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:07:05.542814] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-16T17:07:05.854626] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:07:06.342812] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-16T17:07:07.133415] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T17:07:07.142783] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-16T17:07:07.939943] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:07:07.948922] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-16T17:07:08.238265] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:07:08.742828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-16T17:07:09.130337] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:07:09.542828] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-16T17:07:10.224501] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:07:10.342804] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-16T17:07:11.093082] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:07:11.142819] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-16T17:07:11.440214] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T17:07:11.942818] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-16T17:07:12.458291] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:07:12.742811] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-16T17:07:12.930164] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T17:07:13.542817] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-16T17:07:14.276136] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:07:14.342802] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-16T17:07:15.142785] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-16T17:07:15.223220] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T17:07:15.733367] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:07:15.942840] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-16T17:07:16.641284] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T17:07:16.742821] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-16T17:07:16.920317] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:07:17.542810] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-16T17:07:18.275773] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:07:18.342773] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-16T17:07:18.854700] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T17:07:18.858841] [INFO ] [REMOTE ] AGRO: Full fetch complete (48987 records). [2025-10-16T17:07:18.858968] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-16T17:07:19.151768] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-16T17:07:19.245849] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-16T17:07:19.245934] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-16T17:07:19.246458] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-16T17:07:19.246498] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-16T17:07:19.247526] [DEBUG] [LOCAL ] AGRO: Trimmed 48987 records to 33278 (keeping 200 days of data) [2025-10-16T17:07:19.430714] [DEBUG] [LOCAL ] AGRO: Primary data saved (33278 records). [2025-10-16T17:07:19.430839] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-16T17:07:19.430918] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGRO took 27.3s. Estimated remaining: 4h 44m 21s. Rate: 8.1 symbols/min [2025-10-16T17:07:19.608450] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:19.615614] [DEBUG] [LOCAL ] AHT: Loaded 6362 existing records from primary storage. [2025-10-16T17:07:19.615807] [INFO ] [MAIN ] AHT: Loaded 6362 existing records. [2025-10-16T17:07:19.799967] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:19.800269] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-16T17:07:19.800432] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-16T17:07:19.816175] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-16T17:07:19.817134] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:07:19.816590] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-16T17:07:19.948003] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-16T17:07:20.194229] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:20.721181] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:07:20.742764] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-16T17:07:21.524803] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:07:21.542780] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-16T17:07:21.752391] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:07:22.342812] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-16T17:07:22.952588] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:07:23.142868] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-16T17:07:23.956210] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-16T17:07:23.963313] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:07:24.574147] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:07:24.578418] [INFO ] [REMOTE ] AGX: Full fetch complete (48960 records). [2025-10-16T17:07:24.578573] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-16T17:07:24.743806] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-16T17:07:24.976683] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-16T17:07:24.976872] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-16T17:07:24.977401] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-16T17:07:24.977444] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-16T17:07:24.978468] [DEBUG] [LOCAL ] AGX: Trimmed 48960 records to 33089 (keeping 200 days of data) [2025-10-16T17:07:25.180746] [DEBUG] [LOCAL ] AGX: Primary data saved (33089 records). [2025-10-16T17:07:25.180873] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-16T17:07:25.180949] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AGX took 30.8s. Estimated remaining: 4h 43m 10s. Rate: 8.2 symbols/min [2025-10-16T17:07:25.346269] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:25.397758] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-16T17:07:25.398136] [INFO ] [MAIN ] AI: Loaded 53765 existing records. [2025-10-16T17:07:25.569292] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-16T17:07:25.591073] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:25.592203] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-16T17:07:25.592409] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-16T17:07:25.599929] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-16T17:07:25.609984] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-16T17:07:25.657718] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:07:25.693186] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:07:25.978003] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:26.342846] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-16T17:07:27.142786] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-16T17:07:27.541732] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-16T17:07:27.595082] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:07:27.600294] [INFO ] [REMOTE ] AHH: Full fetch complete (59698 records). [2025-10-16T17:07:27.600391] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-16T17:07:27.731860] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T17:07:27.953823] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-16T17:07:28.007074] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-16T17:07:28.007149] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-16T17:07:28.007768] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-16T17:07:28.007831] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-16T17:07:28.009112] [DEBUG] [LOCAL ] AHH: Trimmed 59698 records to 40838 (keeping 200 days of data) [2025-10-16T17:07:28.240415] [DEBUG] [LOCAL ] AHH: Primary data saved (40838 records). [2025-10-16T17:07:28.240540] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-16T17:07:28.241172] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHH took 31.3s. Estimated remaining: 4h 40m 20s. Rate: 8.2 symbols/min [2025-10-16T17:07:28.410216] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:28.460379] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-16T17:07:28.460699] [INFO ] [MAIN ] AIG: Loaded 53470 existing records. [2025-10-16T17:07:28.636437] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:28.636705] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-16T17:07:28.636761] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-16T17:07:28.637110] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-16T17:07:28.637158] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-16T17:07:28.747980] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-16T17:07:28.791397] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T17:07:29.001570] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:29.542831] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-16T17:07:30.147735] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T17:07:30.342895] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-16T17:07:30.472443] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T17:07:31.142809] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-16T17:07:31.956187] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-16T17:07:31.960518] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T17:07:32.320130] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:07:32.525917] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:07:32.742832] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-16T17:07:33.542821] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-16T17:07:34.167532] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T17:07:34.347905] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-16T17:07:34.364799] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:07:35.142895] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-16T17:07:35.942795] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-16T17:07:35.981417] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:07:36.743195] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:07:36.743013] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-16T17:07:37.486986] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T17:07:37.542786] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-16T17:07:38.342804] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-16T17:07:38.472967] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:07:39.142819] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-16T17:07:39.610949] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T17:07:39.942822] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-16T17:07:40.041516] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:07:40.443306] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:07:40.705008] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:07:40.742814] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-16T17:07:41.454032] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:07:41.542854] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-16T17:07:42.342840] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-16T17:07:43.103395] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:07:43.142886] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-16T17:07:43.942853] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-16T17:07:44.663631] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T17:07:44.748027] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-16T17:07:44.753100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-16T17:07:44.907582] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:07:45.542808] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-16T17:07:46.070296] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:07:46.076552] [INFO ] [REMOTE ] AHR: Full fetch complete (70848 records). [2025-10-16T17:07:46.076745] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-16T17:07:46.350271] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-16T17:07:46.387029] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:07:46.421942] [INFO ] [REMOTE ] AHT: Full fetch complete (9173 records). [2025-10-16T17:07:46.431973] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-16T17:07:46.580922] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-16T17:07:46.581252] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-16T17:07:46.581989] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-16T17:07:46.587403] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-16T17:07:46.706638] [DEBUG] [LOCAL ] AHR: Trimmed 70848 records to 49438 (keeping 200 days of data) [2025-10-16T17:07:46.941183] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-16T17:07:46.941740] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-16T17:07:46.942288] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-16T17:07:46.942608] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-16T17:07:46.947271] [DEBUG] [LOCAL ] AHT: Trimmed 9173 records to 6425 (keeping 200 days of data) [2025-10-16T17:07:46.986196] [DEBUG] [LOCAL ] AHT: Primary data saved (6425 records). [2025-10-16T17:07:46.987761] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-16T17:07:46.988084] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHT took 27.6s. Estimated remaining: 4h 47m 19s. Rate: 8.0 symbols/min [2025-10-16T17:07:47.155412] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-16T17:07:47.233106] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:47.270486] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-16T17:07:47.270826] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-16T17:07:47.271722] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-16T17:07:47.273640] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-16T17:07:47.276565] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-16T17:07:47.278484] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-16T17:07:47.719065] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:47.751346] [DEBUG] [LOCAL ] AHR: Primary data saved (49438 records). [2025-10-16T17:07:47.751485] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-16T17:07:47.752292] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHR took 47.5s. Estimated remaining: 4h 43m 6s. Rate: 8.1 symbols/min [2025-10-16T17:07:47.917836] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:47.941345] [DEBUG] [LOCAL ] AIN: Loaded 24434 existing records from primary storage. [2025-10-16T17:07:47.941594] [INFO ] [MAIN ] AIN: Loaded 24434 existing records. [2025-10-16T17:07:47.972296] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-16T17:07:48.117934] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:48.118187] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-16T17:07:48.118237] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-16T17:07:48.118416] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-16T17:07:48.118455] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-16T17:07:48.277399] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:07:48.296872] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-16T17:07:48.297067] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:07:48.312380] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-16T17:07:48.332345] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:07:48.356162] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-16T17:07:48.364927] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-16T17:07:48.381817] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-16T17:07:48.402883] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-16T17:07:48.408604] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AII took 1.4s. Estimated remaining: 4h 38m 57s. Rate: 8.3 symbols/min [2025-10-16T17:07:48.486986] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:48.653986] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:07:48.684544] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-16T17:07:48.706144] [DEBUG] [LOCAL ] AIO: Loaded 13371 existing records from primary storage. [2025-10-16T17:07:48.706364] [INFO ] [MAIN ] AIO: Loaded 13371 existing records. [2025-10-16T17:07:48.747922] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-16T17:07:48.915220] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:07:48.917445] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T17:07:48.928232] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-16T17:07:48.928556] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-16T17:07:48.929534] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-16T17:07:48.929603] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-16T17:07:49.315346] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:07:49.542857] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-16T17:07:50.342838] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-16T17:07:50.534534] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:07:50.667087] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T17:07:51.142948] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-16T17:07:51.328453] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:07:51.942817] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-16T17:07:52.102763] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T17:07:52.742865] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-16T17:07:52.927855] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:07:53.542842] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-16T17:07:54.342855] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-16T17:07:55.053331] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T17:07:55.096244] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-16T17:07:55.142782] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-16T17:07:55.298502] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:07:55.942826] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-16T17:07:56.742911] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-16T17:07:56.833682] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:07:57.396181] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-16T17:07:57.542818] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-16T17:07:58.220406] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:07:58.342809] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-16T17:07:59.142878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-16T17:07:59.942813] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-16T17:08:00.064380] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:08:00.123179] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T17:08:00.165083] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:08:00.742855] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-16T17:08:00.862753] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:08:01.542820] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-16T17:08:02.342845] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-16T17:08:03.043994] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:08:03.142799] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-16T17:08:03.444335] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-16T17:08:03.481778] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:08:03.942867] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-16T17:08:04.497454] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:08:04.742787] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-16T17:08:05.542787] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-16T17:08:05.575166] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:08:05.582142] [INFO ] [REMOTE ] AIG: Full fetch complete (77563 records). [2025-10-16T17:08:05.582283] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-16T17:08:05.986518] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-16T17:08:05.986689] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-16T17:08:05.987519] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-16T17:08:05.987585] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-16T17:08:05.989128] [DEBUG] [LOCAL ] AIG: Trimmed 77563 records to 53860 (keeping 200 days of data) [2025-10-16T17:08:06.345180] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-16T17:08:06.345758] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:08:06.362081] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-16T17:08:06.387491] [DEBUG] [LOCAL ] AIG: Primary data saved (53860 records). [2025-10-16T17:08:06.387631] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-16T17:08:06.388191] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AIG took 38.1s. Estimated remaining: 4h 45m 10s. Rate: 8.1 symbols/min [2025-10-16T17:08:06.558111] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:06.585633] [DEBUG] [LOCAL ] AIR: Loaded 28874 existing records from primary storage. [2025-10-16T17:08:06.585935] [INFO ] [MAIN ] AIR: Loaded 28874 existing records. [2025-10-16T17:08:06.764390] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:06.764692] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-16T17:08:06.764750] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-16T17:08:06.765065] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-16T17:08:06.765145] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-16T17:08:07.143686] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:07.143882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-16T17:08:07.861884] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:08:07.942782] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-16T17:08:08.657524] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T17:08:08.742829] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-16T17:08:09.403311] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T17:08:09.542786] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-16T17:08:09.705093] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-16T17:08:09.712165] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-16T17:08:09.712287] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-16T17:08:10.105184] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-16T17:08:10.105265] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-16T17:08:10.106018] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-16T17:08:10.106080] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-16T17:08:10.107473] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54155 (keeping 200 days of data) [2025-10-16T17:08:10.343325] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-16T17:08:10.429171] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T17:08:10.450804] [DEBUG] [LOCAL ] AI: Primary data saved (54155 records). [2025-10-16T17:08:10.450919] [INFO ] [MAIN ] AI: Full history saved. [2025-10-16T17:08:10.451540] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AI took 45.3s. Estimated remaining: 4h 43m 5s. Rate: 8.1 symbols/min [2025-10-16T17:08:10.618184] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:10.645894] [DEBUG] [LOCAL ] AIT: Loaded 26971 existing records from primary storage. [2025-10-16T17:08:10.646161] [INFO ] [MAIN ] AIT: Loaded 26971 existing records. [2025-10-16T17:08:10.824947] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:10.825159] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-16T17:08:10.825216] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-16T17:08:10.825455] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-16T17:08:10.825511] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-16T17:08:11.147906] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-16T17:08:11.192256] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:11.527245] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:08:11.942823] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-16T17:08:11.972599] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:08:12.742823] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-16T17:08:13.054990] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:08:13.542857] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-16T17:08:13.590587] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:08:14.300377] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T17:08:14.342815] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-16T17:08:15.142733] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-16T17:08:15.236820] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T17:08:15.243310] [INFO ] [REMOTE ] AIO: Full fetch complete (20149 records). [2025-10-16T17:08:15.244398] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-16T17:08:15.608844] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-16T17:08:15.608982] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-16T17:08:15.609319] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-16T17:08:15.609362] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-16T17:08:15.610105] [DEBUG] [LOCAL ] AIO: Trimmed 20149 records to 13450 (keeping 200 days of data) [2025-10-16T17:08:15.690964] [DEBUG] [LOCAL ] AIO: Primary data saved (13450 records). [2025-10-16T17:08:15.691108] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-16T17:08:15.691212] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIO took 27.2s. Estimated remaining: 4h 41m 44s. Rate: 8.2 symbols/min [2025-10-16T17:08:15.865518] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:15.902996] [DEBUG] [LOCAL ] AIV: Loaded 41436 existing records from primary storage. [2025-10-16T17:08:15.903265] [INFO ] [MAIN ] AIV: Loaded 41436 existing records. [2025-10-16T17:08:15.947917] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-16T17:08:16.103231] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:16.103594] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-16T17:08:16.103709] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-16T17:08:16.104310] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-16T17:08:16.104384] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-16T17:08:16.297109] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:08:16.484252] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:16.742803] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-16T17:08:17.092089] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:08:17.542782] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-16T17:08:17.838131] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T17:08:18.342852] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-16T17:08:19.051970] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:08:19.142817] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-16T17:08:19.460299] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:08:19.942873] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-16T17:08:20.347158] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:08:20.742849] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-16T17:08:21.480121] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T17:08:21.542809] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-16T17:08:21.939455] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T17:08:22.342881] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-16T17:08:22.554357] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:08:23.142868] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-16T17:08:23.565254] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T17:08:23.942840] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-16T17:08:24.591507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:08:24.742882] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-16T17:08:25.308929] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:08:25.542790] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-16T17:08:26.014681] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:08:26.342834] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-16T17:08:26.607073] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T17:08:27.134891] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T17:08:27.142762] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-16T17:08:27.942893] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-16T17:08:28.169842] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:08:28.742903] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-16T17:08:29.220585] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T17:08:29.224880] [INFO ] [REMOTE ] AIN: Full fetch complete (33645 records). [2025-10-16T17:08:29.225044] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-16T17:08:29.547938] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-16T17:08:29.701469] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-16T17:08:29.701568] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-16T17:08:29.702111] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-16T17:08:29.702177] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-16T17:08:29.703236] [DEBUG] [LOCAL ] AIN: Trimmed 33645 records to 24655 (keeping 200 days of data) [2025-10-16T17:08:29.870495] [DEBUG] [LOCAL ] AIN: Primary data saved (24655 records). [2025-10-16T17:08:29.870672] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-16T17:08:29.870778] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIN took 42.1s. Estimated remaining: 4h 45m 28s. Rate: 8.1 symbols/min [2025-10-16T17:08:30.084705] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:30.118099] [DEBUG] [LOCAL ] AIZ: Loaded 29532 existing records from primary storage. [2025-10-16T17:08:30.118388] [INFO ] [MAIN ] AIZ: Loaded 29532 existing records. [2025-10-16T17:08:30.341425] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:30.341698] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-16T17:08:30.341831] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-16T17:08:30.342097] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-16T17:08:30.342249] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-16T17:08:30.347871] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-16T17:08:30.497508] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:08:30.805195] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:30.823743] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T17:08:31.142866] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-16T17:08:31.942839] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-16T17:08:32.003298] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:08:32.637363] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:08:32.742797] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-16T17:08:33.250118] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T17:08:33.542864] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-16T17:08:33.726412] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:08:34.342781] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-16T17:08:34.803341] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T17:08:35.142826] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-16T17:08:35.666362] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:08:35.671311] [INFO ] [REMOTE ] AIR: Full fetch complete (40269 records). [2025-10-16T17:08:35.671398] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-16T17:08:35.951902] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-16T17:08:36.044712] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-16T17:08:36.044907] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-16T17:08:36.045492] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-16T17:08:36.045568] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-16T17:08:36.046776] [DEBUG] [LOCAL ] AIR: Trimmed 40269 records to 29128 (keeping 200 days of data) [2025-10-16T17:08:36.162043] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T17:08:36.240847] [DEBUG] [LOCAL ] AIR: Primary data saved (29128 records). [2025-10-16T17:08:36.240948] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-16T17:08:36.241022] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 29.9s. Estimated remaining: 4h 44m 45s. Rate: 8.1 symbols/min [2025-10-16T17:08:36.405767] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:36.411811] [DEBUG] [LOCAL ] AIZN: Loaded 3961 existing records from primary storage. [2025-10-16T17:08:36.411965] [INFO ] [MAIN ] AIZN: Loaded 3961 existing records. [2025-10-16T17:08:36.589569] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:36.589784] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-16T17:08:36.589832] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-16T17:08:36.589959] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-16T17:08:36.589997] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-16T17:08:36.742792] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-16T17:08:36.942062] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:37.331171] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:08:37.542844] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-16T17:08:37.868091] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:08:38.342818] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-16T17:08:38.641943] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:08:39.142823] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-16T17:08:39.497970] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:08:39.785141] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T17:08:39.942802] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-16T17:08:40.486300] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:08:40.742819] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-16T17:08:41.542822] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-16T17:08:41.985167] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:08:42.342852] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-16T17:08:42.490522] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:08:43.142886] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-16T17:08:43.488792] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T17:08:43.942834] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-16T17:08:44.742821] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-16T17:08:44.795918] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:08:45.322599] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:08:45.542858] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-16T17:08:45.941877] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:08:45.945633] [INFO ] [REMOTE ] AIT: Full fetch complete (39238 records). [2025-10-16T17:08:45.945824] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-16T17:08:46.342952] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-16T17:08:46.343418] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-16T17:08:46.344415] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-16T17:08:46.344956] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-16T17:08:46.345020] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-16T17:08:46.346160] [DEBUG] [LOCAL ] AIT: Trimmed 39238 records to 27175 (keeping 200 days of data) [2025-10-16T17:08:46.533237] [DEBUG] [LOCAL ] AIT: Primary data saved (27175 records). [2025-10-16T17:08:46.533441] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-16T17:08:46.533566] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 36.1s. Estimated remaining: 4h 46m 12s. Rate: 8.0 symbols/min [2025-10-16T17:08:46.743309] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:46.768624] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:08:46.772352] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:08:46.825240] [DEBUG] [LOCAL ] AJG: Loaded 46536 existing records from primary storage. [2025-10-16T17:08:46.825610] [INFO ] [MAIN ] AJG: Loaded 46536 existing records. [2025-10-16T17:08:46.997424] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:08:46.997690] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-16T17:08:46.997748] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-16T17:08:46.998092] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-16T17:08:46.998146] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-16T17:08:47.145628] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-16T17:08:47.347833] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:47.942815] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-16T17:08:48.513106] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:08:48.753692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-16T17:08:48.759093] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T17:08:49.542827] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-16T17:08:50.342864] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-16T17:08:50.588471] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:08:50.637243] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:08:51.007135] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:08:51.142878] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-16T17:08:51.728071] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T17:08:51.942854] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-16T17:08:52.742876] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-16T17:08:53.542800] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-16T17:08:53.698870] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T17:08:53.704948] [INFO ] [REMOTE ] AIV: Full fetch complete (60346 records). [2025-10-16T17:08:53.705058] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-16T17:08:53.980006] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:08:54.124530] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-16T17:08:54.124620] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-16T17:08:54.125362] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-16T17:08:54.125445] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-16T17:08:54.126929] [DEBUG] [LOCAL ] AIV: Trimmed 60346 records to 41824 (keeping 200 days of data) [2025-10-16T17:08:54.246104] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:08:54.353576] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-16T17:08:54.396712] [DEBUG] [LOCAL ] AIV: Primary data saved (41824 records). [2025-10-16T17:08:54.396809] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-16T17:08:54.396886] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIV took 38.7s. Estimated remaining: 4h 46m 17s. Rate: 8.0 symbols/min [2025-10-16T17:08:54.565255] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:08:54.565442] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-16T17:08:54.565481] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-16T17:08:54.565590] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-16T17:08:54.565663] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-16T17:08:54.565742] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-16T17:08:54.565806] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-16T17:08:54.921485] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:08:55.142836] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-16T17:08:55.673957] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:08:55.941900] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:08:55.950537] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-16T17:08:56.500982] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:08:56.742845] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-16T17:08:57.542819] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-16T17:08:58.026238] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:08:58.226057] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:08:58.342837] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-16T17:08:59.142858] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-16T17:08:59.592260] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:08:59.951904] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-16T17:08:59.970697] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:09:00.742806] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-16T17:09:01.237872] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T17:09:01.326298] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:09:01.542789] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-16T17:09:02.342880] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-16T17:09:03.142862] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-16T17:09:03.536088] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T17:09:03.575071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T17:09:03.700358] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T17:09:03.942817] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-16T17:09:04.637540] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:09:04.638738] [INFO ] [REMOTE ] AIZN: Full fetch complete (5885 records). [2025-10-16T17:09:04.638809] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-16T17:09:04.748173] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-16T17:09:05.001302] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-16T17:09:05.001384] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-16T17:09:05.001546] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-16T17:09:05.001589] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-16T17:09:05.001985] [DEBUG] [LOCAL ] AIZN: Trimmed 5885 records to 3972 (keeping 200 days of data) [2025-10-16T17:09:05.026410] [DEBUG] [LOCAL ] AIZN: Primary data saved (3972 records). [2025-10-16T17:09:05.026528] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-16T17:09:05.026608] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZN took 28.8s. Estimated remaining: 4h 47m 50s. Rate: 8.0 symbols/min [2025-10-16T17:09:05.205259] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:05.248168] [DEBUG] [LOCAL ] AKR: Loaded 46096 existing records from primary storage. [2025-10-16T17:09:05.248505] [INFO ] [MAIN ] AKR: Loaded 46096 existing records. [2025-10-16T17:09:05.430771] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:05.430964] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-16T17:09:05.431019] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-16T17:09:05.431447] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-16T17:09:05.431502] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-16T17:09:05.547983] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-16T17:09:05.790522] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:05.813980] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:09:06.342873] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-16T17:09:07.142888] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-16T17:09:07.208936] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T17:09:07.650203] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:09:07.756583] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:09:07.942816] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-16T17:09:08.742815] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-16T17:09:09.254889] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:09:09.542795] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-16T17:09:10.119848] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:09:10.119369] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T17:09:10.125015] [INFO ] [REMOTE ] AIZ: Full fetch complete (42823 records). [2025-10-16T17:09:10.125119] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-16T17:09:10.347877] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-16T17:09:10.532726] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-16T17:09:10.532807] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-16T17:09:10.533273] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-16T17:09:10.533311] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-16T17:09:10.534207] [DEBUG] [LOCAL ] AIZ: Trimmed 42823 records to 29712 (keeping 200 days of data) [2025-10-16T17:09:10.713562] [DEBUG] [LOCAL ] AIZ: Primary data saved (29712 records). [2025-10-16T17:09:10.713718] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-16T17:09:10.713805] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZ took 40.8s. Estimated remaining: 4h 46m 45s. Rate: 8.0 symbols/min [2025-10-16T17:09:10.882819] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:10.922604] [DEBUG] [LOCAL ] AL: Loaded 44699 existing records from primary storage. [2025-10-16T17:09:10.922918] [INFO ] [MAIN ] AL: Loaded 44699 existing records. [2025-10-16T17:09:11.124526] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:11.128324] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-16T17:09:11.128434] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-16T17:09:11.129293] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:09:11.129355] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-16T17:09:11.129554] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-16T17:09:11.144268] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-16T17:09:11.532971] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:11.670600] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:09:11.942805] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-16T17:09:12.742835] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-16T17:09:13.344368] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T17:09:13.542858] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-16T17:09:14.342796] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-16T17:09:14.433605] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:09:14.612063] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T17:09:15.142860] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-16T17:09:15.514868] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T17:09:15.517967] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:09:15.942876] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-16T17:09:16.742821] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-16T17:09:17.092533] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T17:09:17.509819] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:09:17.542787] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-16T17:09:18.342822] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-16T17:09:18.911295] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T17:09:19.140162] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:09:19.141203] [INFO ] [REMOTE ] AKA: Full fetch complete (2615 records). [2025-10-16T17:09:19.141273] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-16T17:09:19.152466] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-16T17:09:19.323773] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T17:09:19.323995] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:09:19.324068] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:09:19.324138] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-16T17:09:19.324204] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-16T17:09:19.324240] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-16T17:09:19.324277] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-16T17:09:19.324331] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 24.9s. Estimated remaining: 4h 47m 12s. Rate: 8.0 symbols/min [2025-10-16T17:09:19.494423] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:19.542720] [DEBUG] [LOCAL ] ALB: Loaded 53343 existing records from primary storage. [2025-10-16T17:09:19.543052] [INFO ] [MAIN ] ALB: Loaded 53343 existing records. [2025-10-16T17:09:19.719304] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:19.719538] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-16T17:09:19.719584] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-16T17:09:19.719967] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-16T17:09:19.720034] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-16T17:09:19.955046] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-16T17:09:20.081968] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:20.742849] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-16T17:09:20.926716] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T17:09:20.932502] [INFO ] [REMOTE ] AJG: Full fetch complete (69062 records). [2025-10-16T17:09:20.932612] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-16T17:09:21.335749] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-16T17:09:21.335892] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-16T17:09:21.337105] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-16T17:09:21.337176] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-16T17:09:21.338663] [DEBUG] [LOCAL ] AJG: Trimmed 69062 records to 46920 (keeping 200 days of data) [2025-10-16T17:09:21.471760] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:09:21.563925] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-16T17:09:21.677405] [DEBUG] [LOCAL ] AJG: Primary data saved (46920 records). [2025-10-16T17:09:21.677536] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-16T17:09:21.677612] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 35.1s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-10-16T17:09:21.845448] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:21.895050] [DEBUG] [LOCAL ] ALC: Loaded 51181 existing records from primary storage. [2025-10-16T17:09:21.895353] [INFO ] [MAIN ] ALC: Loaded 51181 existing records. [2025-10-16T17:09:22.080543] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:22.080854] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-16T17:09:22.080942] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-16T17:09:22.088881] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-16T17:09:22.102059] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-16T17:09:22.147237] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:09:22.351732] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-16T17:09:22.467473] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:22.815113] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:09:23.142859] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-16T17:09:23.942820] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-16T17:09:24.748672] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-16T17:09:24.753382] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:09:24.873031] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-16T17:09:25.465048] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:09:25.542835] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-16T17:09:26.347897] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-16T17:09:26.361450] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:09:27.082252] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:09:27.142768] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-16T17:09:27.942819] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-16T17:09:28.271741] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T17:09:28.389051] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:09:28.742817] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-16T17:09:29.553092] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-16T17:09:29.558121] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:09:30.342783] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-16T17:09:30.607117] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T17:09:30.700245] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:09:31.142817] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-16T17:09:31.843164] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:09:31.942874] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-16T17:09:32.709960] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:09:32.742768] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-16T17:09:33.352355] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:09:33.542784] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-16T17:09:34.342806] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-16T17:09:34.552123] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:09:35.109955] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:09:35.142840] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-16T17:09:35.942822] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-16T17:09:35.992008] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:09:36.742822] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-16T17:09:36.832032] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:09:37.246682] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T17:09:37.542810] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-16T17:09:38.342794] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-16T17:09:38.621905] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T17:09:38.693946] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:09:39.142852] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-16T17:09:39.942865] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-16T17:09:40.210794] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T17:09:40.443335] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:09:40.742815] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-16T17:09:41.542787] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-16T17:09:41.690501] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:09:42.342796] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-16T17:09:42.397091] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:09:42.403183] [INFO ] [REMOTE ] AL: Full fetch complete (63480 records). [2025-10-16T17:09:42.403301] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-16T17:09:42.787195] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-16T17:09:42.787299] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-16T17:09:42.788010] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-16T17:09:42.788075] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-16T17:09:42.789372] [DEBUG] [LOCAL ] AL: Trimmed 63480 records to 45074 (keeping 200 days of data) [2025-10-16T17:09:43.066068] [DEBUG] [LOCAL ] AL: Primary data saved (45074 records). [2025-10-16T17:09:43.066219] [INFO ] [MAIN ] AL: Full history saved. [2025-10-16T17:09:43.066351] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AL took 32.4s. Estimated remaining: 4h 51m 21s. Rate: 7.9 symbols/min [2025-10-16T17:09:43.148128] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-16T17:09:43.277165] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:09:43.310383] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T17:09:43.360099] [DEBUG] [LOCAL ] ALE: Loaded 31952 existing records from primary storage. [2025-10-16T17:09:43.360472] [INFO ] [MAIN ] ALE: Loaded 31952 existing records. [2025-10-16T17:09:43.623512] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:09:43.623814] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-16T17:09:43.623880] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-16T17:09:43.624226] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-16T17:09:43.624288] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-16T17:09:43.950418] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-16T17:09:44.158099] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:09:44.724731] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T17:09:44.742773] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-16T17:09:44.887722] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:09:45.224254] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:09:45.542894] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-16T17:09:46.342923] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-16T17:09:46.905059] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-16T17:09:47.142814] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-16T17:09:47.214047] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:09:47.760392] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:09:47.942805] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-16T17:09:48.742771] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-16T17:09:49.135089] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:09:49.485560] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-16T17:09:49.542810] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-16T17:09:50.042053] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:09:50.048194] [INFO ] [REMOTE ] AKR: Full fetch complete (65467 records). [2025-10-16T17:09:50.048305] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-16T17:09:50.347925] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-16T17:09:50.434118] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-16T17:09:50.434192] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-16T17:09:50.434864] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-16T17:09:50.434962] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-16T17:09:50.436225] [DEBUG] [LOCAL ] AKR: Trimmed 65467 records to 46457 (keeping 200 days of data) [2025-10-16T17:09:50.718726] [DEBUG] [LOCAL ] AKR: Primary data saved (46457 records). [2025-10-16T17:09:50.718865] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-16T17:09:50.719290] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AKR took 45.7s. Estimated remaining: 4h 51m 14s. Rate: 7.9 symbols/min [2025-10-16T17:09:51.142844] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-16T17:09:51.795191] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:09:51.870911] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-16T17:09:51.877725] [INFO ] [REMOTE ] ALB: Full fetch complete (77067 records). [2025-10-16T17:09:51.877838] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-16T17:09:51.947974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-16T17:09:52.297552] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-16T17:09:52.297670] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-16T17:09:52.298458] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-16T17:09:52.298520] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-16T17:09:52.299902] [DEBUG] [LOCAL ] ALB: Trimmed 77067 records to 53733 (keeping 200 days of data) [2025-10-16T17:09:52.620416] [DEBUG] [LOCAL ] ALB: Primary data saved (53733 records). [2025-10-16T17:09:52.620560] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-16T17:09:52.620688] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALB took 33.3s. Estimated remaining: 4h 48m 18s. Rate: 7.9 symbols/min [2025-10-16T17:09:52.923833] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T17:09:52.934400] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-16T17:09:53.082103] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:09:53.542906] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-16T17:09:54.563574] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:09:54.575027] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-16T17:09:54.590897] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:09:55.142890] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-16T17:09:56.335107] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:09:56.347564] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-16T17:09:56.429597] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:09:56.742860] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-16T17:09:57.959379] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T17:09:57.968227] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-16T17:09:58.073209] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:09:58.342871] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-16T17:09:58.972625] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:09:59.142873] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-16T17:09:59.748768] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T17:09:59.755760] [INFO ] [REMOTE ] ALC: Full fetch complete (73621 records). [2025-10-16T17:09:59.755912] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-16T17:10:00.145575] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-16T17:10:00.145766] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-16T17:10:00.146497] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-16T17:10:00.146540] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-16T17:10:00.147869] [DEBUG] [LOCAL ] ALC: Trimmed 73621 records to 51569 (keeping 200 days of data) [2025-10-16T17:10:00.442606] [DEBUG] [LOCAL ] ALC: Primary data saved (51569 records). [2025-10-16T17:10:00.442758] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-16T17:10:00.442855] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALC took 38.8s. Estimated remaining: 4h 48m 18s. Rate: 7.9 symbols/min [2025-10-16T17:10:00.626763] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:10:00.634518] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-16T17:10:02.072372] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T17:10:02.080180] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-16T17:10:03.590236] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:10:03.598152] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-16T17:10:05.092906] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:10:05.098042] [INFO ] [REMOTE ] ALE: Full fetch complete (43919 records). [2025-10-16T17:10:05.098126] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-16T17:10:05.466593] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-16T17:10:05.466691] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-16T17:10:05.467182] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-16T17:10:05.467223] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-16T17:10:05.468076] [DEBUG] [LOCAL ] ALE: Trimmed 43919 records to 32255 (keeping 200 days of data) [2025-10-16T17:10:05.654340] [DEBUG] [LOCAL ] ALE: Primary data saved (32255 records). [2025-10-16T17:10:05.654465] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-16T17:10:05.654544] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 22.6s. Estimated remaining: 4h 47m 4s. Rate: 8.0 symbols/min [2025-10-16T17:10:06.191456] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.315253] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-16T17:10:06.331809] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-16T17:10:06.340155] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.374206] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.374298] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-16T17:10:06.375026] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-16T17:10:06.375889] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:06.376780] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-16T17:10:06.376867] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-16T17:10:06.503931] [DEBUG] [LOCAL ] ALG: Loaded 9756 existing records from primary storage. [2025-10-16T17:10:06.534772] [INFO ] [MAIN ] ALG: Loaded 9756 existing records. [2025-10-16T17:10:06.528865] [DEBUG] [LOCAL ] ALEX: Loaded 31156 existing records from primary storage. [2025-10-16T17:10:06.588378] [INFO ] [MAIN ] ALEX: Loaded 31156 existing records. [2025-10-16T17:10:06.838987] [DEBUG] [LOCAL ] ALIT: Loaded 52788 existing records from primary storage. [2025-10-16T17:10:06.909997] [INFO ] [MAIN ] ALIT: Loaded 52788 existing records. [2025-10-16T17:10:07.164968] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.205066] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.261682] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-16T17:10:07.335917] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.385000] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.395451] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:07.400580] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-16T17:10:07.400377] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-16T17:10:07.400789] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-16T17:10:07.400723] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-16T17:10:07.421820] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-16T17:10:07.422046] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-16T17:10:07.422180] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-16T17:10:07.421748] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:07.467439] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-16T17:10:07.481944] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-16T17:10:07.494054] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-16T17:10:07.978474] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:10:08.084219] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-16T17:10:08.177794] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:10:08.214893] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-16T17:10:08.265735] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:10:08.359508] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-16T17:10:08.396042] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-16T17:10:08.553738] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.432947] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-16T17:10:08.569945] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-16T17:10:08.575476] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-16T17:10:08.575223] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.588007] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALH took 2.9s. Estimated remaining: 4h 44m 47s. Rate: 8.0 symbols/min [2025-10-16T17:10:08.598859] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-16T17:10:08.687069] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:08.723422] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-16T17:10:08.862809] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:08.913145] [DEBUG] [LOCAL ] ALK: Loaded 53081 existing records from primary storage. [2025-10-16T17:10:08.913555] [INFO ] [MAIN ] ALK: Loaded 53081 existing records. [2025-10-16T17:10:09.122364] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:09.122597] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-16T17:10:09.122689] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-16T17:10:09.123291] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-16T17:10:09.123347] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-16T17:10:09.483188] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:09.483506] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-16T17:10:09.692141] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:10:09.695023] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-16T17:10:10.296971] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:10:10.307576] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-16T17:10:10.515897] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:10:10.520184] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-16T17:10:10.675911] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T17:10:10.683120] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-16T17:10:11.131015] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T17:10:11.133851] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-16T17:10:11.397310] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T17:10:11.409581] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-16T17:10:11.523289] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T17:10:11.529900] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-16T17:10:11.712298] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:10:11.893459] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T17:10:11.942802] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-16T17:10:12.742797] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-16T17:10:12.792075] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:10:12.831528] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:10:12.937861] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:10:13.542854] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-16T17:10:14.287219] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:10:14.342785] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-16T17:10:15.142774] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-16T17:10:15.230705] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:10:15.942787] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-16T17:10:16.024176] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:10:16.221134] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T17:10:16.742840] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-16T17:10:17.461496] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:10:17.542788] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-16T17:10:18.051354] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:10:18.342816] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-16T17:10:19.013540] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:10:19.142808] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-16T17:10:19.731477] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:10:19.942830] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-16T17:10:20.639830] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:10:20.742801] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-16T17:10:21.542787] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-16T17:10:21.955816] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T17:10:22.342782] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-16T17:10:22.573579] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:10:22.697044] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-16T17:10:23.117316] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T17:10:23.142819] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-16T17:10:23.793206] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:10:23.942806] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-16T17:10:24.510008] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:10:24.742835] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-16T17:10:25.491610] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:10:25.542776] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-16T17:10:26.342813] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-16T17:10:26.794532] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:10:27.142812] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-16T17:10:27.744282] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T17:10:27.942880] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-16T17:10:28.742809] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-16T17:10:28.773905] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:10:28.856674] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:10:29.542827] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-16T17:10:30.343138] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-16T17:10:30.521281] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T17:10:30.969716] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:10:31.142867] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-16T17:10:31.206997] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:10:31.209149] [INFO ] [REMOTE ] ALG: Full fetch complete (15332 records). [2025-10-16T17:10:31.209257] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-16T17:10:31.589163] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-16T17:10:31.589267] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-16T17:10:31.589567] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-16T17:10:31.589628] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-16T17:10:31.590252] [DEBUG] [LOCAL ] ALG: Trimmed 15332 records to 9812 (keeping 200 days of data) [2025-10-16T17:10:31.652156] [DEBUG] [LOCAL ] ALG: Primary data saved (9812 records). [2025-10-16T17:10:31.652297] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-16T17:10:31.652375] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALG took 26.0s. Estimated remaining: 4h 51m 54s. Rate: 7.8 symbols/min [2025-10-16T17:10:31.818576] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:31.864727] [DEBUG] [LOCAL ] ALL: Loaded 49786 existing records from primary storage. [2025-10-16T17:10:31.865084] [INFO ] [MAIN ] ALL: Loaded 49786 existing records. [2025-10-16T17:10:31.944850] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-16T17:10:32.051937] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:32.052226] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-16T17:10:32.052289] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-16T17:10:32.052906] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-16T17:10:32.052965] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-16T17:10:32.436065] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:32.437439] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:10:32.742835] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-16T17:10:33.542797] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-16T17:10:34.036577] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T17:10:34.157862] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:10:34.342896] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-16T17:10:34.970456] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:10:35.142865] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-16T17:10:35.684628] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:10:35.689573] [INFO ] [REMOTE ] ALEX: Full fetch complete (44625 records). [2025-10-16T17:10:35.689711] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-16T17:10:35.954806] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-16T17:10:36.151226] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-16T17:10:36.151345] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-16T17:10:36.151946] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-16T17:10:36.152016] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-16T17:10:36.153498] [DEBUG] [LOCAL ] ALEX: Trimmed 44625 records to 31407 (keeping 200 days of data) [2025-10-16T17:10:36.395125] [DEBUG] [LOCAL ] ALEX: Primary data saved (31407 records). [2025-10-16T17:10:36.395290] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-16T17:10:36.395377] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALEX took 30.7s. Estimated remaining: 4h 50m 26s. Rate: 7.9 symbols/min [2025-10-16T17:10:36.665160] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:36.723305] [DEBUG] [LOCAL ] ALLE: Loaded 44203 existing records from primary storage. [2025-10-16T17:10:36.723996] [INFO ] [MAIN ] ALLE: Loaded 44203 existing records. [2025-10-16T17:10:36.749118] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-16T17:10:36.968067] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:36.968398] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-16T17:10:36.968695] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-16T17:10:36.969130] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-16T17:10:36.969189] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-16T17:10:37.317094] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-16T17:10:37.407168] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:37.509260] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:10:37.542781] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-16T17:10:38.229815] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T17:10:38.342812] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-16T17:10:39.021302] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:10:39.142822] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-16T17:10:39.915038] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:10:39.942827] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-16T17:10:40.742870] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-16T17:10:40.779533] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T17:10:41.542824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-16T17:10:41.822234] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:10:41.829588] [INFO ] [REMOTE ] ALIT: Full fetch complete (76612 records). [2025-10-16T17:10:41.829753] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-16T17:10:42.254236] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-16T17:10:42.254345] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-16T17:10:42.255241] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-16T17:10:42.255375] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-16T17:10:42.256937] [DEBUG] [LOCAL ] ALIT: Trimmed 76612 records to 53175 (keeping 200 days of data) [2025-10-16T17:10:42.343011] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-16T17:10:42.372268] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:10:42.627318] [DEBUG] [LOCAL ] ALIT: Primary data saved (53175 records). [2025-10-16T17:10:42.627463] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-16T17:10:42.627546] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 36.9s. Estimated remaining: 4h 49m 41s. Rate: 7.9 symbols/min [2025-10-16T17:10:42.824983] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:42.874817] [DEBUG] [LOCAL ] ALLY: Loaded 53221 existing records from primary storage. [2025-10-16T17:10:42.875117] [INFO ] [MAIN ] ALLY: Loaded 53221 existing records. [2025-10-16T17:10:43.059078] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:43.059381] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-16T17:10:43.059508] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-16T17:10:43.060038] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-16T17:10:43.060134] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-16T17:10:43.150296] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-16T17:10:43.380288] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:10:43.469244] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:43.942887] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-16T17:10:44.120900] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T17:10:44.127848] [INFO ] [REMOTE ] ALK: Full fetch complete (77013 records). [2025-10-16T17:10:44.128006] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-16T17:10:44.522980] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-16T17:10:44.523083] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-16T17:10:44.523865] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-16T17:10:44.523933] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-16T17:10:44.525498] [DEBUG] [LOCAL ] ALK: Trimmed 77013 records to 53470 (keeping 200 days of data) [2025-10-16T17:10:44.742976] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-16T17:10:44.861127] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:10:44.881394] [DEBUG] [LOCAL ] ALK: Primary data saved (53470 records). [2025-10-16T17:10:44.881497] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-16T17:10:44.881567] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALK took 36.3s. Estimated remaining: 4h 47m 9s. Rate: 8.0 symbols/min [2025-10-16T17:10:45.049569] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:10:45.089278] [DEBUG] [LOCAL ] ALSN: Loaded 43474 existing records from primary storage. [2025-10-16T17:10:45.089580] [INFO ] [MAIN ] ALSN: Loaded 43474 existing records. [2025-10-16T17:10:45.262256] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:10:45.262462] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-16T17:10:45.262509] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-16T17:10:45.262846] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-16T17:10:45.262902] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-16T17:10:45.547932] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-16T17:10:45.617980] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:10:45.882725] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:10:46.342807] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-16T17:10:46.395256] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T17:10:47.050120] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:10:47.142795] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-16T17:10:47.901610] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T17:10:47.942783] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-16T17:10:48.742889] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-16T17:10:48.912849] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:10:48.998878] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T17:10:49.542820] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-16T17:10:50.199374] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T17:10:50.342839] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-16T17:10:50.813370] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:10:51.142811] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-16T17:10:51.942905] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-16T17:10:52.109924] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:10:52.742872] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-16T17:10:52.841258] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:10:53.485117] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:10:53.542823] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-16T17:10:54.165603] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:10:54.342831] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-16T17:10:55.142840] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-16T17:10:55.171844] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:10:55.942871] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-16T17:10:56.004498] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:10:56.602418] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:10:56.742825] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-16T17:10:57.232166] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T17:10:57.542818] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-16T17:10:58.193529] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:10:58.342824] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-16T17:10:59.142877] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-16T17:10:59.185968] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:10:59.942805] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-16T17:11:00.145310] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:11:00.749205] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-16T17:11:00.771513] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:11:01.320269] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:11:01.542889] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-16T17:11:02.342788] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-16T17:11:02.431636] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:11:02.851310] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:11:03.142795] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-16T17:11:03.942786] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-16T17:11:04.120604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:11:04.593135] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:11:04.742866] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-16T17:11:05.542830] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-16T17:11:05.663961] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:11:05.672012] [INFO ] [REMOTE ] ALLE: Full fetch complete (64818 records). [2025-10-16T17:11:05.672228] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-16T17:11:06.103276] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-16T17:11:06.103346] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-16T17:11:06.104008] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-16T17:11:06.104085] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-16T17:11:06.105425] [DEBUG] [LOCAL ] ALLE: Trimmed 64818 records to 44517 (keeping 200 days of data) [2025-10-16T17:11:06.343393] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-16T17:11:06.379024] [DEBUG] [LOCAL ] ALLE: Primary data saved (44517 records). [2025-10-16T17:11:06.379136] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-16T17:11:06.379561] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLE took 30.0s. Estimated remaining: 4h 53m 12s. Rate: 7.8 symbols/min [2025-10-16T17:11:06.552528] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:06.582198] [DEBUG] [LOCAL ] ALTG: Loaded 23330 existing records from primary storage. [2025-10-16T17:11:06.582432] [INFO ] [MAIN ] ALTG: Loaded 23330 existing records. [2025-10-16T17:11:06.704555] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T17:11:06.756410] [INFO ] [REMOTE ] ALL: Full fetch complete (72540 records). [2025-10-16T17:11:06.782500] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-16T17:11:06.787739] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:06.787996] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-16T17:11:06.788045] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-16T17:11:06.793687] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-16T17:11:06.845218] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-16T17:11:07.567868] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:07.589395] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-16T17:11:07.590081] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-16T17:11:07.591117] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-16T17:11:07.592052] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-16T17:11:07.592473] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-16T17:11:07.595029] [DEBUG] [LOCAL ] ALL: Trimmed 72540 records to 50161 (keeping 200 days of data) [2025-10-16T17:11:07.738154] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-16T17:11:07.753351] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:11:07.946631] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-16T17:11:07.983513] [DEBUG] [LOCAL ] ALL: Primary data saved (50161 records). [2025-10-16T17:11:07.983624] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-16T17:11:07.983743] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALL took 36.3s. Estimated remaining: 4h 50m 24s. Rate: 7.9 symbols/min [2025-10-16T17:11:08.150185] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:08.160430] [DEBUG] [LOCAL ] ALUR: Loaded 9544 existing records from primary storage. [2025-10-16T17:11:08.160618] [INFO ] [MAIN ] ALUR: Loaded 9544 existing records. [2025-10-16T17:11:08.334015] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:08.334189] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-16T17:11:08.334236] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-16T17:11:08.334453] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-16T17:11:08.334519] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-16T17:11:08.683909] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:08.742769] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-16T17:11:08.790057] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:11:09.543853] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-16T17:11:09.546500] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:11:10.211956] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:11:10.342805] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-16T17:11:10.545123] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:11:11.142831] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-16T17:11:11.585811] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:11:11.942815] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-16T17:11:12.470797] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:11:12.742817] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-16T17:11:12.948280] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:11:13.542800] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-16T17:11:13.855056] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:11:14.342811] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-16T17:11:14.849465] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:11:15.142781] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-16T17:11:15.488747] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:11:15.942819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-16T17:11:16.750167] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-16T17:11:16.757443] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T17:11:17.075146] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:11:17.542852] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-16T17:11:17.554703] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T17:11:18.342817] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-16T17:11:18.517100] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:11:19.142880] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-16T17:11:19.768202] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:11:19.777286] [INFO ] [REMOTE ] ALSN: Full fetch complete (62561 records). [2025-10-16T17:11:19.777466] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-16T17:11:19.951879] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-16T17:11:20.186174] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-16T17:11:20.186266] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-16T17:11:20.186939] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-16T17:11:20.187005] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-16T17:11:20.188336] [DEBUG] [LOCAL ] ALSN: Trimmed 62561 records to 43767 (keeping 200 days of data) [2025-10-16T17:11:20.455063] [DEBUG] [LOCAL ] ALSN: Primary data saved (43767 records). [2025-10-16T17:11:20.455209] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-16T17:11:20.455298] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 35.6s. Estimated remaining: 4h 52m 22s. Rate: 7.8 symbols/min [2025-10-16T17:11:20.628496] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:20.684475] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:11:20.712085] [DEBUG] [LOCAL ] ALV: Loaded 42121 existing records from primary storage. [2025-10-16T17:11:20.712404] [INFO ] [MAIN ] ALV: Loaded 42121 existing records. [2025-10-16T17:11:20.748035] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-16T17:11:20.900740] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:20.901131] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-16T17:11:20.901179] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-16T17:11:20.901632] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-16T17:11:20.901716] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-16T17:11:21.275863] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:21.324540] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:11:21.542859] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-16T17:11:22.216505] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:11:22.302037] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:11:22.342783] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-16T17:11:23.142798] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-16T17:11:23.277794] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:11:23.942855] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-16T17:11:24.303273] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T17:11:24.375195] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T17:11:24.742811] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-16T17:11:25.542808] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-16T17:11:26.342799] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-16T17:11:26.481765] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:11:26.755479] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T17:11:26.792577] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:11:27.142830] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-16T17:11:27.942841] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-16T17:11:28.742940] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-16T17:11:29.043607] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T17:11:29.055330] [INFO ] [REMOTE ] ALLY: Full fetch complete (77204 records). [2025-10-16T17:11:29.055572] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-16T17:11:29.197808] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T17:11:29.544072] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:11:29.544160] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-16T17:11:29.573186] [INFO ] [REMOTE ] ALUR: Full fetch complete (19061 records). [2025-10-16T17:11:29.602609] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-16T17:11:29.716944] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-16T17:11:29.738521] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-16T17:11:29.763336] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-16T17:11:29.763450] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-16T17:11:29.819702] [DEBUG] [LOCAL ] ALLY: Trimmed 77204 records to 53610 (keeping 200 days of data) [2025-10-16T17:11:30.373966] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-16T17:11:30.482370] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-16T17:11:30.482089] [DEBUG] [LOCAL ] ALLY: Primary data saved (53610 records). [2025-10-16T17:11:30.482698] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-16T17:11:30.482592] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-16T17:11:30.483949] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-16T17:11:30.483424] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 47.9s. Estimated remaining: 4h 53m 14s. Rate: 7.8 symbols/min [2025-10-16T17:11:30.505278] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-16T17:11:30.583242] [DEBUG] [LOCAL ] ALUR: Trimmed 19061 records to 9589 (keeping 200 days of data) [2025-10-16T17:11:30.704203] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:30.720293] [DEBUG] [LOCAL ] ALUR: Primary data saved (9589 records). [2025-10-16T17:11:30.720619] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-16T17:11:30.720797] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALUR took 22.7s. Estimated remaining: 4h 49m 57s. Rate: 7.9 symbols/min [2025-10-16T17:11:30.837146] [DEBUG] [LOCAL ] ALX: Loaded 6965 existing records from primary storage. [2025-10-16T17:11:30.841333] [INFO ] [MAIN ] ALX: Loaded 6965 existing records. [2025-10-16T17:11:31.002625] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:31.127897] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:31.128860] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-16T17:11:31.129356] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-16T17:11:31.129639] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-16T17:11:31.129798] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-16T17:11:31.275797] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:11:31.301816] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-16T17:11:31.440953] [DEBUG] [LOCAL ] AM: Loaded 51939 existing records from primary storage. [2025-10-16T17:11:31.451558] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:11:31.463876] [INFO ] [MAIN ] AM: Loaded 51939 existing records. [2025-10-16T17:11:31.837611] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:31.875470] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:31.875733] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-16T17:11:31.875791] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-16T17:11:31.876091] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-16T17:11:31.876131] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-16T17:11:31.947989] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-16T17:11:32.226584] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:32.711294] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:11:32.742765] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-16T17:11:33.152838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:11:33.155888] [INFO ] [REMOTE ] ALTG: Full fetch complete (33304 records). [2025-10-16T17:11:33.155973] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-16T17:11:33.156496] [FATAL] [VALIDATOR ] ALTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:11:33.156594] [FATAL] [MAIN ] ALTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:11:33.156694] [WARN ] [MAIN ] ALTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:11:33.156784] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-16T17:11:33.156865] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-10-16T17:11:33.156901] [INFO ] [LOCAL ] ALTG: Starting deletion of derivative data. [2025-10-16T17:11:33.157054] [DEBUG] [LOCAL ] ALTG: Deleted derivative data file. [2025-10-16T17:11:33.157140] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALTG took 26.8s. Estimated remaining: 4h 47m 40s. Rate: 7.9 symbols/min [2025-10-16T17:11:33.324979] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:11:33.357385] [DEBUG] [LOCAL ] AMBC: Loaded 36270 existing records from primary storage. [2025-10-16T17:11:33.357659] [INFO ] [MAIN ] AMBC: Loaded 36270 existing records. [2025-10-16T17:11:33.534803] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:11:33.535019] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-16T17:11:33.535076] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-16T17:11:33.535335] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-16T17:11:33.535399] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-16T17:11:33.542852] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-16T17:11:33.885374] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:11:34.009259] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:11:34.342856] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-16T17:11:35.098592] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T17:11:35.142855] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-16T17:11:35.438425] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T17:11:35.636852] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T17:11:35.942820] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-16T17:11:36.440814] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T17:11:36.742819] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-16T17:11:37.542856] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-16T17:11:38.092961] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T17:11:38.342821] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-16T17:11:38.960931] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:11:39.087147] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:11:39.142818] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-16T17:11:39.942803] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-16T17:11:40.025543] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:11:40.742825] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-16T17:11:41.447682] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:11:41.542838] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-16T17:11:42.294857] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:11:42.342836] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-16T17:11:43.142796] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-16T17:11:43.236836] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:11:43.511366] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-16T17:11:43.666726] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:11:43.942806] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-16T17:11:44.432994] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-16T17:11:44.742834] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-16T17:11:45.542857] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-16T17:11:46.284404] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:11:46.342827] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-16T17:11:47.062606] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:11:47.142820] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-16T17:11:47.942802] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-16T17:11:48.040491] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:11:48.748661] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-16T17:11:48.753203] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:11:49.183276] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:11:49.542833] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-16T17:11:50.342806] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-16T17:11:50.449334] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:11:50.856342] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T17:11:50.917632] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:11:51.142829] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-16T17:11:51.942830] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-16T17:11:52.742841] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-16T17:11:52.778782] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:11:52.797309] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:11:53.542819] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-16T17:11:53.958217] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T17:11:54.315235] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T17:11:54.342822] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-16T17:11:55.142832] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-16T17:11:55.727493] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:11:55.942810] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-16T17:11:56.755447] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-16T17:11:56.757758] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:11:57.375518] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:11:57.542810] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-16T17:11:58.186937] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:11:58.342812] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-16T17:11:59.087731] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:11:59.147965] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-16T17:11:59.163229] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:11:59.942832] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-16T17:12:00.651365] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:12:00.739525] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T17:12:00.742763] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-16T17:12:01.542892] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-16T17:12:01.877140] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T17:12:01.879007] [INFO ] [REMOTE ] ALX: Full fetch complete (7865 records). [2025-10-16T17:12:01.879075] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-16T17:12:02.282211] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-16T17:12:02.282315] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-16T17:12:02.282545] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-16T17:12:02.282607] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-16T17:12:02.283165] [DEBUG] [LOCAL ] ALX: Trimmed 7865 records to 7061 (keeping 200 days of data) [2025-10-16T17:12:02.325898] [DEBUG] [LOCAL ] ALX: Primary data saved (7061 records). [2025-10-16T17:12:02.326019] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-16T17:12:02.326091] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALX took 31.8s. Estimated remaining: 4h 56m 26s. Rate: 7.7 symbols/min [2025-10-16T17:12:02.347854] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-16T17:12:02.494699] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:02.534333] [DEBUG] [LOCAL ] AMBP: Loaded 44639 existing records from primary storage. [2025-10-16T17:12:02.534610] [INFO ] [MAIN ] AMBP: Loaded 44639 existing records. [2025-10-16T17:12:02.708594] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:02.708829] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-16T17:12:02.708876] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-16T17:12:02.709239] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-16T17:12:02.709307] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-16T17:12:03.070925] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:03.146774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-16T17:12:03.150364] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:12:03.155966] [INFO ] [REMOTE ] ALV: Full fetch complete (62090 records). [2025-10-16T17:12:03.156057] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-16T17:12:03.545606] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-16T17:12:03.545814] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-16T17:12:03.546462] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-16T17:12:03.546540] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-16T17:12:03.567122] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T17:12:03.566342] [DEBUG] [LOCAL ] ALV: Trimmed 62090 records to 42481 (keeping 200 days of data) [2025-10-16T17:12:03.829889] [DEBUG] [LOCAL ] ALV: Primary data saved (42481 records). [2025-10-16T17:12:03.830010] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-16T17:12:03.830085] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALV took 43.4s. Estimated remaining: 4h 53m 44s. Rate: 7.7 symbols/min [2025-10-16T17:12:03.947978] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-16T17:12:03.999802] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:03.999910] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-16T17:12:03.999948] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-16T17:12:04.000052] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-16T17:12:04.000092] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-16T17:12:04.000131] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-16T17:12:04.000163] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-16T17:12:04.348523] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:04.620622] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:12:04.742774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-16T17:12:05.542781] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-16T17:12:05.787755] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T17:12:06.342836] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-16T17:12:06.487039] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:12:06.560208] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:12:07.142868] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-16T17:12:07.942851] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-16T17:12:08.178838] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:12:08.179167] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-16T17:12:08.179252] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:12:08.179301] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-16T17:12:08.179363] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:12:08.179435] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-16T17:12:08.179517] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-16T17:12:08.179572] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-16T17:12:08.179615] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-16T17:12:08.179688] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBQ took 4.3s. Estimated remaining: 4h 52m 14s. Rate: 7.8 symbols/min [2025-10-16T17:12:08.307963] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:12:08.341114] [INFO ] [REMOTE ] AM: Full fetch complete (75735 records). [2025-10-16T17:12:08.388388] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:08.384814] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-16T17:12:08.754887] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-16T17:12:08.831741] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-16T17:12:08.832304] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-16T17:12:08.833566] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-16T17:12:08.834529] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-16T17:12:08.834917] [INFO ] [MAIN ] AMC: Loaded 53762 existing records. [2025-10-16T17:12:08.848407] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-16T17:12:08.929049] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T17:12:08.973151] [DEBUG] [LOCAL ] AM: Trimmed 75735 records to 52320 (keeping 200 days of data) [2025-10-16T17:12:09.121617] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:09.155552] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-16T17:12:09.156850] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-16T17:12:09.159856] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-16T17:12:09.160630] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-16T17:12:09.545160] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-16T17:12:09.747781] [DEBUG] [LOCAL ] AM: Primary data saved (52320 records). [2025-10-16T17:12:09.753827] [INFO ] [MAIN ] AM: Full history saved. [2025-10-16T17:12:09.753974] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 39.0s. Estimated remaining: 4h 49m 40s. Rate: 7.9 symbols/min [2025-10-16T17:12:09.753729] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:09.919364] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:09.969710] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-16T17:12:09.970100] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-16T17:12:10.157085] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:10.157314] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-16T17:12:10.157361] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-16T17:12:10.157748] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-16T17:12:10.157805] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-16T17:12:10.361707] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-16T17:12:10.474376] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:12:10.519329] [INFO ] [REMOTE ] AMBC: Full fetch complete (51830 records). [2025-10-16T17:12:10.562411] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-16T17:12:10.567241] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:10.948559] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-16T17:12:10.948636] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-16T17:12:10.949229] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-16T17:12:10.949290] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-16T17:12:10.950372] [DEBUG] [LOCAL ] AMBC: Trimmed 51830 records to 36530 (keeping 200 days of data) [2025-10-16T17:12:11.149861] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-16T17:12:11.155004] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:12:11.190233] [DEBUG] [LOCAL ] AMBC: Primary data saved (36530 records). [2025-10-16T17:12:11.190697] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-16T17:12:11.191610] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBC took 38.0s. Estimated remaining: 4h 47m 5s. Rate: 7.9 symbols/min [2025-10-16T17:12:11.355771] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:11.405115] [DEBUG] [LOCAL ] AME: Loaded 48691 existing records from primary storage. [2025-10-16T17:12:11.405545] [INFO ] [MAIN ] AME: Loaded 48691 existing records. [2025-10-16T17:12:11.577936] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:11.578138] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-16T17:12:11.578185] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-16T17:12:11.578478] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-16T17:12:11.578533] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-16T17:12:11.919956] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:11.942774] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-16T17:12:12.729026] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:12:12.742771] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-16T17:12:13.078237] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-16T17:12:13.542825] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-16T17:12:13.708806] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:12:14.342810] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-16T17:12:14.380667] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:12:15.054014] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:12:15.142799] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-16T17:12:15.942798] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-16T17:12:16.039078] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:12:16.742791] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-16T17:12:16.884853] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:12:17.423484] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:12:17.542790] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-16T17:12:18.342801] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-16T17:12:18.380842] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T17:12:19.142810] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-16T17:12:19.608215] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T17:12:19.734118] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:12:19.942797] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-16T17:12:20.208440] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T17:12:20.742833] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-16T17:12:21.358939] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:12:21.542789] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-16T17:12:22.307445] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T17:12:22.342787] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-16T17:12:23.142778] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-16T17:12:23.557086] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T17:12:23.942879] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-16T17:12:24.393844] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T17:12:24.701446] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:12:24.742815] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-16T17:12:25.205402] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:12:25.542815] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-16T17:12:26.345516] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-16T17:12:26.350837] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:12:27.018164] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:12:27.142822] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-16T17:12:27.942845] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-16T17:12:28.728621] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T17:12:28.750310] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-16T17:12:28.753639] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:12:28.759091] [INFO ] [REMOTE ] AMBP: Full fetch complete (65265 records). [2025-10-16T17:12:28.759186] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-16T17:12:29.176676] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-16T17:12:29.176911] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-16T17:12:29.177633] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-16T17:12:29.177746] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-16T17:12:29.179142] [DEBUG] [LOCAL ] AMBP: Trimmed 65265 records to 44894 (keeping 200 days of data) [2025-10-16T17:12:29.413192] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:12:29.482907] [DEBUG] [LOCAL ] AMBP: Primary data saved (44894 records). [2025-10-16T17:12:29.483041] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-16T17:12:29.483117] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMBP took 27.2s. Estimated remaining: 4h 51m 9s. Rate: 7.8 symbols/min [2025-10-16T17:12:29.547915] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-16T17:12:29.651124] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:29.671464] [DEBUG] [LOCAL ] AMG: Loaded 20143 existing records from primary storage. [2025-10-16T17:12:29.671745] [INFO ] [MAIN ] AMG: Loaded 20143 existing records. [2025-10-16T17:12:29.846499] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:29.846788] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-16T17:12:29.846841] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-16T17:12:29.847112] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-16T17:12:29.847151] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-16T17:12:30.210374] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:30.352320] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-16T17:12:30.373514] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:12:31.142788] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-16T17:12:31.423035] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:12:31.475895] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T17:12:31.942815] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-16T17:12:32.438132] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:12:32.742789] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-16T17:12:33.085568] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T17:12:33.542825] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-16T17:12:34.342886] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-16T17:12:34.773083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T17:12:35.047382] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:12:35.142780] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-16T17:12:35.554468] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:12:35.942818] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-16T17:12:36.742884] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-16T17:12:36.849742] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T17:12:37.543025] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-16T17:12:37.992112] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T17:12:38.342876] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-16T17:12:38.892681] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:12:39.142829] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-16T17:12:39.290090] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-16T17:12:39.942848] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-16T17:12:40.060062] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:12:40.067236] [INFO ] [REMOTE ] AMCR: Full fetch complete (77841 records). [2025-10-16T17:12:40.067415] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-16T17:12:40.497246] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:12:40.528178] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-16T17:12:40.528686] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-16T17:12:40.530003] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-16T17:12:40.530073] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-16T17:12:40.531561] [DEBUG] [LOCAL ] AMCR: Trimmed 77841 records to 54059 (keeping 200 days of data) [2025-10-16T17:12:40.745475] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-16T17:12:40.856090] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-16T17:12:40.856232] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-16T17:12:40.856313] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 31.1s. Estimated remaining: 4h 52m 26s. Rate: 7.8 symbols/min [2025-10-16T17:12:41.027860] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:41.075913] [DEBUG] [LOCAL ] AMH: Loaded 51831 existing records from primary storage. [2025-10-16T17:12:41.076249] [INFO ] [MAIN ] AMH: Loaded 51831 existing records. [2025-10-16T17:12:41.256055] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:41.256332] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-16T17:12:41.256445] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-16T17:12:41.256882] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-16T17:12:41.256940] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-16T17:12:41.548082] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-16T17:12:41.614125] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:42.023334] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T17:12:42.153124] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:12:42.342822] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-16T17:12:42.992310] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:12:43.001118] [INFO ] [REMOTE ] AME: Full fetch complete (70056 records). [2025-10-16T17:12:43.001256] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-16T17:12:43.147957] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-16T17:12:43.396290] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-16T17:12:43.396458] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-16T17:12:43.397287] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-16T17:12:43.397374] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-16T17:12:43.398831] [DEBUG] [LOCAL ] AME: Trimmed 70056 records to 49020 (keeping 200 days of data) [2025-10-16T17:12:43.631431] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:12:43.726497] [DEBUG] [LOCAL ] AME: Primary data saved (49020 records). [2025-10-16T17:12:43.726665] [INFO ] [MAIN ] AME: Full history saved. [2025-10-16T17:12:43.727090] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 32.5s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-16T17:12:43.890882] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:43.930820] [DEBUG] [LOCAL ] AMN: Loaded 41839 existing records from primary storage. [2025-10-16T17:12:43.931103] [INFO ] [MAIN ] AMN: Loaded 41839 existing records. [2025-10-16T17:12:43.951241] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-16T17:12:44.106596] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:44.106825] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-16T17:12:44.106871] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-16T17:12:44.107164] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-16T17:12:44.107220] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-16T17:12:44.451180] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:44.610607] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:12:44.742813] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-16T17:12:45.045450] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:12:45.542877] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-16T17:12:46.342867] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-16T17:12:47.065837] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T17:12:47.114846] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:12:47.142786] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-16T17:12:47.948034] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-16T17:12:47.963781] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:12:48.742776] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-16T17:12:48.891899] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:12:49.542861] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-16T17:12:49.657006] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-16T17:12:49.695069] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T17:12:50.342877] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-16T17:12:50.520714] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T17:12:51.142815] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-16T17:12:51.909700] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:12:51.942817] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-16T17:12:52.351503] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:12:52.742821] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-16T17:12:53.393613] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:12:53.542829] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-16T17:12:54.342828] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-16T17:12:54.374730] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:12:55.142822] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-16T17:12:55.521903] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:12:55.524562] [INFO ] [REMOTE ] AMG: Full fetch complete (29574 records). [2025-10-16T17:12:55.524661] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-16T17:12:55.932879] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-16T17:12:55.935336] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T17:12:55.935578] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-16T17:12:55.945963] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-16T17:12:55.946681] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-16T17:12:55.947616] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-16T17:12:55.949472] [DEBUG] [LOCAL ] AMG: Trimmed 29574 records to 20310 (keeping 200 days of data) [2025-10-16T17:12:56.076853] [DEBUG] [LOCAL ] AMG: Primary data saved (20310 records). [2025-10-16T17:12:56.076983] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-16T17:12:56.077057] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 26.6s. Estimated remaining: 4h 52m 6s. Rate: 7.8 symbols/min [2025-10-16T17:12:56.250341] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:12:56.285178] [DEBUG] [LOCAL ] AMP: Loaded 32020 existing records from primary storage. [2025-10-16T17:12:56.285450] [INFO ] [MAIN ] AMP: Loaded 32020 existing records. [2025-10-16T17:12:56.461185] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:12:56.461965] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-16T17:12:56.462016] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-16T17:12:56.462308] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-16T17:12:56.462347] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-16T17:12:56.752341] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-16T17:12:56.834025] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:12:56.874976] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:12:57.308459] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:12:57.542816] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-16T17:12:58.342822] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-16T17:12:59.082597] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-16T17:12:59.142820] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-16T17:12:59.335044] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:12:59.495732] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:12:59.942821] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-16T17:13:00.742823] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-16T17:13:01.371762] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:13:01.462497] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-16T17:13:01.469408] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-16T17:13:01.469547] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-16T17:13:01.547976] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-16T17:13:01.876074] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-16T17:13:01.876164] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-16T17:13:01.877039] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-16T17:13:01.877112] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-16T17:13:01.879027] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54152 (keeping 200 days of data) [2025-10-16T17:13:02.228181] [DEBUG] [LOCAL ] AMC: Primary data saved (54152 records). [2025-10-16T17:13:02.228540] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-16T17:13:02.228718] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMC took 54.0s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-16T17:13:02.359404] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-16T17:13:02.378752] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:13:02.456463] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:02.507739] [DEBUG] [LOCAL ] AMPX: Loaded 52338 existing records from primary storage. [2025-10-16T17:13:02.508062] [INFO ] [MAIN ] AMPX: Loaded 52338 existing records. [2025-10-16T17:13:02.698670] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:02.699010] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-16T17:13:02.699083] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-16T17:13:02.699498] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-16T17:13:02.699697] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-16T17:13:02.828324] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:13:03.086904] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:03.142781] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-16T17:13:03.732381] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:13:03.942811] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-16T17:13:04.742792] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-16T17:13:04.771467] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:13:05.334906] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:13:05.542829] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-16T17:13:06.276184] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:13:06.342784] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-16T17:13:06.728140] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:13:07.142858] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-16T17:13:07.661005] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T17:13:07.942840] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-16T17:13:08.731717] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T17:13:08.742769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-16T17:13:09.219973] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:13:09.542874] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-16T17:13:10.215693] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:13:10.342840] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-16T17:13:11.079750] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:13:11.142830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-16T17:13:11.334938] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T17:13:11.942834] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-16T17:13:12.742842] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-16T17:13:12.886199] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T17:13:13.004935] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T17:13:13.542867] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-16T17:13:14.089126] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T17:13:14.097234] [INFO ] [REMOTE ] AMN: Full fetch complete (60378 records). [2025-10-16T17:13:14.097407] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-16T17:13:14.354267] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-16T17:13:14.501177] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-16T17:13:14.501284] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-16T17:13:14.502358] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-16T17:13:14.502438] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-16T17:13:14.504170] [DEBUG] [LOCAL ] AMN: Trimmed 60378 records to 42102 (keeping 200 days of data) [2025-10-16T17:13:14.775839] [DEBUG] [LOCAL ] AMN: Primary data saved (42102 records). [2025-10-16T17:13:14.775972] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-16T17:13:14.776388] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 31.0s. Estimated remaining: 4h 53m 2s. Rate: 7.7 symbols/min [2025-10-16T17:13:14.953322] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:14.974521] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:13:15.016682] [DEBUG] [LOCAL ] AMPY: Loaded 39159 existing records from primary storage. [2025-10-16T17:13:15.016969] [INFO ] [MAIN ] AMPY: Loaded 39159 existing records. [2025-10-16T17:13:15.148038] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-16T17:13:15.199687] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:15.200150] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-16T17:13:15.200205] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-16T17:13:15.200574] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-16T17:13:15.200631] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-16T17:13:15.569676] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:15.942807] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-16T17:13:16.330846] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:13:16.722088] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:13:16.742758] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-16T17:13:16.884495] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T17:13:17.542851] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-16T17:13:18.210979] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:13:18.217033] [INFO ] [REMOTE ] AMP: Full fetch complete (47525 records). [2025-10-16T17:13:18.217185] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-16T17:13:18.348011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-16T17:13:18.618261] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-16T17:13:18.618340] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-16T17:13:18.618850] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-16T17:13:18.618932] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-16T17:13:18.619884] [DEBUG] [LOCAL ] AMP: Trimmed 47525 records to 32286 (keeping 200 days of data) [2025-10-16T17:13:18.816112] [DEBUG] [LOCAL ] AMP: Primary data saved (32286 records). [2025-10-16T17:13:18.816290] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-16T17:13:18.817093] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 22.7s. Estimated remaining: 4h 51m 33s. Rate: 7.8 symbols/min [2025-10-16T17:13:19.002664] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:19.032359] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:13:19.070041] [DEBUG] [LOCAL ] AMR: Loaded 28956 existing records from primary storage. [2025-10-16T17:13:19.070293] [INFO ] [MAIN ] AMR: Loaded 28956 existing records. [2025-10-16T17:13:19.146104] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-16T17:13:19.248686] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:19.248942] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-16T17:13:19.249000] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-16T17:13:19.249298] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-16T17:13:19.249353] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-16T17:13:19.551176] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:13:19.621550] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:19.942863] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-16T17:13:20.425454] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T17:13:20.742863] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-16T17:13:21.173785] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T17:13:21.542878] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-16T17:13:22.342815] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-16T17:13:22.649877] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T17:13:22.710444] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:13:23.142813] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-16T17:13:23.879700] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T17:13:23.942839] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-16T17:13:24.742892] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-16T17:13:24.974628] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:13:25.542845] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-16T17:13:25.691510] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:13:25.698171] [INFO ] [REMOTE ] AMH: Full fetch complete (75087 records). [2025-10-16T17:13:25.698280] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-16T17:13:26.032874] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:13:26.133563] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-16T17:13:26.133663] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-16T17:13:26.134415] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-16T17:13:26.134457] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-16T17:13:26.135840] [DEBUG] [LOCAL ] AMH: Trimmed 75087 records to 52220 (keeping 200 days of data) [2025-10-16T17:13:26.348535] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-16T17:13:26.448815] [DEBUG] [LOCAL ] AMH: Primary data saved (52220 records). [2025-10-16T17:13:26.448985] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-16T17:13:26.449104] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMH took 45.6s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-16T17:13:26.627581] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:26.664243] [DEBUG] [LOCAL ] AMRC: Loaded 38459 existing records from primary storage. [2025-10-16T17:13:26.664555] [INFO ] [MAIN ] AMRC: Loaded 38459 existing records. [2025-10-16T17:13:26.838993] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:26.839234] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-16T17:13:26.839284] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-16T17:13:26.839628] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-16T17:13:26.839744] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-16T17:13:27.144898] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-16T17:13:27.205716] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:27.305421] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:13:27.626057] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T17:13:27.942823] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-16T17:13:27.997081] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:13:28.742872] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-16T17:13:29.542899] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-16T17:13:29.695404] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T17:13:29.862771] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T17:13:30.342830] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-16T17:13:30.898887] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:13:31.142825] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-16T17:13:31.942781] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-16T17:13:32.125582] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:13:32.655125] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-16T17:13:32.742796] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-16T17:13:33.126983] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:13:33.542877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-16T17:13:34.342835] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-16T17:13:34.622566] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:13:34.881041] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T17:13:35.142812] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-16T17:13:35.260082] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:13:35.942831] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-16T17:13:36.742873] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-16T17:13:36.967452] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:13:37.381638] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:13:37.542975] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-16T17:13:37.604127] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:13:38.342831] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-16T17:13:39.142824] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-16T17:13:39.611034] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T17:13:39.617859] [INFO ] [REMOTE ] AMPX: Full fetch complete (75210 records). [2025-10-16T17:13:39.617970] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-16T17:13:39.944331] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-16T17:13:39.947017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:13:40.058829] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-16T17:13:40.059057] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-16T17:13:40.060663] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-16T17:13:40.061080] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-16T17:13:40.063266] [DEBUG] [LOCAL ] AMPX: Trimmed 75210 records to 52728 (keeping 200 days of data) [2025-10-16T17:13:40.137082] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:13:40.382634] [DEBUG] [LOCAL ] AMPX: Primary data saved (52728 records). [2025-10-16T17:13:40.382801] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-16T17:13:40.382888] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPX took 38.2s. Estimated remaining: 4h 53m 30s. Rate: 7.7 symbols/min [2025-10-16T17:13:40.548791] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:40.548993] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-16T17:13:40.549041] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-16T17:13:40.549164] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-16T17:13:40.549206] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-16T17:13:40.549247] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-16T17:13:40.549279] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-16T17:13:40.749460] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-16T17:13:40.908841] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:41.542835] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-16T17:13:41.705782] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:13:42.070015] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:13:42.342871] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-16T17:13:42.629422] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:13:43.142797] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-16T17:13:43.734993] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T17:13:43.942855] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-16T17:13:44.165956] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:13:44.166268] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-16T17:13:44.166374] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:13:44.166499] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-16T17:13:44.166586] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:13:44.166707] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-16T17:13:44.166795] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-16T17:13:44.166835] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-16T17:13:44.166877] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-16T17:13:44.166926] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRZ took 3.8s. Estimated remaining: 4h 51m 56s. Rate: 7.8 symbols/min [2025-10-16T17:13:44.342196] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:44.403760] [DEBUG] [LOCAL ] AMT: Loaded 52475 existing records from primary storage. [2025-10-16T17:13:44.404087] [INFO ] [MAIN ] AMT: Loaded 52475 existing records. [2025-10-16T17:13:44.591764] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:44.592041] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-16T17:13:44.592282] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-16T17:13:44.592888] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-16T17:13:44.592948] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-16T17:13:44.753447] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-16T17:13:45.024863] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:13:45.038276] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:45.542828] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-16T17:13:46.260243] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:13:46.342788] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-16T17:13:47.142856] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-16T17:13:47.437811] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T17:13:47.505769] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:13:47.942876] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-16T17:13:48.742880] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-16T17:13:48.881565] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:13:48.888546] [INFO ] [REMOTE ] AMPY: Full fetch complete (52957 records). [2025-10-16T17:13:48.888713] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-16T17:13:49.198047] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:13:49.305845] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-16T17:13:49.305935] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-16T17:13:49.306572] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-16T17:13:49.306617] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-16T17:13:49.307982] [DEBUG] [LOCAL ] AMPY: Trimmed 52957 records to 39500 (keeping 200 days of data) [2025-10-16T17:13:49.525366] [DEBUG] [LOCAL ] AMPY: Primary data saved (39500 records). [2025-10-16T17:13:49.525557] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-16T17:13:49.526012] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMPY took 34.7s. Estimated remaining: 4h 50m 58s. Rate: 7.8 symbols/min [2025-10-16T17:13:49.548052] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-16T17:13:49.698067] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:49.720237] [DEBUG] [LOCAL ] AMTB: Loaded 20526 existing records from primary storage. [2025-10-16T17:13:49.720475] [INFO ] [MAIN ] AMTB: Loaded 20526 existing records. [2025-10-16T17:13:49.892036] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:49.892288] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-16T17:13:49.892341] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-16T17:13:49.892516] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-16T17:13:49.892572] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-16T17:13:50.249662] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:50.342795] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-16T17:13:50.593272] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T17:13:51.041823] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:13:51.142792] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-16T17:13:51.597426] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:13:51.602239] [INFO ] [REMOTE ] AMR: Full fetch complete (40595 records). [2025-10-16T17:13:51.602419] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-16T17:13:51.947980] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-16T17:13:51.999414] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-16T17:13:51.999494] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-16T17:13:52.000067] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-16T17:13:52.000143] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-16T17:13:52.001086] [DEBUG] [LOCAL ] AMR: Trimmed 40595 records to 29158 (keeping 200 days of data) [2025-10-16T17:13:52.184300] [DEBUG] [LOCAL ] AMR: Primary data saved (29158 records). [2025-10-16T17:13:52.184401] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-16T17:13:52.184482] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 33.4s. Estimated remaining: 4h 49m 5s. Rate: 7.8 symbols/min [2025-10-16T17:13:52.352415] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:13:52.358535] [DEBUG] [LOCAL ] AMTD: Loaded 3789 existing records from primary storage. [2025-10-16T17:13:52.358719] [INFO ] [MAIN ] AMTD: Loaded 3789 existing records. [2025-10-16T17:13:52.541101] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:13:52.541323] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-16T17:13:52.541391] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-16T17:13:52.557743] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-16T17:13:52.558151] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-16T17:13:52.558688] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:13:52.753867] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-16T17:13:52.925343] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:13:53.238321] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T17:13:53.542814] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-16T17:13:54.076934] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:13:54.342865] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-16T17:13:54.438051] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:13:54.810943] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T17:13:55.142836] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-16T17:13:55.942845] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-16T17:13:56.716971] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:13:56.742776] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-16T17:13:56.945332] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:13:57.542855] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-16T17:13:58.113411] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:13:58.342789] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-16T17:13:58.584305] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T17:13:58.862922] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T17:13:59.142806] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-16T17:13:59.942843] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-16T17:14:00.287618] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T17:14:00.742800] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-16T17:14:01.233203] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T17:14:01.542811] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-16T17:14:01.777609] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T17:14:02.342817] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-16T17:14:03.142481] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:14:03.150678] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-16T17:14:03.484959] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T17:14:03.515887] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T17:14:03.942815] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-16T17:14:04.663962] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:14:04.742791] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-16T17:14:05.323036] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:14:05.542841] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-16T17:14:06.342864] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-16T17:14:06.690858] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T17:14:06.919425] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T17:14:07.142860] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-16T17:14:07.942863] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-16T17:14:08.145887] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:14:08.742928] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-16T17:14:09.099782] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T17:14:09.167883] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-16T17:14:09.542824] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-16T17:14:10.342832] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-16T17:14:10.678223] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T17:14:10.934682] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T17:14:10.935897] [INFO ] [REMOTE ] AMTD: Full fetch complete (5580 records). [2025-10-16T17:14:10.935968] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-16T17:14:11.150115] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-16T17:14:11.346118] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-16T17:14:11.346192] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-16T17:14:11.346345] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-16T17:14:11.346381] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-16T17:14:11.346766] [DEBUG] [LOCAL ] AMTD: Trimmed 5580 records to 3819 (keeping 200 days of data) [2025-10-16T17:14:11.368428] [DEBUG] [LOCAL ] AMTD: Primary data saved (3819 records). [2025-10-16T17:14:11.368495] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-16T17:14:11.368563] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTD took 19.2s. Estimated remaining: 4h 52m 56s. Rate: 7.7 symbols/min [2025-10-16T17:14:11.540109] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:11.589738] [DEBUG] [LOCAL ] AMTM: Loaded 50564 existing records from primary storage. [2025-10-16T17:14:11.590045] [INFO ] [MAIN ] AMTM: Loaded 50564 existing records. [2025-10-16T17:14:11.773328] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:11.774757] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-16T17:14:11.774817] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-16T17:14:11.775735] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-16T17:14:11.775793] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-16T17:14:11.949780] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-16T17:14:12.133244] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:12.329078] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:14:12.742823] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-16T17:14:13.542846] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-16T17:14:13.934498] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T17:14:14.207543] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:14:14.342835] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-16T17:14:14.630543] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:14:15.142818] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-16T17:14:15.942802] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-16T17:14:16.334991] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T17:14:16.532911] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:14:16.742818] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-16T17:14:16.944891] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:14:17.542857] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-16T17:14:18.342820] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-16T17:14:18.575387] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:14:18.855756] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:14:19.130710] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T17:14:19.133604] [INFO ] [REMOTE ] AMTB: Full fetch complete (29608 records). [2025-10-16T17:14:19.133706] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-16T17:14:19.147996] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-16T17:14:19.529779] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-16T17:14:19.529876] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-16T17:14:19.530267] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-16T17:14:19.530309] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-16T17:14:19.531222] [DEBUG] [LOCAL ] AMTB: Trimmed 29608 records to 20672 (keeping 200 days of data) [2025-10-16T17:14:19.654728] [DEBUG] [LOCAL ] AMTB: Primary data saved (20672 records). [2025-10-16T17:14:19.654846] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-16T17:14:19.654920] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTB took 30.1s. Estimated remaining: 4h 52m 58s. Rate: 7.7 symbols/min [2025-10-16T17:14:19.839975] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:19.851456] [DEBUG] [LOCAL ] AMWL: Loaded 9542 existing records from primary storage. [2025-10-16T17:14:19.851696] [INFO ] [MAIN ] AMWL: Loaded 9542 existing records. [2025-10-16T17:14:19.950363] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-16T17:14:20.041430] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:20.041706] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-16T17:14:20.041765] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-16T17:14:20.041914] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-16T17:14:20.041970] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-16T17:14:20.386128] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:20.742797] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-16T17:14:21.175234] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T17:14:21.542804] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-16T17:14:21.682373] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T17:14:22.122455] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:14:22.131228] [INFO ] [REMOTE ] AMRC: Full fetch complete (54271 records). [2025-10-16T17:14:22.131460] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-16T17:14:22.347983] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-16T17:14:22.657426] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-16T17:14:22.657541] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-16T17:14:22.658384] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-16T17:14:22.658452] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-16T17:14:22.660461] [DEBUG] [LOCAL ] AMRC: Trimmed 54271 records to 38803 (keeping 200 days of data) [2025-10-16T17:14:22.885570] [DEBUG] [LOCAL ] AMRC: Primary data saved (38803 records). [2025-10-16T17:14:22.885737] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-16T17:14:22.885827] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMRC took 56.4s. Estimated remaining: 4h 51m 18s. Rate: 7.8 symbols/min [2025-10-16T17:14:23.051707] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:23.097686] [DEBUG] [LOCAL ] AMX: Loaded 49144 existing records from primary storage. [2025-10-16T17:14:23.098027] [INFO ] [MAIN ] AMX: Loaded 49144 existing records. [2025-10-16T17:14:23.155543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-16T17:14:23.295001] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:23.295390] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-16T17:14:23.295601] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-16T17:14:23.295977] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-16T17:14:23.296084] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-16T17:14:23.422193] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:14:23.474333] [INFO ] [REMOTE ] AMT: Full fetch complete (76191 records). [2025-10-16T17:14:23.489696] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-16T17:14:23.868427] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:23.946707] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-16T17:14:24.165258] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-16T17:14:24.165707] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-16T17:14:24.173987] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-16T17:14:24.174219] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-16T17:14:24.176305] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T17:14:24.180886] [DEBUG] [LOCAL ] AMT: Trimmed 76191 records to 52860 (keeping 200 days of data) [2025-10-16T17:14:24.308512] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:14:24.561775] [DEBUG] [LOCAL ] AMT: Primary data saved (52860 records). [2025-10-16T17:14:24.561916] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-16T17:14:24.562697] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMT took 40.4s. Estimated remaining: 4h 49m 8s. Rate: 7.8 symbols/min [2025-10-16T17:14:24.736794] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:24.742819] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-16T17:14:24.776935] [DEBUG] [LOCAL ] AN: Loaded 31439 existing records from primary storage. [2025-10-16T17:14:24.777212] [INFO ] [MAIN ] AN: Loaded 31439 existing records. [2025-10-16T17:14:24.958517] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:24.958781] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-16T17:14:24.958833] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-16T17:14:24.959110] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-16T17:14:24.959167] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-16T17:14:25.353468] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:25.542863] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-16T17:14:25.700305] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T17:14:26.342853] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-16T17:14:26.557292] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:14:26.711398] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:14:27.142816] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-16T17:14:27.584791] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T17:14:27.942865] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-16T17:14:28.582202] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:14:28.742847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-16T17:14:29.287503] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:14:29.542894] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-16T17:14:29.645735] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:14:30.342869] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-16T17:14:30.415886] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:14:31.142877] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-16T17:14:31.784130] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:14:31.942835] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-16T17:14:32.638416] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:14:32.742816] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-16T17:14:33.374529] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T17:14:33.542843] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-16T17:14:34.342788] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-16T17:14:34.379581] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:14:34.926501] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:14:35.142846] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-16T17:14:35.520365] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:14:35.942846] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-16T17:14:36.039007] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:14:36.742848] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-16T17:14:37.333022] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:14:37.332836] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:14:37.542809] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-16T17:14:38.342805] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-16T17:14:39.142821] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-16T17:14:39.286062] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:14:39.723948] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:14:39.942825] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-16T17:14:40.608708] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:14:40.742802] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-16T17:14:41.542783] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-16T17:14:41.684108] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:14:41.997690] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:14:42.342805] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-16T17:14:43.066261] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T17:14:43.073369] [INFO ] [REMOTE ] AMTM: Full fetch complete (73883 records). [2025-10-16T17:14:43.073532] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-16T17:14:43.151548] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-16T17:14:43.479413] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-16T17:14:43.479706] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-16T17:14:43.480583] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-16T17:14:43.480706] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-16T17:14:43.482394] [DEBUG] [LOCAL ] AMTM: Trimmed 73883 records to 50899 (keeping 200 days of data) [2025-10-16T17:14:43.717685] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:14:43.771759] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T17:14:43.837461] [DEBUG] [LOCAL ] AMTM: Primary data saved (50899 records). [2025-10-16T17:14:43.837610] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-16T17:14:43.838572] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMTM took 32.5s. Estimated remaining: 4h 52m 52s. Rate: 7.7 symbols/min [2025-10-16T17:14:43.948040] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-16T17:14:44.008145] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:44.063698] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-16T17:14:44.064021] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-16T17:14:44.238435] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:44.238678] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-16T17:14:44.238737] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-16T17:14:44.239208] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-16T17:14:44.239264] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-16T17:14:44.588956] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:44.742782] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-16T17:14:45.425145] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:14:45.542841] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-16T17:14:46.342820] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-16T17:14:46.745826] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T17:14:46.827586] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T17:14:47.142808] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-16T17:14:47.579549] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:14:47.942825] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-16T17:14:48.742885] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-16T17:14:49.074908] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T17:14:49.420555] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T17:14:49.437618] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:14:49.542843] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-16T17:14:50.342830] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-16T17:14:51.142904] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-16T17:14:51.724801] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T17:14:51.942833] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-16T17:14:52.188633] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T17:14:52.227946] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:14:52.231916] [INFO ] [REMOTE ] AN: Full fetch complete (47121 records). [2025-10-16T17:14:52.232049] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-16T17:14:52.635384] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-16T17:14:52.635491] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-16T17:14:52.636090] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-16T17:14:52.636154] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-16T17:14:52.637462] [DEBUG] [LOCAL ] AN: Trimmed 47121 records to 31615 (keeping 200 days of data) [2025-10-16T17:14:52.742870] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-16T17:14:52.833004] [DEBUG] [LOCAL ] AN: Primary data saved (31615 records). [2025-10-16T17:14:52.833169] [INFO ] [MAIN ] AN: Full history saved. [2025-10-16T17:14:52.833254] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 28.3s. Estimated remaining: 4h 53m 8s. Rate: 7.7 symbols/min [2025-10-16T17:14:53.010820] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:53.060352] [DEBUG] [LOCAL ] ANF: Loaded 52079 existing records from primary storage. [2025-10-16T17:14:53.060706] [INFO ] [MAIN ] ANF: Loaded 52079 existing records. [2025-10-16T17:14:53.241201] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:14:53.241538] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-16T17:14:53.241592] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-16T17:14:53.241904] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-16T17:14:53.241959] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-16T17:14:53.349815] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T17:14:53.548006] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-16T17:14:53.614495] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:14:54.021181] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:14:54.105524] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:14:54.342822] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-16T17:14:55.082132] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:14:55.142828] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-16T17:14:55.942920] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-16T17:14:56.742895] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-16T17:14:57.195411] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-16T17:14:57.463933] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:14:57.542815] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-16T17:14:58.342859] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-16T17:14:58.687413] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:14:58.790209] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:14:58.796750] [INFO ] [REMOTE ] AMX: Full fetch complete (70959 records). [2025-10-16T17:14:58.796933] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-16T17:14:59.149746] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-16T17:14:59.206273] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-16T17:14:59.202404] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T17:14:59.206400] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-16T17:14:59.207402] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-16T17:14:59.210726] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-16T17:14:59.212211] [DEBUG] [LOCAL ] AMX: Trimmed 70959 records to 49533 (keeping 200 days of data) [2025-10-16T17:14:59.507433] [DEBUG] [LOCAL ] AMX: Primary data saved (49533 records). [2025-10-16T17:14:59.507716] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-16T17:14:59.507833] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 36.6s. Estimated remaining: 4h 52m 38s. Rate: 7.7 symbols/min [2025-10-16T17:14:59.674112] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:14:59.674311] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-16T17:14:59.674349] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-16T17:14:59.674458] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-16T17:14:59.674498] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-16T17:14:59.674538] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-16T17:14:59.674569] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-16T17:14:59.947717] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-16T17:15:00.028571] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:00.742863] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-16T17:15:01.542856] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-16T17:15:01.771082] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T17:15:01.800947] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:15:01.801341] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-16T17:15:01.801437] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:15:01.801525] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-16T17:15:01.801609] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:15:01.801723] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-16T17:15:01.801808] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-16T17:15:01.801856] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-16T17:15:01.801909] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-16T17:15:01.801968] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 2.3s. Estimated remaining: 4h 50m 44s. Rate: 7.7 symbols/min [2025-10-16T17:15:01.945332] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-16T17:15:01.996350] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:15:02.020671] [INFO ] [REMOTE ] AMWL: Full fetch complete (14538 records). [2025-10-16T17:15:02.039903] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-16T17:15:02.076922] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:02.138507] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-16T17:15:02.176587] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-16T17:15:02.180066] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-16T17:15:02.195908] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-16T17:15:02.229114] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-16T17:15:02.302797] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-16T17:15:02.358475] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-16T17:15:02.662052] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-16T17:15:02.678285] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-16T17:15:02.741565] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-16T17:15:02.756478] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-16T17:15:02.795495] [DEBUG] [LOCAL ] AMWL: Trimmed 14538 records to 9671 (keeping 200 days of data) [2025-10-16T17:15:02.909794] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:02.924157] [DEBUG] [LOCAL ] AMWL: Primary data saved (9671 records). [2025-10-16T17:15:02.924229] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-16T17:15:02.924296] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. AMWL took 43.3s. Estimated remaining: 4h 48m 28s. Rate: 7.8 symbols/min [2025-10-16T17:15:03.142777] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-16T17:15:03.942842] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-16T17:15:04.243484] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:15:04.742848] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-16T17:15:04.984030] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-16T17:15:05.447927] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T17:15:05.468782] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:15:05.542795] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-16T17:15:06.342792] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-16T17:15:06.587079] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T17:15:07.142842] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-16T17:15:07.942830] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-16T17:15:08.290492] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T17:15:08.742847] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-16T17:15:09.174480] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:15:09.230477] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T17:15:09.542818] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-16T17:15:10.342849] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-16T17:15:10.731322] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:15:10.754696] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T17:15:11.142901] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-16T17:15:11.942860] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-16T17:15:12.384711] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T17:15:12.742881] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-16T17:15:12.957372] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:15:13.116977] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:15:13.542900] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-16T17:15:14.342874] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-16T17:15:14.557507] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:15:15.142905] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-16T17:15:15.200400] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-16T17:15:15.906844] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T17:15:15.929229] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:15:15.942791] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-16T17:15:16.742796] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-16T17:15:16.763375] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:15:17.542912] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-16T17:15:18.300521] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T17:15:18.342807] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-16T17:15:18.670413] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:15:19.142839] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-16T17:15:19.587433] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:15:19.591419] [INFO ] [REMOTE ] ANRO: Full fetch complete (29806 records). [2025-10-16T17:15:19.591528] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-16T17:15:19.946693] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-16T17:15:19.986387] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-16T17:15:19.986497] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-16T17:15:19.987058] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-16T17:15:19.987321] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-16T17:15:19.988830] [DEBUG] [LOCAL ] ANRO: Trimmed 29806 records to 19575 (keeping 200 days of data) [2025-10-16T17:15:20.083334] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:15:20.094573] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-16T17:15:20.095583] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-16T17:15:20.521354] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-16T17:15:20.521737] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-16T17:15:20.522717] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-16T17:15:20.523066] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-16T17:15:20.525944] [DEBUG] [LOCAL ] ANRO: Primary data saved (19575 records). [2025-10-16T17:15:20.526060] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-16T17:15:20.526251] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANRO took 18.7s. Estimated remaining: 4h 51m 30s. Rate: 7.7 symbols/min [2025-10-16T17:15:20.527053] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54156 (keeping 200 days of data) [2025-10-16T17:15:20.841798] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-16T17:15:20.841934] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-16T17:15:20.842676] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANET took 37.0s. Estimated remaining: 4h 49m 1s. Rate: 7.8 symbols/min [2025-10-16T17:15:21.772377] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:15:21.784026] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-16T17:15:23.298233] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:15:23.309202] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-16T17:15:25.215510] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:15:25.222527] [INFO ] [REMOTE ] ANF: Full fetch complete (75804 records). [2025-10-16T17:15:25.222717] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-16T17:15:25.617059] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-16T17:15:25.617133] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-16T17:15:25.617879] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-16T17:15:25.617941] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-16T17:15:25.619275] [DEBUG] [LOCAL ] ANF: Trimmed 75804 records to 52463 (keeping 200 days of data) [2025-10-16T17:15:25.915617] [DEBUG] [LOCAL ] ANF: Primary data saved (52463 records). [2025-10-16T17:15:25.915778] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-16T17:15:25.916268] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANF took 33.1s. Estimated remaining: 4h 48m 4s. Rate: 7.8 symbols/min [2025-10-16T17:15:26.492929] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.545344] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-16T17:15:26.583235] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-16T17:15:26.569853] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.638313] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-16T17:15:26.640603] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-16T17:15:26.637979] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.641483] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:26.641732] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-16T17:15:26.642488] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-16T17:15:26.832959] [DEBUG] [LOCAL ] AOMR: Loaded 16461 existing records from primary storage. [2025-10-16T17:15:26.849870] [DEBUG] [LOCAL ] ANVS: Loaded 23750 existing records from primary storage. [2025-10-16T17:15:26.857432] [DEBUG] [LOCAL ] AOD: Loaded 30814 existing records from primary storage. [2025-10-16T17:15:26.856990] [INFO ] [MAIN ] AOMR: Loaded 16461 existing records. [2025-10-16T17:15:26.865535] [INFO ] [MAIN ] AOD: Loaded 30814 existing records. [2025-10-16T17:15:26.857692] [INFO ] [MAIN ] ANVS: Loaded 23750 existing records. [2025-10-16T17:15:27.591245] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.613550] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.587812] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:27.653007] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-16T17:15:27.658215] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.638251] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-16T17:15:27.664192] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-16T17:15:27.667465] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-16T17:15:27.667197] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:27.667384] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.712107] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-16T17:15:27.721962] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-16T17:15:27.736178] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-16T17:15:27.721793] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-16T17:15:27.746863] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-16T17:15:27.789548] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-16T17:15:27.850824] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-16T17:15:27.918314] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:15:27.957317] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-16T17:15:27.974328] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:15:28.038948] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-16T17:15:28.122371] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:15:28.173365] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-16T17:15:28.226728] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-16T17:15:28.333384] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-16T17:15:28.417907] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.436696] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-16T17:15:28.436405] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-16T17:15:28.505456] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 46m 22s. Rate: 7.9 symbols/min [2025-10-16T17:15:28.870272] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.907517] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-16T17:15:28.938082] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:28.964577] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-16T17:15:28.986357] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:29.029210] [DEBUG] [LOCAL ] AON: Loaded 45133 existing records from primary storage. [2025-10-16T17:15:29.029556] [INFO ] [MAIN ] AON: Loaded 45133 existing records. [2025-10-16T17:15:29.200790] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:29.200974] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-16T17:15:29.201022] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-16T17:15:29.201211] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-16T17:15:29.201250] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-16T17:15:29.495865] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T17:15:29.509319] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-16T17:15:29.560009] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:29.560304] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-16T17:15:30.150092] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:15:30.152996] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-16T17:15:30.292726] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T17:15:30.299453] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-16T17:15:30.376143] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:15:30.383225] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-16T17:15:31.269152] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:15:31.279076] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-16T17:15:31.295804] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:15:31.300306] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-16T17:15:31.326987] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T17:15:31.334507] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-16T17:15:31.594030] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:15:31.942891] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-16T17:15:32.262021] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T17:15:32.342501] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:15:32.436074] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:15:32.742829] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-16T17:15:33.386628] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:15:33.542850] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-16T17:15:34.031117] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:15:34.317326] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:15:34.343007] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-16T17:15:35.142803] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-16T17:15:35.459932] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:15:35.942854] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-16T17:15:36.309971] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:15:36.742851] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-16T17:15:37.083579] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T17:15:37.542894] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-16T17:15:37.578449] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:15:38.342887] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-16T17:15:38.822593] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:15:39.142897] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-16T17:15:39.894456] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T17:15:39.942820] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-16T17:15:40.552489] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:15:40.742822] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-16T17:15:41.453531] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:15:41.542805] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-16T17:15:42.095846] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:15:42.342853] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-16T17:15:43.142804] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-16T17:15:43.325629] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:15:43.760271] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T17:15:43.942777] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-16T17:15:44.016673] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T17:15:44.742861] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-16T17:15:45.249513] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:15:45.542791] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-16T17:15:45.795211] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:15:46.342818] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-16T17:15:46.659630] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:15:47.142821] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-16T17:15:47.629674] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:15:47.942867] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-16T17:15:48.141080] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:15:48.581454] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:15:48.742814] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-16T17:15:49.542810] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-16T17:15:49.725777] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:15:50.342818] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-16T17:15:50.846749] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:15:50.851473] [INFO ] [REMOTE ] AOD: Full fetch complete (44706 records). [2025-10-16T17:15:50.851638] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-16T17:15:51.145444] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-16T17:15:51.236918] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-16T17:15:51.237036] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-16T17:15:51.237582] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-16T17:15:51.237625] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-16T17:15:51.238797] [DEBUG] [LOCAL ] AOD: Trimmed 44706 records to 31036 (keeping 200 days of data) [2025-10-16T17:15:51.419307] [DEBUG] [LOCAL ] AOD: Primary data saved (31036 records). [2025-10-16T17:15:51.419480] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-16T17:15:51.419603] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 25.5s. Estimated remaining: 4h 50m 55s. Rate: 7.7 symbols/min [2025-10-16T17:15:51.594606] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:51.622108] [DEBUG] [LOCAL ] AORT: Loaded 29190 existing records from primary storage. [2025-10-16T17:15:51.622405] [INFO ] [MAIN ] AORT: Loaded 29190 existing records. [2025-10-16T17:15:51.799819] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:51.800092] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-16T17:15:51.800258] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-16T17:15:51.800447] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-16T17:15:51.800489] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-16T17:15:51.940859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:15:51.954034] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-16T17:15:52.017328] [INFO ] [REMOTE ] ANVS: Full fetch complete (36868 records). [2025-10-16T17:15:52.048042] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-16T17:15:52.353211] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:52.569374] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-16T17:15:52.569660] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-16T17:15:52.570697] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-16T17:15:52.570960] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-16T17:15:52.580002] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T17:15:52.584388] [DEBUG] [LOCAL ] ANVS: Trimmed 36868 records to 24112 (keeping 200 days of data) [2025-10-16T17:15:52.746971] [DEBUG] [LOCAL ] ANVS: Primary data saved (24112 records). [2025-10-16T17:15:52.747401] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-16T17:15:52.747081] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-16T17:15:52.748348] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. ANVS took 26.8s. Estimated remaining: 4h 48m 50s. Rate: 7.8 symbols/min [2025-10-16T17:15:52.751309] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:15:52.931316] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:15:52.975521] [DEBUG] [LOCAL ] AOS: Loaded 48761 existing records from primary storage. [2025-10-16T17:15:52.975851] [INFO ] [MAIN ] AOS: Loaded 48761 existing records. [2025-10-16T17:15:53.150484] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:15:53.150723] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-16T17:15:53.150780] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-16T17:15:53.151053] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-16T17:15:53.151093] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-16T17:15:53.503835] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:15:53.542809] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-16T17:15:53.968064] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T17:15:54.342810] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-16T17:15:55.048588] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:15:55.142831] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-16T17:15:55.597329] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:15:55.942810] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-16T17:15:56.621282] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:15:56.742855] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-16T17:15:57.193149] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:15:57.542837] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-16T17:15:57.746878] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:15:58.342823] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-16T17:15:59.008732] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:15:59.142864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-16T17:15:59.305254] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:15:59.942791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-16T17:16:00.125577] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:16:00.742858] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-16T17:16:01.542850] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-16T17:16:01.708352] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T17:16:02.351075] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-16T17:16:02.358439] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:16:02.528010] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:16:03.142850] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-16T17:16:03.942834] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-16T17:16:04.009086] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:16:04.115284] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T17:16:04.742726] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-16T17:16:04.827394] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T17:16:04.829279] [INFO ] [REMOTE ] AOMR: Full fetch complete (23101 records). [2025-10-16T17:16:04.829355] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-16T17:16:04.829865] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:04.829949] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:04.829991] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:04.830029] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-16T17:16:04.830085] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-16T17:16:04.830159] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-16T17:16:04.830369] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-10-16T17:16:04.830455] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOMR took 38.9s. Estimated remaining: 4h 50m 1s. Rate: 7.7 symbols/min [2025-10-16T17:16:04.997701] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:05.007347] [DEBUG] [LOCAL ] AP: Loaded 7352 existing records from primary storage. [2025-10-16T17:16:05.007577] [INFO ] [MAIN ] AP: Loaded 7352 existing records. [2025-10-16T17:16:05.187464] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:05.187757] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-16T17:16:05.187809] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-16T17:16:05.188025] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-16T17:16:05.188081] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-16T17:16:05.537612] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:05.542784] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-16T17:16:06.193582] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:16:06.277731] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T17:16:06.342772] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-16T17:16:07.142837] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-16T17:16:07.785426] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T17:16:07.942818] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-16T17:16:08.742838] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-16T17:16:08.964175] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:16:09.145314] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:16:09.170699] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T17:16:09.542823] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-16T17:16:10.210753] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:16:10.342816] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-16T17:16:10.758344] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:16:11.142802] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-16T17:16:11.756575] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T17:16:11.942826] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-16T17:16:12.742839] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-16T17:16:13.542797] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-16T17:16:13.558237] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:16:13.563695] [INFO ] [REMOTE ] AON: Full fetch complete (64971 records). [2025-10-16T17:16:13.563797] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-16T17:16:13.949840] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-16T17:16:13.949916] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-16T17:16:13.950563] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-16T17:16:13.950604] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-16T17:16:13.951836] [DEBUG] [LOCAL ] AON: Trimmed 64971 records to 45501 (keeping 200 days of data) [2025-10-16T17:16:14.239990] [DEBUG] [LOCAL ] AON: Primary data saved (45501 records). [2025-10-16T17:16:14.240119] [INFO ] [MAIN ] AON: Full history saved. [2025-10-16T17:16:14.240204] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AON took 45.7s. Estimated remaining: 4h 50m 23s. Rate: 7.7 symbols/min [2025-10-16T17:16:14.343940] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-16T17:16:14.420259] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:14.420609] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-16T17:16:14.420729] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-16T17:16:14.421006] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-16T17:16:14.421147] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-16T17:16:14.421230] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-16T17:16:14.421421] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-16T17:16:14.745390] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T17:16:14.839103] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:14.848894] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:16:14.872214] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:16:15.142826] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-16T17:16:15.942851] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-16T17:16:16.668964] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:16:16.748049] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-16T17:16:16.754041] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:16:17.542828] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-16T17:16:18.342763] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-16T17:16:18.509874] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:16:18.583783] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T17:16:19.142835] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-16T17:16:19.584729] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:16:19.942850] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-16T17:16:20.742811] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-16T17:16:20.802968] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T17:16:21.051909] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:16:21.542819] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-16T17:16:21.727165] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T17:16:21.730801] [INFO ] [REMOTE ] AORT: Full fetch complete (42339 records). [2025-10-16T17:16:21.730893] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-16T17:16:22.112395] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-16T17:16:22.112484] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-16T17:16:22.112982] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-16T17:16:22.113078] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-16T17:16:22.114279] [DEBUG] [LOCAL ] AORT: Trimmed 42339 records to 29387 (keeping 200 days of data) [2025-10-16T17:16:22.279637] [DEBUG] [LOCAL ] AORT: Primary data saved (29387 records). [2025-10-16T17:16:22.279793] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-16T17:16:22.279885] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AORT took 30.9s. Estimated remaining: 4h 50m 21s. Rate: 7.7 symbols/min [2025-10-16T17:16:22.347945] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-16T17:16:22.462157] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:22.512538] [DEBUG] [LOCAL ] APD: Loaded 45470 existing records from primary storage. [2025-10-16T17:16:22.512897] [INFO ] [MAIN ] APD: Loaded 45470 existing records. [2025-10-16T17:16:22.726912] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:22.727161] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-16T17:16:22.727213] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-16T17:16:22.727511] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-16T17:16:22.727571] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-16T17:16:23.147341] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-16T17:16:23.168579] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:16:23.229752] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:16:23.310873] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:23.942854] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-16T17:16:24.742881] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-16T17:16:24.773004] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:16:24.804071] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:16:25.542818] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-16T17:16:26.074452] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:16:26.342818] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-16T17:16:27.138975] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:16:27.148062] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-16T17:16:27.714386] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:16:27.942858] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-16T17:16:28.375341] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T17:16:28.742893] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-16T17:16:28.844766] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:16:29.542857] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-16T17:16:30.068311] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:16:30.074611] [INFO ] [REMOTE ] AOS: Full fetch complete (70615 records). [2025-10-16T17:16:30.074818] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-16T17:16:30.075841] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:30.075950] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:30.075995] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:30.076069] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-16T17:16:30.076136] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-16T17:16:30.076175] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-16T17:16:30.076371] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-16T17:16:30.076884] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 37.3s. Estimated remaining: 4h 50m 13s. Rate: 7.7 symbols/min [2025-10-16T17:16:30.279791] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:30.331215] [DEBUG] [LOCAL ] APG: Loaded 50584 existing records from primary storage. [2025-10-16T17:16:30.331542] [INFO ] [MAIN ] APG: Loaded 50584 existing records. [2025-10-16T17:16:30.352214] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-16T17:16:30.513263] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:30.513478] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-16T17:16:30.513525] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-16T17:16:30.513835] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-16T17:16:30.513896] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-16T17:16:30.886448] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:30.987954] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:16:31.142841] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-16T17:16:31.942847] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-16T17:16:32.051773] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:16:32.665476] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:16:32.742840] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-16T17:16:33.385227] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T17:16:33.387079] [INFO ] [REMOTE ] AP: Full fetch complete (9082 records). [2025-10-16T17:16:33.387239] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-16T17:16:33.547327] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-16T17:16:33.767370] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-16T17:16:33.767476] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-16T17:16:33.767769] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-16T17:16:33.767909] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-16T17:16:33.768521] [DEBUG] [LOCAL ] AP: Trimmed 9082 records to 7398 (keeping 200 days of data) [2025-10-16T17:16:33.825075] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:16:33.845824] [DEBUG] [LOCAL ] AP: Primary data saved (7398 records). [2025-10-16T17:16:33.845974] [INFO ] [MAIN ] AP: Full history saved. [2025-10-16T17:16:33.846056] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. AP took 29.0s. Estimated remaining: 4h 48m 56s. Rate: 7.8 symbols/min [2025-10-16T17:16:34.016027] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:34.070240] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-16T17:16:34.070541] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-16T17:16:34.246965] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:34.247174] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-16T17:16:34.247221] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-16T17:16:34.247426] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-16T17:16:34.247483] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-16T17:16:34.347935] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-16T17:16:34.671792] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:34.792438] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:16:35.142845] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-16T17:16:35.942822] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-16T17:16:36.345964] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T17:16:36.380128] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:16:36.742866] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-16T17:16:37.511746] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:16:37.542789] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-16T17:16:38.001861] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:16:38.342787] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-16T17:16:38.900787] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:16:39.142887] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-16T17:16:39.581303] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T17:16:39.942788] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-16T17:16:40.742833] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-16T17:16:41.081301] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:16:41.542792] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-16T17:16:41.671870] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:16:41.752576] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:16:42.342858] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-16T17:16:42.913565] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:16:43.142860] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-16T17:16:43.942801] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-16T17:16:44.040614] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:16:44.672064] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:16:44.742779] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-16T17:16:44.988238] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:16:44.992931] [INFO ] [REMOTE ] APAM: Full fetch complete (51888 records). [2025-10-16T17:16:44.993024] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-16T17:16:44.993680] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:16:44.993763] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:16:44.993806] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:16:44.993844] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-16T17:16:44.993898] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-16T17:16:44.993932] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-16T17:16:44.993970] [DEBUG] [LOCAL ] APAM: No derivative data file found to delete. [2025-10-16T17:16:44.994023] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 30.8s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-16T17:16:45.160606] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:45.160829] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-16T17:16:45.160874] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-16T17:16:45.161011] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-16T17:16:45.161073] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-16T17:16:45.161122] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-16T17:16:45.161157] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-16T17:16:45.525732] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:45.542784] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-16T17:16:46.342786] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-16T17:16:46.576203] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T17:16:47.142789] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-16T17:16:47.413306] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:16:47.877932] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:16:47.942779] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-16T17:16:48.742867] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-16T17:16:49.043056] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-16T17:16:49.542873] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-16T17:16:49.669562] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:16:50.342843] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-16T17:16:50.437162] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:16:51.142808] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-16T17:16:51.640987] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-16T17:16:51.862771] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:16:51.942799] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-16T17:16:52.742727] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-16T17:16:52.931178] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:16:53.230947] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:16:53.542848] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-16T17:16:53.890438] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:16:54.342833] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-16T17:16:55.142842] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-16T17:16:55.349041] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T17:16:55.772194] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:16:55.942780] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-16T17:16:56.748608] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-16T17:16:56.754378] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:16:57.542841] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-16T17:16:57.716179] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:16:58.126034] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T17:16:58.132986] [INFO ] [REMOTE ] APD: Full fetch complete (67334 records). [2025-10-16T17:16:58.133229] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-16T17:16:58.343612] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-16T17:16:58.563394] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-16T17:16:58.563471] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-16T17:16:58.564239] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-16T17:16:58.564304] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-16T17:16:58.565619] [DEBUG] [LOCAL ] APD: Trimmed 67334 records to 45857 (keeping 200 days of data) [2025-10-16T17:16:58.864165] [DEBUG] [LOCAL ] APD: Primary data saved (45857 records). [2025-10-16T17:16:58.864292] [INFO ] [MAIN ] APD: Full history saved. [2025-10-16T17:16:58.864369] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APD took 36.6s. Estimated remaining: 4h 51m 24s. Rate: 7.7 symbols/min [2025-10-16T17:16:59.051119] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:16:59.082863] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:16:59.143307] [DEBUG] [LOCAL ] APO: Loaded 53389 existing records from primary storage. [2025-10-16T17:16:59.143383] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-16T17:16:59.144448] [INFO ] [MAIN ] APO: Loaded 53389 existing records. [2025-10-16T17:16:59.350087] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:16:59.350305] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-16T17:16:59.350354] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-16T17:16:59.350619] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-16T17:16:59.350720] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-16T17:16:59.729438] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:16:59.832197] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:16:59.942768] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-16T17:17:00.742820] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-16T17:17:00.782248] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:17:01.305685] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T17:17:01.542863] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-16T17:17:02.342810] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-16T17:17:02.904195] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-16T17:17:02.932261] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T17:17:02.938719] [INFO ] [REMOTE ] APG: Full fetch complete (72176 records). [2025-10-16T17:17:02.938833] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-16T17:17:03.151962] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-16T17:17:03.324436] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-16T17:17:03.324522] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-16T17:17:03.325237] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-16T17:17:03.325300] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-16T17:17:03.326712] [DEBUG] [LOCAL ] APG: Trimmed 72176 records to 50964 (keeping 200 days of data) [2025-10-16T17:17:03.629939] [DEBUG] [LOCAL ] APG: Primary data saved (50964 records). [2025-10-16T17:17:03.630062] [INFO ] [MAIN ] APG: Full history saved. [2025-10-16T17:17:03.630747] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APG took 33.6s. Estimated remaining: 4h 50m 25s. Rate: 7.7 symbols/min [2025-10-16T17:17:03.805100] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:03.837147] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:17:03.851388] [DEBUG] [LOCAL ] APOS: Loaded 7314 existing records from primary storage. [2025-10-16T17:17:03.851681] [INFO ] [MAIN ] APOS: Loaded 7314 existing records. [2025-10-16T17:17:03.948162] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-16T17:17:04.029340] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:04.029538] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-16T17:17:04.029586] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-16T17:17:04.029779] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-16T17:17:04.029836] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-16T17:17:04.377803] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:04.742871] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-16T17:17:05.307422] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T17:17:05.542788] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-16T17:17:05.955574] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T17:17:06.349454] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-16T17:17:06.369402] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T17:17:06.949963] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:17:07.142798] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-16T17:17:07.942842] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-16T17:17:08.110977] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:17:08.742821] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-16T17:17:09.207215] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T17:17:09.291923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T17:17:09.334436] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:17:09.542877] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-16T17:17:10.342853] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-16T17:17:11.010944] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:17:11.142847] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-16T17:17:11.233073] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:17:11.239975] [INFO ] [REMOTE ] APH: Full fetch complete (77479 records). [2025-10-16T17:17:11.240157] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-16T17:17:11.241104] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:17:11.241206] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:17:11.241249] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:17:11.241289] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-16T17:17:11.241346] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-16T17:17:11.241382] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-10-16T17:17:11.241687] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-10-16T17:17:11.242221] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APH took 37.4s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-16T17:17:11.412891] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:11.413115] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-16T17:17:11.413153] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-16T17:17:11.413271] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-16T17:17:11.413312] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-16T17:17:11.413353] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-16T17:17:11.413385] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-16T17:17:11.776905] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:11.942806] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-16T17:17:12.742807] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-16T17:17:13.001102] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T17:17:13.542804] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-16T17:17:13.675475] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:17:14.232245] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T17:17:14.342830] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-16T17:17:14.519769] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T17:17:15.142888] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-16T17:17:15.942835] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-16T17:17:15.998100] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T17:17:16.171011] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:17:16.178068] [INFO ] [REMOTE ] APLE: Full fetch complete (74728 records). [2025-10-16T17:17:16.178174] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-16T17:17:16.565028] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-16T17:17:16.565107] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-16T17:17:16.565841] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-16T17:17:16.565904] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-16T17:17:16.567238] [DEBUG] [LOCAL ] APLE: Trimmed 74728 records to 52352 (keeping 200 days of data) [2025-10-16T17:17:16.747871] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-16T17:17:16.880535] [DEBUG] [LOCAL ] APLE: Primary data saved (52352 records). [2025-10-16T17:17:16.880699] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-16T17:17:16.880785] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APLE took 31.9s. Estimated remaining: 4h 49m 30s. Rate: 7.7 symbols/min [2025-10-16T17:17:17.045427] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:17.045557] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-16T17:17:17.045593] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-16T17:17:17.045724] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-16T17:17:17.045783] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-16T17:17:17.045869] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-16T17:17:17.045917] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-16T17:17:17.389222] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:17.409984] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:17:17.542873] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-16T17:17:18.191374] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-16T17:17:18.342779] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-16T17:17:19.142792] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-16T17:17:19.209000] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:17:19.942790] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-16T17:17:20.236620] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T17:17:20.652923] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:17:20.742783] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-16T17:17:21.321467] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:17:21.542886] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-16T17:17:21.969789] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:17:22.342826] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-16T17:17:22.923372] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T17:17:23.142773] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-16T17:17:23.252442] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:17:23.942814] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-16T17:17:24.704314] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:17:24.742764] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-16T17:17:25.542918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-16T17:17:25.678417] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:17:26.230187] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:17:26.274517] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:17:26.342812] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-16T17:17:27.142817] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-16T17:17:27.563942] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T17:17:27.942895] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-16T17:17:28.062425] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:17:28.742818] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-16T17:17:29.542832] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-16T17:17:29.864859] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T17:17:30.342812] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-16T17:17:30.519502] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:17:30.834574] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T17:17:31.142850] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-16T17:17:31.890442] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:17:31.942785] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-16T17:17:32.742815] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-16T17:17:32.875957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:17:33.428249] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:17:33.474785] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:17:33.542780] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-16T17:17:34.342792] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-16T17:17:35.142931] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-16T17:17:35.380534] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T17:17:35.942872] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-16T17:17:36.161438] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:17:36.441504] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T17:17:36.613136] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:17:36.742776] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-16T17:17:37.542862] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-16T17:17:38.342800] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-16T17:17:38.532957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:17:38.844495] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:17:39.142867] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-16T17:17:39.942886] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-16T17:17:40.012583] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:17:40.022825] [INFO ] [REMOTE ] APO: Full fetch complete (77464 records). [2025-10-16T17:17:40.023054] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-16T17:17:40.403906] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-16T17:17:40.403981] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-16T17:17:40.404740] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-16T17:17:40.404802] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-16T17:17:40.406163] [DEBUG] [LOCAL ] APO: Trimmed 77464 records to 53779 (keeping 200 days of data) [2025-10-16T17:17:40.753703] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-16T17:17:40.773798] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:17:40.792174] [DEBUG] [LOCAL ] APO: Primary data saved (53779 records). [2025-10-16T17:17:40.793032] [INFO ] [MAIN ] APO: Full history saved. [2025-10-16T17:17:40.793137] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 41.9s. Estimated remaining: 4h 53m 52s. Rate: 7.6 symbols/min [2025-10-16T17:17:40.957787] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:40.965448] [DEBUG] [LOCAL ] AQNB: Loaded 4069 existing records from primary storage. [2025-10-16T17:17:40.965665] [INFO ] [MAIN ] AQNB: Loaded 4069 existing records. [2025-10-16T17:17:41.141249] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:41.141492] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-16T17:17:41.141547] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-16T17:17:41.141737] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-16T17:17:41.141794] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-16T17:17:41.509744] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:41.538484] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:17:41.544032] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-16T17:17:41.546007] [INFO ] [REMOTE ] APTV: Full fetch complete (75563 records). [2025-10-16T17:17:41.546157] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-16T17:17:41.547070] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:17:41.547165] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:17:41.547208] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:17:41.547272] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-16T17:17:41.547335] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-16T17:17:41.547372] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-16T17:17:41.547410] [DEBUG] [LOCAL ] APTV: No derivative data file found to delete. [2025-10-16T17:17:41.547468] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APTV took 30.3s. Estimated remaining: 4h 51m 46s. Rate: 7.7 symbols/min [2025-10-16T17:17:41.719404] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:41.719604] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-16T17:17:41.719661] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-16T17:17:41.719788] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-16T17:17:41.719828] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-16T17:17:41.719869] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-16T17:17:41.719900] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-16T17:17:41.827221] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:17:41.840489] [INFO ] [REMOTE ] APOS: Full fetch complete (10331 records). [2025-10-16T17:17:41.851235] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-16T17:17:42.322503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:17:42.354097] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-16T17:17:42.385083] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:42.507881] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-16T17:17:42.507969] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-16T17:17:42.508193] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-16T17:17:42.508233] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-16T17:17:42.508892] [DEBUG] [LOCAL ] APOS: Trimmed 10331 records to 7359 (keeping 200 days of data) [2025-10-16T17:17:42.556270] [DEBUG] [LOCAL ] APOS: Primary data saved (7359 records). [2025-10-16T17:17:42.556457] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-16T17:17:42.556554] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APOS took 38.9s. Estimated remaining: 4h 49m 46s. Rate: 7.7 symbols/min [2025-10-16T17:17:42.733114] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:42.773371] [DEBUG] [LOCAL ] ARCO: Loaded 44501 existing records from primary storage. [2025-10-16T17:17:42.773705] [INFO ] [MAIN ] ARCO: Loaded 44501 existing records. [2025-10-16T17:17:42.954907] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:42.955202] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-16T17:17:42.955293] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-16T17:17:42.955711] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-16T17:17:42.955776] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-16T17:17:43.148700] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-16T17:17:43.325293] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:43.853955] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:17:43.942787] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-16T17:17:44.632403] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:17:44.742796] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-16T17:17:45.542831] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-16T17:17:45.777212] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T17:17:46.342825] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-16T17:17:46.440741] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:17:46.911815] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:17:47.142828] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-16T17:17:47.771246] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:17:47.778391] [INFO ] [REMOTE ] AQN: Full fetch complete (75386 records). [2025-10-16T17:17:47.778519] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-16T17:17:47.963096] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-16T17:17:48.187212] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-16T17:17:48.187328] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-16T17:17:48.188121] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-16T17:17:48.188190] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-16T17:17:48.189699] [DEBUG] [LOCAL ] AQN: Trimmed 75386 records to 52131 (keeping 200 days of data) [2025-10-16T17:17:48.490973] [DEBUG] [LOCAL ] AQN: Primary data saved (52131 records). [2025-10-16T17:17:48.491146] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-16T17:17:48.491244] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQN took 31.6s. Estimated remaining: 4h 49m 8s. Rate: 7.7 symbols/min [2025-10-16T17:17:48.669815] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:17:48.686704] [DEBUG] [LOCAL ] ARDC: Loaded 15318 existing records from primary storage. [2025-10-16T17:17:48.686932] [INFO ] [MAIN ] ARDC: Loaded 15318 existing records. [2025-10-16T17:17:48.752029] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-16T17:17:48.893430] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T17:17:48.907274] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:17:48.908345] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-16T17:17:48.908404] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-16T17:17:48.908634] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-16T17:17:48.908724] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-16T17:17:49.250319] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:17:49.298110] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T17:17:49.345557] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:17:49.542807] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-16T17:17:49.980031] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:17:50.342814] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-16T17:17:50.916035] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:17:51.142829] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-16T17:17:51.802338] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:17:51.942866] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-16T17:17:52.742836] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-16T17:17:52.815230] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:17:53.279213] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:17:53.542930] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-16T17:17:54.342880] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-16T17:17:54.654071] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:17:55.142841] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-16T17:17:55.942889] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-16T17:17:56.175456] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T17:17:56.615394] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T17:17:56.742834] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-16T17:17:56.951755] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:17:57.542819] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-16T17:17:57.627244] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T17:17:58.342839] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-16T17:17:59.142800] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-16T17:17:59.330178] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:17:59.474971] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:17:59.764461] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T17:17:59.942796] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-16T17:18:00.321363] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T17:18:00.742817] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-16T17:18:01.542848] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-16T17:18:02.236430] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T17:18:02.321421] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:18:02.342774] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-16T17:18:03.142841] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-16T17:18:03.932282] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T17:18:03.942759] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-16T17:18:04.226480] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:18:04.271632] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T17:18:04.742868] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-16T17:18:05.319503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:18:05.320439] [INFO ] [REMOTE ] AQNB: Full fetch complete (5485 records). [2025-10-16T17:18:05.320507] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-16T17:18:05.547914] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-16T17:18:05.695511] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-16T17:18:05.695587] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-16T17:18:05.695768] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-16T17:18:05.695828] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-16T17:18:05.696183] [DEBUG] [LOCAL ] AQNB: Trimmed 5485 records to 4077 (keeping 200 days of data) [2025-10-16T17:18:05.719995] [DEBUG] [LOCAL ] AQNB: Primary data saved (4077 records). [2025-10-16T17:18:05.720058] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-16T17:18:05.720146] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AQNB took 24.9s. Estimated remaining: 4h 51m 33s. Rate: 7.7 symbols/min [2025-10-16T17:18:05.884067] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:05.910393] [DEBUG] [LOCAL ] ARDT: Loaded 27721 existing records from primary storage. [2025-10-16T17:18:05.910663] [INFO ] [MAIN ] ARDT: Loaded 27721 existing records. [2025-10-16T17:18:06.083742] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:06.083940] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-16T17:18:06.083986] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-16T17:18:06.084182] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-16T17:18:06.084237] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-16T17:18:06.348036] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-16T17:18:06.441834] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:06.452968] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:18:07.142875] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-16T17:18:07.942882] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-16T17:18:08.252397] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:18:08.742919] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-16T17:18:08.784725] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-16T17:18:09.542789] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-16T17:18:09.691124] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T17:18:09.746564] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:18:10.342815] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-16T17:18:10.949624] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:18:11.142816] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-16T17:18:11.160873] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:18:11.942784] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-16T17:18:12.742854] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-16T17:18:13.199534] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T17:18:13.225964] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T17:18:13.542815] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-16T17:18:14.257974] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:18:14.342833] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-16T17:18:14.454452] [DEBUG] [REMOTE ] ARCO: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-16T17:18:14.454841] [WARN ] [REMOTE ] ARCO: No data returned for month 2025-07 [2025-10-16T17:18:14.454947] [FATAL] [REMOTE ] ARCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:18:14.455069] [FATAL] [MAIN ] ARCO: Failed to fetch primary data. [2025-10-16T17:18:14.455151] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:18:14.455262] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-16T17:18:14.455360] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-16T17:18:14.455412] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-16T17:18:14.455625] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-16T17:18:14.456278] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. ARCO took 31.9s. Estimated remaining: 4h 51m 39s. Rate: 7.6 symbols/min [2025-10-16T17:18:14.637936] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:14.687447] [DEBUG] [LOCAL ] ARE: Loaded 50973 existing records from primary storage. [2025-10-16T17:18:14.687799] [INFO ] [MAIN ] ARE: Loaded 50973 existing records. [2025-10-16T17:18:14.864716] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:14.864923] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-16T17:18:14.864969] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-16T17:18:14.865295] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-16T17:18:14.865334] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-16T17:18:15.147936] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-16T17:18:15.223626] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:15.772538] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T17:18:15.779832] [INFO ] [REMOTE ] AR: Full fetch complete (77738 records). [2025-10-16T17:18:15.780003] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-16T17:18:15.949956] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-16T17:18:15.971268] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T17:18:16.202946] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-16T17:18:16.203035] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-16T17:18:16.203846] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-16T17:18:16.203915] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-16T17:18:16.205455] [DEBUG] [LOCAL ] AR: Trimmed 77738 records to 53977 (keeping 200 days of data) [2025-10-16T17:18:16.535981] [DEBUG] [LOCAL ] AR: Primary data saved (53977 records). [2025-10-16T17:18:16.536133] [INFO ] [MAIN ] AR: Full history saved. [2025-10-16T17:18:16.536225] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. AR took 35.0s. Estimated remaining: 4h 49m 60s. Rate: 7.7 symbols/min [2025-10-16T17:18:16.705879] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:16.706036] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-16T17:18:16.706116] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-16T17:18:16.706198] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-16T17:18:16.706235] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-16T17:18:16.706289] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-16T17:18:16.706334] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-16T17:18:16.748293] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-16T17:18:17.069973] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:17.483508] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:18:17.542837] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-16T17:18:17.791165] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T17:18:18.342847] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-16T17:18:19.094458] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:18:19.142874] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-16T17:18:19.517190] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:18:19.942874] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-16T17:18:20.748124] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-16T17:18:20.762571] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:18:21.542802] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-16T17:18:21.948314] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:18:22.022463] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:18:22.342830] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-16T17:18:23.073756] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:18:23.142778] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-16T17:18:23.682373] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:18:23.942833] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-16T17:18:24.650855] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:18:24.742777] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-16T17:18:25.029821] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:18:25.542816] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-16T17:18:26.342820] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-16T17:18:26.399981] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:18:26.946073] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T17:18:27.142009] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:18:27.145985] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-16T17:18:27.942812] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-16T17:18:28.742804] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-16T17:18:29.118249] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:18:29.542789] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-16T17:18:29.690283] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:18:29.723810] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:18:30.342780] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-16T17:18:30.499708] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:18:31.142865] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-16T17:18:31.792536] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:18:31.942817] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-16T17:18:32.742884] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-16T17:18:33.083113] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T17:18:33.286250] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:18:33.542820] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-16T17:18:34.005110] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T17:18:34.342815] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-16T17:18:35.142869] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-16T17:18:35.312087] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T17:18:35.372025] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:18:35.942846] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-16T17:18:36.193250] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:18:36.196330] [INFO ] [REMOTE ] ARDC: Full fetch complete (21501 records). [2025-10-16T17:18:36.196452] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-16T17:18:36.563569] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-16T17:18:36.563894] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-16T17:18:36.564225] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-16T17:18:36.564264] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-16T17:18:36.564858] [DEBUG] [LOCAL ] ARDC: Trimmed 21501 records to 15429 (keeping 200 days of data) [2025-10-16T17:18:36.653678] [DEBUG] [LOCAL ] ARDC: Primary data saved (15429 records). [2025-10-16T17:18:36.653809] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-16T17:18:36.653889] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDC took 48.2s. Estimated remaining: 4h 53m 6s. Rate: 7.6 symbols/min [2025-10-16T17:18:36.749410] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-16T17:18:36.823809] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:36.863075] [DEBUG] [LOCAL ] ARI: Loaded 43733 existing records from primary storage. [2025-10-16T17:18:36.863366] [INFO ] [MAIN ] ARI: Loaded 43733 existing records. [2025-10-16T17:18:37.047166] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:18:37.052221] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:37.056786] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-16T17:18:37.057163] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-16T17:18:37.057350] [INFO ] [REMOTE ] ARDT: Full fetch complete (41633 records). [2025-10-16T17:18:37.057427] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-16T17:18:37.057639] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-16T17:18:37.088704] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-16T17:18:37.547794] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-16T17:18:37.800524] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-16T17:18:37.805773] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-16T17:18:37.811468] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-16T17:18:37.816702] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-16T17:18:37.879819] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:37.879994] [DEBUG] [LOCAL ] ARDT: Trimmed 41633 records to 27912 (keeping 200 days of data) [2025-10-16T17:18:38.036982] [DEBUG] [LOCAL ] ARDT: Primary data saved (27912 records). [2025-10-16T17:18:38.037120] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-16T17:18:38.037201] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARDT took 32.3s. Estimated remaining: 4h 51m 16s. Rate: 7.6 symbols/min [2025-10-16T17:18:38.209519] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:38.252897] [DEBUG] [LOCAL ] ARLO: Loaded 43803 existing records from primary storage. [2025-10-16T17:18:38.253221] [INFO ] [MAIN ] ARLO: Loaded 43803 existing records. [2025-10-16T17:18:38.349375] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-16T17:18:38.445135] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:38.445414] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-16T17:18:38.445474] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-16T17:18:38.445755] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-16T17:18:38.445814] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-16T17:18:38.854030] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:38.887801] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-16T17:18:39.008193] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:18:39.142817] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-16T17:18:39.708121] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:18:39.942871] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-16T17:18:40.742829] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-16T17:18:41.097830] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:18:41.542827] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-16T17:18:41.833688] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T17:18:41.909314] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:18:42.342812] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-16T17:18:43.037395] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:18:43.142794] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-16T17:18:43.942858] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-16T17:18:43.997332] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:18:44.609885] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:18:44.616537] [INFO ] [REMOTE ] ARE: Full fetch complete (73003 records). [2025-10-16T17:18:44.616679] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-16T17:18:44.748021] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-16T17:18:45.016032] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-16T17:18:45.016130] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-16T17:18:45.017046] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-16T17:18:45.017122] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-16T17:18:45.018616] [DEBUG] [LOCAL ] ARE: Trimmed 73003 records to 51360 (keeping 200 days of data) [2025-10-16T17:18:45.339234] [DEBUG] [LOCAL ] ARE: Primary data saved (51360 records). [2025-10-16T17:18:45.339361] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-16T17:18:45.340367] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARE took 30.9s. Estimated remaining: 4h 51m 0s. Rate: 7.6 symbols/min [2025-10-16T17:18:45.516188] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:18:45.541955] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:45.550253] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-16T17:18:45.550393] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-16T17:18:45.550474] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-16T17:18:45.552055] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-16T17:18:45.552468] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-16T17:18:45.552674] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-16T17:18:45.552729] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-16T17:18:45.908095] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:46.342780] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-16T17:18:46.585186] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:18:46.591675] [INFO ] [REMOTE ] ARES: Full fetch complete (71085 records). [2025-10-16T17:18:46.591839] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-16T17:18:46.592580] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:18:46.592787] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:18:46.592864] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:18:46.592937] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-16T17:18:46.593028] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-16T17:18:46.593079] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-16T17:18:46.593134] [DEBUG] [LOCAL ] ARES: No derivative data file found to delete. [2025-10-16T17:18:46.593214] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARES took 30.1s. Estimated remaining: 4h 49m 10s. Rate: 7.7 symbols/min [2025-10-16T17:18:46.761149] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:18:46.811601] [DEBUG] [LOCAL ] AROC: Loaded 49062 existing records from primary storage. [2025-10-16T17:18:46.811991] [INFO ] [MAIN ] AROC: Loaded 49062 existing records. [2025-10-16T17:18:47.002538] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:18:47.002939] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-16T17:18:47.003218] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-16T17:18:47.003723] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-16T17:18:47.003792] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-16T17:18:47.146605] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-16T17:18:47.271528] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T17:18:47.402820] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:18:47.755850] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:18:47.942845] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-16T17:18:48.742821] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-16T17:18:48.975045] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:18:49.542819] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-16T17:18:49.644512] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T17:18:49.852518] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T17:18:50.342814] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-16T17:18:50.899874] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T17:18:51.142875] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-16T17:18:51.925012] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:18:51.942771] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-16T17:18:52.544753] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:18:52.742810] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-16T17:18:53.411941] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:18:53.542817] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-16T17:18:53.892013] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:18:54.342881] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-16T17:18:55.010941] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:18:55.142835] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-16T17:18:55.893447] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T17:18:55.942850] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-16T17:18:56.326470] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:18:56.742920] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-16T17:18:57.548085] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-16T17:18:57.571685] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:18:58.342874] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-16T17:18:58.385687] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:18:58.829969] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:18:59.142881] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-16T17:18:59.947926] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-16T17:18:59.977328] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:19:00.743481] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-16T17:19:00.748104] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:19:01.542866] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-16T17:19:01.707492] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:19:02.294336] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:19:02.342941] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-16T17:19:02.800785] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T17:19:03.142825] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-16T17:19:03.942816] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-16T17:19:04.121257] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:19:04.485292] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:19:04.491150] [INFO ] [REMOTE ] ARI: Full fetch complete (62553 records). [2025-10-16T17:19:04.491342] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-16T17:19:04.752509] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-16T17:19:04.891108] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-16T17:19:04.891199] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-16T17:19:04.891873] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-16T17:19:04.891937] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-16T17:19:04.893231] [DEBUG] [LOCAL ] ARI: Trimmed 62553 records to 44048 (keeping 200 days of data) [2025-10-16T17:19:05.154798] [DEBUG] [LOCAL ] ARI: Primary data saved (44048 records). [2025-10-16T17:19:05.154977] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-16T17:19:05.155707] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARI took 28.5s. Estimated remaining: 4h 51m 48s. Rate: 7.6 symbols/min [2025-10-16T17:19:05.323045] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:05.376041] [DEBUG] [LOCAL ] ARR: Loaded 52115 existing records from primary storage. [2025-10-16T17:19:05.376331] [INFO ] [MAIN ] ARR: Loaded 52115 existing records. [2025-10-16T17:19:05.548380] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-16T17:19:05.552589] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:05.553680] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-16T17:19:05.553838] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-16T17:19:05.554108] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-16T17:19:05.554154] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-16T17:19:05.835623] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:19:05.947805] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:06.350911] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-16T17:19:06.356221] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:19:06.971279] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:19:07.142886] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-16T17:19:07.942802] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-16T17:19:08.119841] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:19:08.742870] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-16T17:19:08.811950] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:19:08.817431] [INFO ] [REMOTE ] ARLO: Full fetch complete (62948 records). [2025-10-16T17:19:08.817598] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-16T17:19:08.818496] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:19:08.818590] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:19:08.818680] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:19:08.818757] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-16T17:19:08.818823] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-16T17:19:08.818860] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-16T17:19:08.819041] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-16T17:19:08.819133] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 30.8s. Estimated remaining: 4h 50m 36s. Rate: 7.6 symbols/min [2025-10-16T17:19:08.990713] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:09.023359] [DEBUG] [LOCAL ] ARW: Loaded 33090 existing records from primary storage. [2025-10-16T17:19:09.023666] [INFO ] [MAIN ] ARW: Loaded 33090 existing records. [2025-10-16T17:19:09.197529] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:09.197747] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-16T17:19:09.197798] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-16T17:19:09.197977] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-16T17:19:09.198014] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-16T17:19:09.544167] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-16T17:19:09.548817] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:09.590572] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:19:10.342804] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-16T17:19:10.610568] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T17:19:10.717012] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T17:19:11.142855] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-16T17:19:11.942927] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-16T17:19:12.420301] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T17:19:12.468054] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:19:12.742848] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-16T17:19:13.524494] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T17:19:13.542786] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-16T17:19:14.274675] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:19:14.342783] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-16T17:19:15.142798] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-16T17:19:15.271524] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T17:19:15.761117] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:19:15.942791] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-16T17:19:16.504293] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:19:16.742861] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-16T17:19:17.542950] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-16T17:19:17.933296] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T17:19:17.999823] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:19:18.342851] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-16T17:19:18.946025] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:19:19.142871] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-16T17:19:19.942840] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-16T17:19:20.080762] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:19:20.175372] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T17:19:20.742842] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-16T17:19:21.542847] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-16T17:19:21.932178] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T17:19:21.995957] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T17:19:22.342831] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-16T17:19:22.895944] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:19:23.142814] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-16T17:19:23.501206] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T17:19:23.942851] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-16T17:19:24.722368] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:19:24.742784] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-16T17:19:25.542789] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-16T17:19:25.948024] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T17:19:25.954698] [INFO ] [REMOTE ] ARMK: Full fetch complete (72955 records). [2025-10-16T17:19:25.954841] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-16T17:19:26.337718] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-16T17:19:26.337904] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-16T17:19:26.338910] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-16T17:19:26.339013] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-16T17:19:26.340527] [DEBUG] [LOCAL ] ARMK: Trimmed 72955 records to 50753 (keeping 200 days of data) [2025-10-16T17:19:26.392731] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-16T17:19:26.588394] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T17:19:26.713155] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:19:26.740506] [DEBUG] [LOCAL ] ARMK: Primary data saved (50753 records). [2025-10-16T17:19:26.740671] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-16T17:19:26.740763] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 41.4s. Estimated remaining: 4h 53m 0s. Rate: 7.6 symbols/min [2025-10-16T17:19:26.909072] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:26.909260] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-16T17:19:26.909298] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-16T17:19:26.909434] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-16T17:19:26.909476] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-16T17:19:26.909518] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-16T17:19:26.909551] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-16T17:19:27.149579] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-16T17:19:27.267865] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:27.942777] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-16T17:19:28.122504] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:19:28.133055] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:19:28.133837] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-16T17:19:28.133936] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:19:28.134368] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-16T17:19:28.134437] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:19:28.134509] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-16T17:19:28.134571] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-16T17:19:28.134607] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-16T17:19:28.134671] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-16T17:19:28.134736] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARX took 1.4s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-16T17:19:28.314183] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:28.362619] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-16T17:19:28.362966] [INFO ] [MAIN ] AS: Loaded 53174 existing records. [2025-10-16T17:19:28.560246] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:28.561614] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:19:28.561885] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-16T17:19:28.568421] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-16T17:19:28.568907] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-16T17:19:28.568995] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-16T17:19:28.750850] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-16T17:19:28.914082] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:29.542858] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-16T17:19:30.159543] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:19:30.342796] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-16T17:19:30.996243] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:19:31.142829] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-16T17:19:31.727390] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:19:31.942815] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-16T17:19:32.742786] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-16T17:19:32.804839] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T17:19:32.810909] [INFO ] [REMOTE ] AROC: Full fetch complete (70871 records). [2025-10-16T17:19:32.811027] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-16T17:19:32.811923] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:19:32.812013] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:19:32.812055] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:19:32.812120] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-16T17:19:32.812182] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-16T17:19:32.812219] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-16T17:19:32.812378] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-10-16T17:19:32.812466] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. AROC took 46.2s. Estimated remaining: 4h 50m 19s. Rate: 7.6 symbols/min [2025-10-16T17:19:32.995366] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:33.013423] [DEBUG] [LOCAL ] ASA: Loaded 15215 existing records from primary storage. [2025-10-16T17:19:33.013695] [INFO ] [MAIN ] ASA: Loaded 15215 existing records. [2025-10-16T17:19:33.197979] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:33.198217] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-16T17:19:33.198301] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-16T17:19:33.198501] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-16T17:19:33.198588] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-16T17:19:33.377599] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:19:33.554011] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-16T17:19:33.594180] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:34.342833] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-16T17:19:34.430677] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:19:34.844671] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:19:35.142830] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-16T17:19:35.648069] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:19:35.942802] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-16T17:19:36.742837] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-16T17:19:36.849886] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:19:37.072846] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T17:19:37.077900] [INFO ] [REMOTE ] ARW: Full fetch complete (48439 records). [2025-10-16T17:19:37.078037] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-16T17:19:37.526430] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-16T17:19:37.526503] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-16T17:19:37.527088] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-16T17:19:37.527151] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-16T17:19:37.528135] [DEBUG] [LOCAL ] ARW: Trimmed 48439 records to 33338 (keeping 200 days of data) [2025-10-16T17:19:37.581393] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-16T17:19:37.728139] [DEBUG] [LOCAL ] ARW: Primary data saved (33338 records). [2025-10-16T17:19:37.728270] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-16T17:19:37.728351] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 28.9s. Estimated remaining: 4h 49m 28s. Rate: 7.7 symbols/min [2025-10-16T17:19:37.899019] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:37.948881] [DEBUG] [LOCAL ] ASAN: Loaded 52733 existing records from primary storage. [2025-10-16T17:19:37.949210] [INFO ] [MAIN ] ASAN: Loaded 52733 existing records. [2025-10-16T17:19:38.127072] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:38.127278] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-16T17:19:38.127334] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-16T17:19:38.127743] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-16T17:19:38.127798] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-16T17:19:38.250871] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T17:19:38.343335] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-16T17:19:38.530303] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:38.559722] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:19:39.142796] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-16T17:19:39.191038] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:19:39.942819] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-16T17:19:40.537243] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T17:19:40.655630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:19:40.742866] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-16T17:19:41.542852] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-16T17:19:41.578257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T17:19:42.342829] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-16T17:19:43.142805] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-16T17:19:43.294386] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:19:43.491588] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:19:43.942834] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-16T17:19:44.742818] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-16T17:19:44.795115] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T17:19:44.802205] [INFO ] [REMOTE ] ARR: Full fetch complete (75480 records). [2025-10-16T17:19:44.802388] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-16T17:19:45.198022] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-16T17:19:45.198101] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-16T17:19:45.198936] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-16T17:19:45.199009] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-16T17:19:45.200387] [DEBUG] [LOCAL ] ARR: Trimmed 75480 records to 52502 (keeping 200 days of data) [2025-10-16T17:19:45.453747] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:19:45.552562] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-16T17:19:45.567530] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:19:45.590301] [DEBUG] [LOCAL ] ARR: Primary data saved (52502 records). [2025-10-16T17:19:45.590417] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-16T17:19:45.591296] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARR took 40.4s. Estimated remaining: 4h 49m 21s. Rate: 7.7 symbols/min [2025-10-16T17:19:45.758006] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:19:45.804149] [DEBUG] [LOCAL ] ASB: Loaded 49632 existing records from primary storage. [2025-10-16T17:19:45.804445] [INFO ] [MAIN ] ASB: Loaded 49632 existing records. [2025-10-16T17:19:45.980178] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:19:45.980374] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-16T17:19:45.980422] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-16T17:19:45.980700] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-16T17:19:45.980758] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-16T17:19:46.341358] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:19:46.342766] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-16T17:19:47.142851] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-16T17:19:47.452270] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T17:19:47.786278] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:19:47.896636] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T17:19:47.942785] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-16T17:19:48.742826] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-16T17:19:49.000625] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T17:19:49.542843] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-16T17:19:50.342807] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-16T17:19:50.383502] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:19:51.113489] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:19:51.142801] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-16T17:19:51.942814] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-16T17:19:52.290399] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T17:19:52.335764] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:19:52.742902] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-16T17:19:53.187497] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T17:19:53.542881] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-16T17:19:54.300888] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:19:54.342781] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-16T17:19:55.148000] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-16T17:19:55.171637] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:19:55.671564] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:19:55.942791] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-16T17:19:56.122172] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:19:56.742851] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-16T17:19:57.542837] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-16T17:19:57.717489] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T17:19:58.342850] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-16T17:19:58.377431] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:19:58.607213] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T17:19:59.142884] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-16T17:19:59.942781] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-16T17:20:00.074367] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T17:20:00.730668] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:20:00.742770] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-16T17:20:01.542870] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-16T17:20:01.587707] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:20:01.592989] [INFO ] [REMOTE ] ASA: Full fetch complete (20237 records). [2025-10-16T17:20:01.593165] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-16T17:20:01.997883] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-16T17:20:01.998029] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-16T17:20:01.998517] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-16T17:20:01.998591] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-16T17:20:01.999785] [DEBUG] [LOCAL ] ASA: Trimmed 20237 records to 15405 (keeping 200 days of data) [2025-10-16T17:20:02.115122] [DEBUG] [LOCAL ] ASA: Primary data saved (15405 records). [2025-10-16T17:20:02.115308] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-16T17:20:02.115424] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ASA took 29.3s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-16T17:20:02.311271] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:02.355174] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-16T17:20:02.358040] [DEBUG] [LOCAL ] ASBA: Loaded 3459 existing records from primary storage. [2025-10-16T17:20:02.362934] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:20:02.363365] [INFO ] [MAIN ] ASBA: Loaded 3459 existing records. [2025-10-16T17:20:02.567715] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:02.568004] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-16T17:20:02.568054] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-16T17:20:02.568180] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-16T17:20:02.568220] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-16T17:20:02.928616] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:03.039805] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T17:20:03.142862] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-16T17:20:03.682830] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T17:20:03.942829] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-16T17:20:04.205290] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T17:20:04.742837] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-16T17:20:05.542873] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-16T17:20:05.988377] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T17:20:06.342794] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-16T17:20:06.582438] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:20:06.760590] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T17:20:07.142835] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-16T17:20:07.942788] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-16T17:20:08.166469] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:20:08.173768] [INFO ] [REMOTE ] ASAN: Full fetch complete (76647 records). [2025-10-16T17:20:08.173950] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-16T17:20:08.588613] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-16T17:20:08.588843] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-16T17:20:08.589774] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-16T17:20:08.589856] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-16T17:20:08.591406] [DEBUG] [LOCAL ] ASAN: Trimmed 76647 records to 53123 (keeping 200 days of data) [2025-10-16T17:20:08.718142] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T17:20:08.742994] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-16T17:20:08.951760] [DEBUG] [LOCAL ] ASAN: Primary data saved (53123 records). [2025-10-16T17:20:08.951920] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-16T17:20:08.952003] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASAN took 31.2s. Estimated remaining: 4h 50m 57s. Rate: 7.6 symbols/min [2025-10-16T17:20:09.137488] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:09.172679] [DEBUG] [LOCAL ] ASC: Loaded 37348 existing records from primary storage. [2025-10-16T17:20:09.172989] [INFO ] [MAIN ] ASC: Loaded 37348 existing records. [2025-10-16T17:20:09.392570] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:09.393342] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-16T17:20:09.393454] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-16T17:20:09.394018] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-16T17:20:09.394078] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-16T17:20:09.552829] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-16T17:20:09.728135] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:20:09.869905] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:10.131078] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:20:10.222858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:20:10.342961] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-16T17:20:11.142914] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-16T17:20:11.693918] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:20:11.797407] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T17:20:11.942884] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-16T17:20:12.474909] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:20:12.742892] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-16T17:20:13.317186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:20:13.542896] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-16T17:20:14.236254] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:20:14.342865] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-16T17:20:14.683105] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T17:20:15.142883] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-16T17:20:15.942866] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-16T17:20:16.742852] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-16T17:20:17.542796] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-16T17:20:17.884338] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T17:20:17.894017] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T17:20:17.896383] [INFO ] [REMOTE ] AS: Full fetch complete (76875 records). [2025-10-16T17:20:17.896478] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-16T17:20:18.287437] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-16T17:20:18.287561] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-16T17:20:18.288517] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-16T17:20:18.288585] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-16T17:20:18.290380] [DEBUG] [LOCAL ] AS: Trimmed 76875 records to 53564 (keeping 200 days of data) [2025-10-16T17:20:18.343619] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-16T17:20:18.630099] [DEBUG] [LOCAL ] AS: Primary data saved (53564 records). [2025-10-16T17:20:18.630377] [INFO ] [MAIN ] AS: Full history saved. [2025-10-16T17:20:18.631091] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. AS took 50.5s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-16T17:20:18.813853] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:18.835847] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T17:20:18.846419] [DEBUG] [LOCAL ] ASG: Loaded 19561 existing records from primary storage. [2025-10-16T17:20:18.847268] [INFO ] [MAIN ] ASG: Loaded 19561 existing records. [2025-10-16T17:20:18.986168] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (3.84 seconds). [2025-10-16T17:20:19.107045] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:19.107350] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-16T17:20:19.107422] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-16T17:20:19.107847] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-16T17:20:19.107974] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-16T17:20:19.148053] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-16T17:20:19.261392] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-16T17:20:19.521469] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:19.630925] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T17:20:19.942882] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-16T17:20:20.510835] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T17:20:20.511895] [INFO ] [REMOTE ] ASBA: Full fetch complete (5218 records). [2025-10-16T17:20:20.511973] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-16T17:20:20.748813] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-16T17:20:20.878410] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-16T17:20:20.878478] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-16T17:20:20.878630] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-16T17:20:20.878707] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-16T17:20:20.879155] [DEBUG] [LOCAL ] ASBA: Trimmed 5218 records to 3483 (keeping 200 days of data) [2025-10-16T17:20:20.899743] [DEBUG] [LOCAL ] ASBA: Primary data saved (3483 records). [2025-10-16T17:20:20.899830] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-16T17:20:20.899905] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASBA took 18.8s. Estimated remaining: 4h 49m 47s. Rate: 7.6 symbols/min [2025-10-16T17:20:21.076682] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:21.100629] [DEBUG] [LOCAL ] ASGI: Loaded 22951 existing records from primary storage. [2025-10-16T17:20:21.100918] [INFO ] [MAIN ] ASGI: Loaded 22951 existing records. [2025-10-16T17:20:21.278460] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:21.278776] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-16T17:20:21.278829] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-16T17:20:21.279015] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-16T17:20:21.279070] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-16T17:20:21.551270] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-16T17:20:21.633172] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:22.300454] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:20:22.342816] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-16T17:20:23.142842] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-16T17:20:23.482959] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T17:20:23.504734] [INFO ] [REMOTE ] ASB: Full fetch complete (72117 records). [2025-10-16T17:20:23.505530] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-16T17:20:23.506069] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T17:20:23.905437] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-16T17:20:23.905513] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-16T17:20:23.906257] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-16T17:20:23.906319] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-16T17:20:23.907633] [DEBUG] [LOCAL ] ASB: Trimmed 72117 records to 50019 (keeping 200 days of data) [2025-10-16T17:20:23.959808] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-16T17:20:24.155316] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T17:20:24.232508] [DEBUG] [LOCAL ] ASB: Primary data saved (50019 records). [2025-10-16T17:20:24.232809] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-16T17:20:24.233443] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASB took 38.6s. Estimated remaining: 4h 48m 35s. Rate: 7.7 symbols/min [2025-10-16T17:20:24.399760] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:24.435250] [DEBUG] [LOCAL ] ASGN: Loaded 36578 existing records from primary storage. [2025-10-16T17:20:24.435547] [INFO ] [MAIN ] ASGN: Loaded 36578 existing records. [2025-10-16T17:20:24.608978] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:24.609200] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-16T17:20:24.609246] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-16T17:20:24.609516] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-16T17:20:24.609572] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-16T17:20:24.748111] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-16T17:20:24.965392] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:20:25.536593] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:20:25.545598] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-16T17:20:26.025189] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T17:20:26.342859] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-16T17:20:26.811395] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:20:26.986741] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:20:27.142832] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-16T17:20:27.942880] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-16T17:20:28.150977] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:20:28.742848] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-16T17:20:29.542819] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-16T17:20:29.675528] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:20:29.725016] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T17:20:30.342812] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-16T17:20:30.887834] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:20:31.142809] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-16T17:20:31.596571] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:20:31.850495] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T17:20:31.942805] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-16T17:20:32.742806] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-16T17:20:33.460227] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:20:33.542835] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-16T17:20:34.201313] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:20:34.342794] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-16T17:20:34.599609] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:20:35.142784] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-16T17:20:35.214513] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T17:20:35.942863] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-16T17:20:36.554935] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:20:36.742821] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-16T17:20:37.030167] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:20:37.542790] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-16T17:20:37.562922] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T17:20:38.342807] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-16T17:20:38.928052] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:20:38.989797] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:20:39.142819] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-16T17:20:39.942787] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-16T17:20:40.264269] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:20:40.742812] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-16T17:20:41.542803] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-16T17:20:41.578351] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:20:41.857910] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:20:42.342794] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-16T17:20:42.558303] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:20:43.142818] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-16T17:20:43.757446] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T17:20:43.942850] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-16T17:20:44.468317] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:20:44.540681] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T17:20:44.742826] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-16T17:20:45.542828] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-16T17:20:45.720264] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T17:20:46.342786] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-16T17:20:46.843345] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:20:47.096964] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:20:47.142833] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-16T17:20:47.942817] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-16T17:20:48.696301] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:20:48.742775] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-16T17:20:49.359119] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:20:49.364206] [INFO ] [REMOTE ] ASC: Full fetch complete (56216 records). [2025-10-16T17:20:49.364347] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-16T17:20:49.552974] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-16T17:20:49.755148] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-16T17:20:49.755306] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-16T17:20:49.756125] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-16T17:20:49.756229] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-16T17:20:49.775620] [DEBUG] [LOCAL ] ASC: Trimmed 56216 records to 37642 (keeping 200 days of data) [2025-10-16T17:20:49.776603] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:20:50.008278] [DEBUG] [LOCAL ] ASC: Primary data saved (37642 records). [2025-10-16T17:20:50.008425] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-16T17:20:50.008505] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 41.1s. Estimated remaining: 4h 52m 40s. Rate: 7.6 symbols/min [2025-10-16T17:20:50.342834] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-16T17:20:50.698840] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T17:20:50.701749] [INFO ] [REMOTE ] ASG: Full fetch complete (31008 records). [2025-10-16T17:20:50.701878] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-16T17:20:51.066464] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-16T17:20:51.066535] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-16T17:20:51.066953] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-16T17:20:51.067014] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-16T17:20:51.067723] [DEBUG] [LOCAL ] ASG: Trimmed 31008 records to 19723 (keeping 200 days of data) [2025-10-16T17:20:51.145002] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-16T17:20:51.178592] [DEBUG] [LOCAL ] ASG: Primary data saved (19723 records). [2025-10-16T17:20:51.178746] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-16T17:20:51.178834] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 32.5s. Estimated remaining: 4h 50m 57s. Rate: 7.6 symbols/min [2025-10-16T17:20:51.568222] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:20:51.942827] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-16T17:20:52.451822] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:20:52.742806] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-16T17:20:53.097995] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:20:53.542875] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-16T17:20:53.957373] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:20:53.960989] [INFO ] [REMOTE ] ASGI: Full fetch complete (33339 records). [2025-10-16T17:20:53.961099] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-16T17:20:54.344476] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-16T17:20:54.344560] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-16T17:20:54.345006] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-16T17:20:54.345069] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-16T17:20:54.345989] [DEBUG] [LOCAL ] ASGI: Trimmed 33339 records to 23140 (keeping 200 days of data) [2025-10-16T17:20:54.485848] [DEBUG] [LOCAL ] ASGI: Primary data saved (23140 records). [2025-10-16T17:20:54.485977] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-16T17:20:54.486059] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGI took 33.6s. Estimated remaining: 4h 49m 45s. Rate: 7.6 symbols/min [2025-10-16T17:20:55.014152] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:20:55.022614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-16T17:20:56.399890] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:20:56.408604] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-16T17:20:57.944712] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:20:57.950845] [INFO ] [REMOTE ] ASGN: Full fetch complete (53291 records). [2025-10-16T17:20:57.950979] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-16T17:20:58.334007] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-16T17:20:58.334090] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-16T17:20:58.334702] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-16T17:20:58.334766] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-16T17:20:58.336143] [DEBUG] [LOCAL ] ASGN: Trimmed 53291 records to 36906 (keeping 200 days of data) [2025-10-16T17:20:58.551496] [DEBUG] [LOCAL ] ASGN: Primary data saved (36906 records). [2025-10-16T17:20:58.551667] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-16T17:20:58.552270] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGN took 34.3s. Estimated remaining: 4h 48m 45s. Rate: 7.7 symbols/min [2025-10-16T17:20:59.237988] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.233264] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.277573] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.306281] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:20:59.317503] [DEBUG] [LOCAL ] ASR: Loaded 9379 existing records from primary storage. [2025-10-16T17:20:59.317808] [INFO ] [MAIN ] ASR: Loaded 9379 existing records. [2025-10-16T17:20:59.538699] [DEBUG] [LOCAL ] ASIX: Loaded 23077 existing records from primary storage. [2025-10-16T17:20:59.599444] [INFO ] [MAIN ] ASIX: Loaded 23077 existing records. [2025-10-16T17:20:59.600132] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-16T17:20:59.631271] [INFO ] [MAIN ] ASH: Loaded 37552 existing records. [2025-10-16T17:20:59.605576] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:20:59.666802] [DEBUG] [LOCAL ] ASPN: Loaded 49893 existing records from primary storage. [2025-10-16T17:20:59.666058] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-16T17:20:59.678722] [INFO ] [MAIN ] ASPN: Loaded 49893 existing records. [2025-10-16T17:20:59.702769] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-16T17:20:59.739461] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-16T17:20:59.830903] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-16T17:21:00.249550] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.252477] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.307183] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.327852] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-16T17:21:00.328180] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.353167] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-16T17:21:00.359120] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-16T17:21:00.347870] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-16T17:21:00.403262] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:00.424119] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-16T17:21:00.430884] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-16T17:21:00.466107] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-16T17:21:00.481718] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-16T17:21:00.482039] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-16T17:21:00.495480] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-16T17:21:01.373384] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.415935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-16T17:21:01.785888] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.844190] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-16T17:21:01.941072] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:01.956098] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-16T17:21:02.002271] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:02.002747] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-16T17:21:02.626591] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T17:21:02.636147] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-16T17:21:02.762737] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:21:02.768600] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-16T17:21:03.170529] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T17:21:03.173864] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-16T17:21:03.386687] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:21:03.397629] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-16T17:21:03.490949] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T17:21:03.495458] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-16T17:21:03.498086] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:21:03.508585] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-16T17:21:03.619484] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:21:03.942838] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-16T17:21:04.135458] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:21:04.527424] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T17:21:04.742884] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-16T17:21:04.803784] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:21:05.098047] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:21:05.542841] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-16T17:21:05.734738] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T17:21:06.342861] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-16T17:21:06.354607] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T17:21:07.142818] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-16T17:21:07.408821] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T17:21:07.942837] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-16T17:21:07.956267] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T17:21:08.742835] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-16T17:21:09.057943] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:21:09.526075] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:21:09.542765] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-16T17:21:10.342803] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-16T17:21:10.351450] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T17:21:11.142797] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-16T17:21:11.262311] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T17:21:11.589444] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:21:11.942786] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-16T17:21:12.742871] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-16T17:21:13.445156] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:21:13.542781] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-16T17:21:14.342844] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-16T17:21:14.411024] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T17:21:14.495047] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:21:15.142841] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-16T17:21:15.427855] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:21:15.942871] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-16T17:21:16.737254] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:21:16.737932] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:21:16.748747] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-16T17:21:16.750577] [INFO ] [REMOTE ] ASR: Full fetch complete (12389 records). [2025-10-16T17:21:16.751500] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-16T17:21:17.102531] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-16T17:21:17.102601] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-16T17:21:17.102830] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-16T17:21:17.102890] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-16T17:21:17.103318] [DEBUG] [LOCAL ] ASR: Trimmed 12389 records to 9418 (keeping 200 days of data) [2025-10-16T17:21:17.160380] [DEBUG] [LOCAL ] ASR: Primary data saved (9418 records). [2025-10-16T17:21:17.160492] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-16T17:21:17.160565] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASR took 18.6s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-16T17:21:17.325723] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:17.375725] [DEBUG] [LOCAL ] ASX: Loaded 52874 existing records from primary storage. [2025-10-16T17:21:17.376029] [INFO ] [MAIN ] ASX: Loaded 52874 existing records. [2025-10-16T17:21:17.551408] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-16T17:21:17.556004] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:17.556954] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-16T17:21:17.557008] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-16T17:21:17.557185] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-16T17:21:17.557222] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-16T17:21:17.904504] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:17.922723] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T17:21:18.342817] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-16T17:21:19.051500] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:21:19.142791] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-16T17:21:19.942790] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-16T17:21:20.404002] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T17:21:20.633298] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:21:20.742798] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-16T17:21:20.966720] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:21:21.542812] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-16T17:21:22.348002] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-16T17:21:22.353638] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:21:23.142793] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-16T17:21:23.301796] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T17:21:23.361356] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:21:23.942830] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-16T17:21:24.370815] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T17:21:24.742835] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-16T17:21:25.542866] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-16T17:21:25.625480] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:21:25.969057] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T17:21:26.342872] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-16T17:21:27.142793] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-16T17:21:27.326109] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T17:21:27.549845] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:21:27.553463] [INFO ] [REMOTE ] ASIX: Full fetch complete (30964 records). [2025-10-16T17:21:27.553557] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-16T17:21:27.914111] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-16T17:21:27.914199] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-16T17:21:27.914600] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-16T17:21:27.914639] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-16T17:21:27.915424] [DEBUG] [LOCAL ] ASIX: Trimmed 30964 records to 23274 (keeping 200 days of data) [2025-10-16T17:21:27.965702] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-16T17:21:28.055510] [DEBUG] [LOCAL ] ASIX: Primary data saved (23274 records). [2025-10-16T17:21:28.055634] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-16T17:21:28.055747] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 29.5s. Estimated remaining: 4h 51m 38s. Rate: 7.6 symbols/min [2025-10-16T17:21:28.232366] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:28.268998] [DEBUG] [LOCAL ] ATEN: Loaded 38334 existing records from primary storage. [2025-10-16T17:21:28.269300] [INFO ] [MAIN ] ATEN: Loaded 38334 existing records. [2025-10-16T17:21:28.451136] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:28.451372] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-16T17:21:28.451419] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-16T17:21:28.451608] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-16T17:21:28.451706] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-16T17:21:28.743915] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-16T17:21:28.824953] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:28.953726] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T17:21:29.472792] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:21:29.542784] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-16T17:21:29.837954] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:21:30.342809] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-16T17:21:30.990585] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:21:31.142807] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-16T17:21:31.942795] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-16T17:21:32.273822] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T17:21:32.633392] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:21:32.742784] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-16T17:21:33.531127] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:21:33.542757] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-16T17:21:34.226155] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:21:34.342810] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-16T17:21:34.448768] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:21:35.142865] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-16T17:21:35.942869] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-16T17:21:36.113979] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T17:21:36.616891] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:21:36.742824] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-16T17:21:37.496053] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:21:37.542786] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-16T17:21:38.342864] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-16T17:21:38.403859] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:21:39.002215] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:21:39.142801] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-16T17:21:39.942875] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-16T17:21:40.224109] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:21:40.231402] [INFO ] [REMOTE ] ASPN: Full fetch complete (72651 records). [2025-10-16T17:21:40.231555] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-16T17:21:40.521555] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:21:40.653969] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-16T17:21:40.654045] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-16T17:21:40.654837] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-16T17:21:40.654899] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-16T17:21:40.656264] [DEBUG] [LOCAL ] ASPN: Trimmed 72651 records to 50279 (keeping 200 days of data) [2025-10-16T17:21:40.744925] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-16T17:21:40.938979] [DEBUG] [LOCAL ] ASPN: Primary data saved (50279 records). [2025-10-16T17:21:40.939116] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-16T17:21:40.939194] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASPN took 42.4s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-16T17:21:41.108761] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:41.140071] [DEBUG] [LOCAL ] ATGE: Loaded 31064 existing records from primary storage. [2025-10-16T17:21:41.140331] [INFO ] [MAIN ] ATGE: Loaded 31064 existing records. [2025-10-16T17:21:41.319017] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:41.319322] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-16T17:21:41.319385] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-16T17:21:41.327856] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-16T17:21:41.343054] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:21:41.342244] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-16T17:21:41.547899] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-16T17:21:41.706769] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:42.006408] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:21:42.342801] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-16T17:21:43.139306] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:21:43.149196] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-16T17:21:43.246911] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:21:43.942821] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-16T17:21:44.672175] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T17:21:44.677534] [INFO ] [REMOTE ] ASH: Full fetch complete (55583 records). [2025-10-16T17:21:44.677718] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-16T17:21:44.748050] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-16T17:21:45.070280] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-16T17:21:45.070394] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-16T17:21:45.071048] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-16T17:21:45.071112] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-16T17:21:45.072370] [DEBUG] [LOCAL ] ASH: Trimmed 55583 records to 37839 (keeping 200 days of data) [2025-10-16T17:21:45.301257] [DEBUG] [LOCAL ] ASH: Primary data saved (37839 records). [2025-10-16T17:21:45.301388] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-16T17:21:45.301467] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASH took 46.7s. Estimated remaining: 4h 51m 40s. Rate: 7.6 symbols/min [2025-10-16T17:21:45.472914] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:45.502054] [DEBUG] [LOCAL ] ATHM: Loaded 31512 existing records from primary storage. [2025-10-16T17:21:45.502335] [INFO ] [MAIN ] ATHM: Loaded 31512 existing records. [2025-10-16T17:21:45.556203] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-16T17:21:45.685551] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:45.685870] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-16T17:21:45.685953] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-16T17:21:45.686382] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-16T17:21:45.686464] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-16T17:21:45.819391] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T17:21:46.102377] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:46.120542] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:21:46.342816] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-16T17:21:47.142857] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-16T17:21:47.573371] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-16T17:21:47.942912] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-16T17:21:48.152022] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T17:21:48.159020] [INFO ] [REMOTE ] ASX: Full fetch complete (76779 records). [2025-10-16T17:21:48.159197] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-16T17:21:48.569344] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-16T17:21:48.569447] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-16T17:21:48.570240] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-16T17:21:48.570303] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-16T17:21:48.571742] [DEBUG] [LOCAL ] ASX: Trimmed 76779 records to 53264 (keeping 200 days of data) [2025-10-16T17:21:48.746891] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-16T17:21:48.886376] [DEBUG] [LOCAL ] ASX: Primary data saved (53264 records). [2025-10-16T17:21:48.886503] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-16T17:21:48.886580] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ASX took 31.7s. Estimated remaining: 4h 50m 34s. Rate: 7.6 symbols/min [2025-10-16T17:21:49.072155] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:49.089852] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:21:49.119016] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T17:21:49.132790] [DEBUG] [LOCAL ] ATHS: Loaded 6640 existing records from primary storage. [2025-10-16T17:21:49.133027] [INFO ] [MAIN ] ATHS: Loaded 6640 existing records. [2025-10-16T17:21:49.314173] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:21:49.314414] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-16T17:21:49.314473] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-16T17:21:49.314637] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-16T17:21:49.314732] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-16T17:21:49.555752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-16T17:21:49.701534] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:50.229840] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:21:50.342785] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-16T17:21:50.730781] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:21:51.142877] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-16T17:21:51.942854] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-16T17:21:52.014139] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T17:21:52.666674] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:21:52.694188] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:21:52.742827] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-16T17:21:53.542848] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-16T17:21:54.141309] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:21:54.342833] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-16T17:21:55.093225] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:21:55.142896] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-16T17:21:55.829933] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T17:21:55.942879] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-16T17:21:56.074113] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:21:56.078778] [INFO ] [REMOTE ] ATEN: Full fetch complete (56912 records). [2025-10-16T17:21:56.078997] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-16T17:21:56.461239] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-16T17:21:56.461315] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-16T17:21:56.461962] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-16T17:21:56.462025] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-16T17:21:56.463100] [DEBUG] [LOCAL ] ATEN: Trimmed 56912 records to 38592 (keeping 200 days of data) [2025-10-16T17:21:56.570381] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:21:56.700059] [DEBUG] [LOCAL ] ATEN: Primary data saved (38592 records). [2025-10-16T17:21:56.700187] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-16T17:21:56.700583] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ATEN took 28.6s. Estimated remaining: 4h 50m 25s. Rate: 7.6 symbols/min [2025-10-16T17:21:56.752259] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-16T17:21:56.872524] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:21:56.872709] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-16T17:21:56.872762] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-16T17:21:56.872868] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-16T17:21:56.872909] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-16T17:21:56.872949] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-16T17:21:56.872981] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-16T17:21:57.213353] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:21:57.542878] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-16T17:21:58.155485] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:21:58.342858] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-16T17:21:59.142797] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-16T17:21:59.303599] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:21:59.871505] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T17:21:59.942800] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-16T17:22:00.742803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-16T17:22:01.122763] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T17:22:01.286790] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:22:01.542878] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-16T17:22:02.037484] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:22:02.036277] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:22:02.342824] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-16T17:22:02.970184] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:22:03.142819] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-16T17:22:03.942868] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-16T17:22:04.585430] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:22:04.742803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-16T17:22:05.315997] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:22:05.542871] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-16T17:22:06.022984] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T17:22:06.201451] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:22:06.342793] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-16T17:22:07.142892] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-16T17:22:07.791908] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:22:07.942796] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-16T17:22:08.742815] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-16T17:22:08.892003] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:22:08.890355] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:22:09.542836] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-16T17:22:09.609034] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:22:09.959804] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T17:22:10.342823] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-16T17:22:11.142831] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-16T17:22:11.952302] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-16T17:22:11.979166] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:22:12.007964] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T17:22:12.742834] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-16T17:22:13.347142] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:22:13.542904] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-16T17:22:14.342790] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-16T17:22:14.476708] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T17:22:14.810713] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T17:22:15.142849] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-16T17:22:15.486267] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:22:15.942893] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-16T17:22:16.742916] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-16T17:22:16.901942] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:22:17.285012] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T17:22:17.294749] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:22:17.294421] [INFO ] [REMOTE ] ATGE: Full fetch complete (46044 records). [2025-10-16T17:22:17.297347] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-16T17:22:17.551433] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-16T17:22:17.682940] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-16T17:22:17.683028] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-16T17:22:17.683553] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-16T17:22:17.683596] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-16T17:22:17.684700] [DEBUG] [LOCAL ] ATGE: Trimmed 46044 records to 31229 (keeping 200 days of data) [2025-10-16T17:22:17.893509] [DEBUG] [LOCAL ] ATGE: Primary data saved (31229 records). [2025-10-16T17:22:17.893692] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-16T17:22:17.893788] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 37.0s. Estimated remaining: 4h 53m 12s. Rate: 7.5 symbols/min [2025-10-16T17:22:18.066508] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:18.072514] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T17:22:18.106145] [DEBUG] [LOCAL ] ATKR: Loaded 35206 existing records from primary storage. [2025-10-16T17:22:18.106411] [INFO ] [MAIN ] ATKR: Loaded 35206 existing records. [2025-10-16T17:22:18.284532] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:18.284841] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-16T17:22:18.284893] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-16T17:22:18.285133] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-16T17:22:18.285199] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-16T17:22:18.347950] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-16T17:22:18.647350] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:19.142845] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-16T17:22:19.464216] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T17:22:19.942801] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-16T17:22:20.519527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T17:22:20.734089] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:22:20.742768] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-16T17:22:21.542849] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-16T17:22:21.844811] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:22:22.342883] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-16T17:22:23.142879] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-16T17:22:23.368171] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:22:23.942792] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-16T17:22:23.991279] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:22:24.200179] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:22:24.204476] [INFO ] [REMOTE ] ATHM: Full fetch complete (50010 records). [2025-10-16T17:22:24.204600] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-16T17:22:24.602189] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-16T17:22:24.602310] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-16T17:22:24.603014] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-16T17:22:24.603086] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-16T17:22:24.604782] [DEBUG] [LOCAL ] ATHM: Trimmed 50010 records to 31712 (keeping 200 days of data) [2025-10-16T17:22:24.760477] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-16T17:22:24.812547] [DEBUG] [LOCAL ] ATHM: Primary data saved (31712 records). [2025-10-16T17:22:24.812798] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-16T17:22:24.812912] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 39.5s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-16T17:22:24.991012] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:24.991187] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-16T17:22:24.991227] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-16T17:22:24.991339] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-16T17:22:24.991381] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-16T17:22:24.991423] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-16T17:22:24.991457] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-16T17:22:25.360876] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:25.410441] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T17:22:25.463249] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:22:25.464913] [INFO ] [REMOTE ] ATHS: Full fetch complete (9621 records). [2025-10-16T17:22:25.465007] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-16T17:22:25.547969] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-16T17:22:25.840110] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-16T17:22:25.840193] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-16T17:22:25.840439] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-16T17:22:25.840478] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-16T17:22:25.840957] [DEBUG] [LOCAL ] ATHS: Trimmed 9621 records to 6668 (keeping 200 days of data) [2025-10-16T17:22:25.881603] [DEBUG] [LOCAL ] ATHS: Primary data saved (6668 records). [2025-10-16T17:22:25.881779] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-16T17:22:25.881865] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 37.0s. Estimated remaining: 4h 51m 12s. Rate: 7.6 symbols/min [2025-10-16T17:22:26.050554] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:26.091332] [DEBUG] [LOCAL ] ATO: Loaded 41759 existing records from primary storage. [2025-10-16T17:22:26.091610] [INFO ] [MAIN ] ATO: Loaded 41759 existing records. [2025-10-16T17:22:26.264024] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:26.264234] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-16T17:22:26.264280] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-16T17:22:26.264489] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-16T17:22:26.264527] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-16T17:22:26.351585] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-16T17:22:26.613298] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:27.087899] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:22:27.142771] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-16T17:22:27.949669] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-16T17:22:27.967562] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T17:22:28.192459] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:22:28.742869] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-16T17:22:29.542876] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-16T17:22:29.599355] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:22:29.932875] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:22:30.342804] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-16T17:22:30.952821] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:22:31.142872] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-16T17:22:31.799763] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:22:31.942822] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-16T17:22:32.639359] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:22:32.742815] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-16T17:22:32.893121] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:22:33.542793] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-16T17:22:33.904309] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T17:22:34.342884] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-16T17:22:34.950669] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:22:35.142809] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-16T17:22:35.778520] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:22:35.785035] [INFO ] [REMOTE ] ATI: Full fetch complete (74011 records). [2025-10-16T17:22:35.785161] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-16T17:22:35.971302] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-16T17:22:36.195751] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-16T17:22:36.195890] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-16T17:22:36.196749] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-16T17:22:36.196827] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-16T17:22:36.198475] [DEBUG] [LOCAL ] ATI: Trimmed 74011 records to 51723 (keeping 200 days of data) [2025-10-16T17:22:36.418960] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T17:22:36.525548] [DEBUG] [LOCAL ] ATI: Primary data saved (51723 records). [2025-10-16T17:22:36.525708] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-16T17:22:36.525792] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATI took 39.8s. Estimated remaining: 4h 51m 39s. Rate: 7.5 symbols/min [2025-10-16T17:22:36.711299] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:36.741804] [DEBUG] [LOCAL ] ATR: Loaded 30562 existing records from primary storage. [2025-10-16T17:22:36.742053] [INFO ] [MAIN ] ATR: Loaded 30562 existing records. [2025-10-16T17:22:36.753332] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-16T17:22:36.936138] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:36.936338] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-16T17:22:36.936387] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-16T17:22:36.936560] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-16T17:22:36.936599] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-16T17:22:37.304233] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:37.486302] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T17:22:37.542801] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-16T17:22:38.347990] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-16T17:22:38.367600] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T17:22:38.800849] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T17:22:39.143047] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-16T17:22:39.742932] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T17:22:39.942842] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-16T17:22:40.136173] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:22:40.742849] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-16T17:22:41.312313] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T17:22:41.542808] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-16T17:22:42.118033] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:22:42.342807] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-16T17:22:42.821164] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T17:22:42.825717] [INFO ] [REMOTE ] ATKR: Full fetch complete (53529 records). [2025-10-16T17:22:42.825812] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-16T17:22:43.156684] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-16T17:22:43.210439] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-16T17:22:43.210515] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-16T17:22:43.211122] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-16T17:22:43.211201] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-16T17:22:43.212301] [DEBUG] [LOCAL ] ATKR: Trimmed 53529 records to 35500 (keeping 200 days of data) [2025-10-16T17:22:43.431817] [DEBUG] [LOCAL ] ATKR: Primary data saved (35500 records). [2025-10-16T17:22:43.431975] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-16T17:22:43.432066] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATKR took 25.5s. Estimated remaining: 4h 51m 18s. Rate: 7.5 symbols/min [2025-10-16T17:22:43.602698] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:43.602874] [DEBUG] [LOCAL ] ATS: No existing data file found in primary storage. [2025-10-16T17:22:43.602912] [WARN ] [MAIN ] ATS: No existing data found, performing full refresh instead. [2025-10-16T17:22:43.603025] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-16T17:22:43.603085] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-16T17:22:43.603155] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-16T17:22:43.603199] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-16T17:22:43.946581] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-16T17:22:43.968503] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:43.991359] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T17:22:44.225355] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:22:44.742818] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-16T17:22:45.290301] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:22:45.542910] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-16T17:22:46.343152] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-16T17:22:46.345984] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T17:22:46.915551] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:22:47.063617] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:22:47.142844] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-16T17:22:47.942897] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-16T17:22:48.128067] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:22:48.742918] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-16T17:22:49.284882] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:22:49.542794] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-16T17:22:49.661462] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:22:50.342857] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-16T17:22:51.117905] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:22:51.142821] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-16T17:22:51.541381] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T17:22:51.942844] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-16T17:22:52.747993] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-16T17:22:52.754605] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T17:22:52.759741] [INFO ] [REMOTE ] ATMU: Full fetch complete (56818 records). [2025-10-16T17:22:52.759836] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-16T17:22:53.166745] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-16T17:22:53.166842] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-16T17:22:53.167472] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-16T17:22:53.167539] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-16T17:22:53.168869] [DEBUG] [LOCAL ] ATMU: Trimmed 56818 records to 39185 (keeping 200 days of data) [2025-10-16T17:22:53.402996] [DEBUG] [LOCAL ] ATMU: Primary data saved (39185 records). [2025-10-16T17:22:53.403132] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-16T17:22:53.403203] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATMU took 28.6s. Estimated remaining: 4h 51m 36s. Rate: 7.5 symbols/min [2025-10-16T17:22:53.547982] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-16T17:22:53.575262] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:22:53.617365] [DEBUG] [LOCAL ] ATUS: Loaded 49869 existing records from primary storage. [2025-10-16T17:22:53.617662] [INFO ] [MAIN ] ATUS: Loaded 49869 existing records. [2025-10-16T17:22:53.792979] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:22:53.793199] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-16T17:22:53.793246] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-16T17:22:53.793436] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-16T17:22:53.793491] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-16T17:22:54.174163] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:22:54.342801] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-16T17:23:06.187153] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (12.64 seconds). [2025-10-16T17:23:06.191858] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-16T17:23:06.987404] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (12.64 seconds). [2025-10-16T17:23:06.997085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-16T17:23:07.111505] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (14.36 seconds). [2025-10-16T17:23:07.118348] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-16T17:23:07.671077] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (15.73 seconds). [2025-10-16T17:23:07.681458] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-16T17:23:07.759106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:23:07.764218] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-16T17:23:08.051056] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:23:08.058013] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-16T17:23:08.540633] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:23:08.545105] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-16T17:23:09.024978] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:23:09.035340] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-16T17:23:09.413795] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-16T17:23:09.424731] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:23:09.425069] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-16T17:23:09.430055] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-16T17:23:09.472102] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:23:09.480366] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-16T17:23:10.451683] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T17:23:10.457768] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-16T17:23:10.476430] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:23:10.504491] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-16T17:23:10.509387] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:23:10.518677] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-16T17:23:10.762385] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:23:10.771964] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-16T17:23:11.366626] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:23:11.371136] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-16T17:23:11.965714] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:23:11.971106] [INFO ] [REMOTE ] ATR: Full fetch complete (43970 records). [2025-10-16T17:23:11.971219] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-16T17:23:12.332202] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T17:23:12.369107] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-16T17:23:12.412389] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T17:23:12.423612] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:23:12.470388] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-16T17:23:12.498103] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-16T17:23:12.549957] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-16T17:23:12.550044] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-16T17:23:12.550700] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-16T17:23:12.550785] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-16T17:23:12.552011] [DEBUG] [LOCAL ] ATR: Trimmed 43970 records to 30763 (keeping 200 days of data) [2025-10-16T17:23:12.770467] [DEBUG] [LOCAL ] ATR: Primary data saved (30763 records). [2025-10-16T17:23:12.770620] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-16T17:23:12.770736] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATR took 36.2s. Estimated remaining: 4h 53m 53s. Rate: 7.5 symbols/min [2025-10-16T17:23:12.978299] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:13.033181] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-16T17:23:13.033510] [INFO ] [MAIN ] AU: Loaded 53079 existing records. [2025-10-16T17:23:13.211792] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:13.212138] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-16T17:23:13.212269] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-16T17:23:13.212564] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-16T17:23:13.212620] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-16T17:23:13.397494] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T17:23:13.482269] [INFO ] [REMOTE ] ATS: Full fetch complete (25588 records). [2025-10-16T17:23:13.507757] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-16T17:23:13.704564] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:13.708544] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-16T17:23:13.991036] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-16T17:23:13.991353] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-16T17:23:13.992030] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-16T17:23:13.992226] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-16T17:23:13.993441] [DEBUG] [LOCAL ] ATS: Trimmed 25588 records to 17690 (keeping 200 days of data) [2025-10-16T17:23:14.100213] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T17:23:14.119414] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-16T17:23:14.151689] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T17:23:14.164079] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-16T17:23:14.181663] [DEBUG] [LOCAL ] ATS: Primary data saved (17690 records). [2025-10-16T17:23:14.181785] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-16T17:23:14.181859] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATS took 30.7s. Estimated remaining: 4h 52m 21s. Rate: 7.5 symbols/min [2025-10-16T17:23:14.381457] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:14.426351] [DEBUG] [LOCAL ] AUB: Loaded 46010 existing records from primary storage. [2025-10-16T17:23:14.426677] [INFO ] [MAIN ] AUB: Loaded 46010 existing records. [2025-10-16T17:23:14.631195] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:14.631395] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-16T17:23:14.631445] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-16T17:23:14.632095] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-16T17:23:14.632153] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-16T17:23:15.046583] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:15.046974] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-16T17:23:15.723290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:23:15.734036] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-16T17:23:15.811952] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T17:23:15.824844] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-16T17:23:15.869396] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T17:23:15.882397] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-16T17:23:16.521499] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:23:16.530258] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-16T17:23:17.511439] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T17:23:17.517023] [INFO ] [REMOTE ] ATO: Full fetch complete (60700 records). [2025-10-16T17:23:17.517172] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-16T17:23:17.917513] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T17:23:17.986722] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-16T17:23:18.039387] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-16T17:23:18.039939] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-16T17:23:18.041132] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-16T17:23:18.041290] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-16T17:23:18.077799] [DEBUG] [LOCAL ] ATO: Trimmed 60700 records to 42086 (keeping 200 days of data) [2025-10-16T17:23:18.080360] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-16T17:23:18.156279] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-16T17:23:18.213177] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T17:23:18.349573] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-16T17:23:18.402162] [DEBUG] [LOCAL ] ATO: Primary data saved (42086 records). [2025-10-16T17:23:18.402305] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-16T17:23:18.402387] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATO took 52.5s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-16T17:23:18.581574] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:18.588623] [DEBUG] [LOCAL ] AUNA: Loaded 5131 existing records from primary storage. [2025-10-16T17:23:18.588852] [INFO ] [MAIN ] AUNA: Loaded 5131 existing records. [2025-10-16T17:23:18.763930] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:18.764129] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-16T17:23:18.764175] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-16T17:23:18.764337] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-16T17:23:18.764391] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-16T17:23:19.121100] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:19.142794] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-16T17:23:19.671247] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:23:19.707902] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:23:19.709834] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T17:23:19.942892] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-16T17:23:20.097205] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T17:23:20.742856] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-16T17:23:21.546369] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-16T17:23:21.551665] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:23:21.940252] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-16T17:23:22.003631] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:23:22.342811] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-16T17:23:23.143020] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-16T17:23:23.953500] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-16T17:23:23.956945] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:23:24.743058] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-16T17:23:25.132321] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T17:23:25.382468] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:23:25.542975] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-16T17:23:25.593994] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T17:23:26.092473] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T17:23:26.342803] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-16T17:23:27.142862] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-16T17:23:27.506246] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:23:27.943036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-16T17:23:28.121304] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:23:28.343895] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T17:23:28.742859] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-16T17:23:29.542805] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-16T17:23:30.309330] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:23:30.316478] [INFO ] [REMOTE ] ATUS: Full fetch complete (71384 records). [2025-10-16T17:23:30.316715] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-16T17:23:30.347892] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-16T17:23:30.724235] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-16T17:23:30.724321] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-16T17:23:30.725098] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-16T17:23:30.725164] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-16T17:23:30.726725] [DEBUG] [LOCAL ] ATUS: Trimmed 71384 records to 50229 (keeping 200 days of data) [2025-10-16T17:23:31.011915] [DEBUG] [LOCAL ] ATUS: Primary data saved (50229 records). [2025-10-16T17:23:31.012059] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-16T17:23:31.012158] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 37.6s. Estimated remaining: 4h 52m 16s. Rate: 7.5 symbols/min [2025-10-16T17:23:31.151041] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-16T17:23:31.184146] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:31.221615] [DEBUG] [LOCAL ] AVA: Loaded 38779 existing records from primary storage. [2025-10-16T17:23:31.221938] [INFO ] [MAIN ] AVA: Loaded 38779 existing records. [2025-10-16T17:23:31.400712] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:31.400954] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-16T17:23:31.401030] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-16T17:23:31.401398] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-16T17:23:31.401447] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-16T17:23:31.764835] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:31.799571] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-16T17:23:31.841231] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:23:31.942792] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-16T17:23:32.026699] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:23:32.742812] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-16T17:23:33.542786] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-16T17:23:33.945495] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T17:23:34.316103] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:23:34.342805] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-16T17:23:35.046064] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:23:35.142823] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-16T17:23:35.570065] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:23:35.942815] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-16T17:23:36.742876] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-16T17:23:37.133800] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-16T17:23:37.168081] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:23:37.542835] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-16T17:23:38.342806] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-16T17:23:38.466513] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:23:38.601802] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T17:23:39.142841] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-16T17:23:39.942802] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-16T17:23:40.400688] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T17:23:40.487292] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T17:23:40.672066] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:23:40.677942] [INFO ] [REMOTE ] AUB: Full fetch complete (66171 records). [2025-10-16T17:23:40.678076] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-16T17:23:40.748073] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-16T17:23:41.082245] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-16T17:23:41.082342] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-16T17:23:41.083098] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-16T17:23:41.083164] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-16T17:23:41.084532] [DEBUG] [LOCAL ] AUB: Trimmed 66171 records to 46391 (keeping 200 days of data) [2025-10-16T17:23:41.370967] [DEBUG] [LOCAL ] AUB: Primary data saved (46391 records). [2025-10-16T17:23:41.371107] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-16T17:23:41.371742] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AUB took 27.2s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-16T17:23:41.480304] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:23:41.548554] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-16T17:23:41.551337] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:41.564582] [DEBUG] [LOCAL ] AVAL: Loaded 8592 existing records from primary storage. [2025-10-16T17:23:41.564836] [INFO ] [MAIN ] AVAL: Loaded 8592 existing records. [2025-10-16T17:23:41.738464] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:41.738706] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-16T17:23:41.738762] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-16T17:23:41.738916] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-16T17:23:41.738994] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-16T17:23:42.088553] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:42.342812] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-16T17:23:42.985112] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T17:23:43.010911] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:23:43.142805] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-16T17:23:43.942838] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-16T17:23:44.742853] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-16T17:23:44.853995] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T17:23:45.149998] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T17:23:45.542810] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-16T17:23:46.051474] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:23:46.342796] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-16T17:23:46.431543] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:23:47.142891] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-16T17:23:47.859839] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:23:47.942827] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-16T17:23:48.742862] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-16T17:23:48.908054] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T17:23:49.392920] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:23:49.542830] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-16T17:23:49.564898] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:23:50.342817] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-16T17:23:51.065208] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T17:23:51.142846] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-16T17:23:51.942922] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-16T17:23:52.215908] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T17:23:52.223851] [INFO ] [REMOTE ] AU: Full fetch complete (76165 records). [2025-10-16T17:23:52.224026] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-16T17:23:52.224941] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:23:52.225042] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:23:52.225086] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:23:52.225125] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-16T17:23:52.225196] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-16T17:23:52.225251] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-16T17:23:52.225417] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-10-16T17:23:52.225800] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 39.5s. Estimated remaining: 4h 53m 4s. Rate: 7.5 symbols/min [2025-10-16T17:23:52.406194] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:52.406453] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-10-16T17:23:52.406534] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-10-16T17:23:52.406833] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-16T17:23:52.406954] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-16T17:23:52.407209] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-16T17:23:52.407388] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-16T17:23:52.484814] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:23:52.531854] [INFO ] [REMOTE ] AUNA: Full fetch complete (7788 records). [2025-10-16T17:23:52.543925] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-16T17:23:52.545630] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:23:52.752235] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-16T17:23:53.126985] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:53.203914] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-16T17:23:53.203993] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-16T17:23:53.204213] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-16T17:23:53.204263] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-16T17:23:53.204661] [DEBUG] [LOCAL ] AUNA: Trimmed 7788 records to 5158 (keeping 200 days of data) [2025-10-16T17:23:53.231770] [DEBUG] [LOCAL ] AUNA: Primary data saved (5158 records). [2025-10-16T17:23:53.231855] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-16T17:23:53.231928] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 34.8s. Estimated remaining: 4h 51m 30s. Rate: 7.5 symbols/min [2025-10-16T17:23:53.400294] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:53.400463] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-16T17:23:53.400500] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-16T17:23:53.400615] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-16T17:23:53.400687] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-16T17:23:53.400777] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-16T17:23:53.400812] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-16T17:23:53.552163] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-16T17:23:53.764097] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:54.251468] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:23:54.342807] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-16T17:23:54.790891] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:23:55.142816] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-16T17:23:55.336960] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:23:55.337293] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-16T17:23:55.337387] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:23:55.337434] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-16T17:23:55.337469] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:23:55.337511] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-16T17:23:55.337586] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-16T17:23:55.337622] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-16T17:23:55.337719] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-16T17:23:55.337802] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVBC took 2.1s. Estimated remaining: 4h 50m 10s. Rate: 7.5 symbols/min [2025-10-16T17:23:55.519251] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:55.534283] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:23:55.539399] [INFO ] [REMOTE ] AVA: Full fetch complete (55526 records). [2025-10-16T17:23:55.539556] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-16T17:23:55.727354] [DEBUG] [LOCAL ] AVD: Loaded 21808 existing records from primary storage. [2025-10-16T17:23:55.730139] [INFO ] [MAIN ] AVD: Loaded 21808 existing records. [2025-10-16T17:23:55.942949] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-16T17:23:56.277556] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-16T17:23:56.277708] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-16T17:23:56.279032] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-16T17:23:56.279139] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-16T17:23:56.255140] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:56.280733] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-16T17:23:56.281173] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-16T17:23:56.281507] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-16T17:23:56.281596] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-16T17:23:56.281436] [DEBUG] [LOCAL ] AVA: Trimmed 55526 records to 39001 (keeping 200 days of data) [2025-10-16T17:23:56.772840] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-16T17:23:57.134126] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:57.168584] [DEBUG] [LOCAL ] AVA: Primary data saved (39001 records). [2025-10-16T17:23:57.168834] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-16T17:23:57.169001] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 26.2s. Estimated remaining: 4h 48m 49s. Rate: 7.6 symbols/min [2025-10-16T17:23:57.344340] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:23:57.363838] [DEBUG] [LOCAL ] AVK: Loaded 18628 existing records from primary storage. [2025-10-16T17:23:57.364235] [INFO ] [MAIN ] AVK: Loaded 18628 existing records. [2025-10-16T17:23:57.509999] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T17:23:57.552317] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-16T17:23:57.587724] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:23:57.589011] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-16T17:23:57.589082] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-16T17:23:57.589281] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-16T17:23:57.589322] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-16T17:23:57.897225] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:23:57.967661] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:23:58.342798] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-16T17:23:58.690475] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T17:23:59.006585] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:23:59.142816] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-16T17:23:59.869079] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T17:23:59.942840] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-16T17:24:00.742897] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-16T17:24:01.224263] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:24:01.284204] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T17:24:01.542814] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-16T17:24:02.342813] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-16T17:24:02.568164] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T17:24:03.142837] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-16T17:24:03.788305] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:24:03.943060] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-16T17:24:04.299483] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:24:04.742833] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-16T17:24:05.542785] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-16T17:24:05.736958] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:24:05.756543] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:24:06.342812] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-16T17:24:06.456001] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:24:07.142837] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-16T17:24:07.539842] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:24:07.942823] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-16T17:24:08.525429] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:24:08.742798] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-16T17:24:08.905579] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:24:09.542810] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-16T17:24:09.993485] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T17:24:10.342783] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-16T17:24:10.621003] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T17:24:11.142807] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-16T17:24:11.397349] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:24:11.942813] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-16T17:24:12.675615] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:24:12.742818] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-16T17:24:12.798472] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T17:24:13.364396] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T17:24:13.542840] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-16T17:24:14.342825] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-16T17:24:14.536488] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T17:24:15.142820] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-16T17:24:15.905210] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T17:24:15.947916] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-16T17:24:15.963099] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T17:24:16.742804] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-16T17:24:16.885099] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T17:24:17.543909] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-16T17:24:17.546075] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:24:18.342794] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-16T17:24:18.527604] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:24:19.050128] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:24:19.142847] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-16T17:24:19.619815] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T17:24:19.942804] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-16T17:24:20.742827] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-16T17:24:21.018371] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:24:21.524695] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T17:24:21.526409] [INFO ] [REMOTE ] AVAL: Full fetch complete (14928 records). [2025-10-16T17:24:21.526481] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-16T17:24:21.548033] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-16T17:24:21.908471] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-16T17:24:21.908548] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-16T17:24:21.908861] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-16T17:24:21.908945] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-16T17:24:21.909449] [DEBUG] [LOCAL ] AVAL: Trimmed 14928 records to 8650 (keeping 200 days of data) [2025-10-16T17:24:21.960311] [DEBUG] [LOCAL ] AVAL: Primary data saved (8650 records). [2025-10-16T17:24:21.960456] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-16T17:24:21.960536] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVAL took 40.6s. Estimated remaining: 4h 52m 3s. Rate: 7.5 symbols/min [2025-10-16T17:24:22.132764] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:22.168110] [DEBUG] [LOCAL ] AVNS: Loaded 33666 existing records from primary storage. [2025-10-16T17:24:22.168400] [INFO ] [MAIN ] AVNS: Loaded 33666 existing records. [2025-10-16T17:24:22.341589] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:22.341819] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-16T17:24:22.341867] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-16T17:24:22.342138] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-16T17:24:22.342176] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-16T17:24:22.353149] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-16T17:24:22.708138] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:22.714290] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T17:24:23.142811] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-16T17:24:23.592329] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:24:23.597314] [INFO ] [REMOTE ] AVK: Full fetch complete (26720 records). [2025-10-16T17:24:23.597394] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-16T17:24:23.951124] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-16T17:24:23.962848] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-16T17:24:23.963117] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-16T17:24:23.964304] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-16T17:24:23.964469] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-16T17:24:23.965301] [DEBUG] [LOCAL ] AVK: Trimmed 26720 records to 18751 (keeping 200 days of data) [2025-10-16T17:24:24.077105] [DEBUG] [LOCAL ] AVK: Primary data saved (18751 records). [2025-10-16T17:24:24.077224] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-16T17:24:24.077298] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVK took 26.9s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-16T17:24:24.272309] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:24:24.275954] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:24.319672] [DEBUG] [LOCAL ] AVNT: Loaded 39045 existing records from primary storage. [2025-10-16T17:24:24.319958] [INFO ] [MAIN ] AVNT: Loaded 39045 existing records. [2025-10-16T17:24:24.490434] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:24.490609] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-16T17:24:24.490682] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-16T17:24:24.491026] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-16T17:24:24.491083] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-16T17:24:24.749900] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-16T17:24:24.842400] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:25.542845] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-16T17:24:25.667049] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:24:25.750493] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:24:26.342865] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-16T17:24:27.118486] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:24:27.142766] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-16T17:24:27.715980] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:24:27.942826] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-16T17:24:28.471173] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:24:28.744008] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-16T17:24:28.748618] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:24:29.542858] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-16T17:24:30.278288] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T17:24:30.342827] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-16T17:24:30.532098] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:24:31.142781] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-16T17:24:31.343156] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:24:31.804817] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T17:24:31.807467] [INFO ] [REMOTE ] AVD: Full fetch complete (32746 records). [2025-10-16T17:24:31.807630] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-16T17:24:31.808239] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:24:31.808341] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:24:31.808414] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:24:31.808509] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-16T17:24:31.808592] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-16T17:24:31.808632] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-10-16T17:24:31.808833] [DEBUG] [LOCAL ] AVD: Deleted derivative data file. [2025-10-16T17:24:31.808955] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 36.5s. Estimated remaining: 4h 50m 34s. Rate: 7.5 symbols/min [2025-10-16T17:24:31.949226] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-16T17:24:31.982396] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:32.040725] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-16T17:24:32.041066] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-16T17:24:32.216201] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:24:32.216435] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-16T17:24:32.216503] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-16T17:24:32.216865] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-16T17:24:32.216925] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-16T17:24:32.591012] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:32.742823] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-16T17:24:33.542840] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-16T17:24:33.613562] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T17:24:33.619347] [INFO ] [REMOTE ] AVB: Full fetch complete (59108 records). [2025-10-16T17:24:33.619533] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-16T17:24:34.024098] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-16T17:24:34.024176] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-16T17:24:34.024833] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-16T17:24:34.024895] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-16T17:24:34.026260] [DEBUG] [LOCAL ] AVB: Trimmed 59108 records to 42587 (keeping 200 days of data) [2025-10-16T17:24:34.293690] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:24:34.336268] [DEBUG] [LOCAL ] AVB: Primary data saved (42587 records). [2025-10-16T17:24:34.336395] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-16T17:24:34.336465] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVB took 42.1s. Estimated remaining: 4h 49m 22s. Rate: 7.5 symbols/min [2025-10-16T17:24:34.348207] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-16T17:24:34.524547] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:34.524775] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-16T17:24:34.524847] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-16T17:24:34.524965] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-16T17:24:34.525007] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-16T17:24:34.525052] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-16T17:24:34.525123] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-16T17:24:34.901460] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:34.921684] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:24:35.142821] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-16T17:24:35.919623] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:24:35.942768] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-16T17:24:36.581624] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:24:36.742862] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-16T17:24:37.186836] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T17:24:37.542880] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-16T17:24:37.764237] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:24:38.342818] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-16T17:24:39.142861] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-16T17:24:39.360082] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:24:39.693866] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:24:39.942829] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-16T17:24:40.582453] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:24:40.742829] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-16T17:24:41.396221] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:24:41.542966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-16T17:24:42.063332] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:24:42.342817] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-16T17:24:43.122908] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:24:43.142773] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-16T17:24:43.422899] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:24:43.942810] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-16T17:24:44.591572] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T17:24:44.742808] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-16T17:24:45.468223] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:24:45.542782] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-16T17:24:46.337011] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:24:46.351095] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-16T17:24:46.594933] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T17:24:47.142838] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-16T17:24:47.697336] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T17:24:47.942993] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-16T17:24:48.742908] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-16T17:24:49.004262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T17:24:49.479283] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:24:49.484631] [INFO ] [REMOTE ] AVNT: Full fetch complete (56444 records). [2025-10-16T17:24:49.484849] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-16T17:24:49.548252] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-16T17:24:49.920266] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-16T17:24:49.920485] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-16T17:24:49.921262] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-16T17:24:49.921434] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-16T17:24:49.939565] [DEBUG] [LOCAL ] AVNT: Trimmed 56444 records to 39339 (keeping 200 days of data) [2025-10-16T17:24:49.941175] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T17:24:50.186982] [DEBUG] [LOCAL ] AVNT: Primary data saved (39339 records). [2025-10-16T17:24:50.187125] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-16T17:24:50.187206] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNT took 26.1s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-16T17:24:50.357335] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:50.353504] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-16T17:24:50.357723] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-10-16T17:24:50.358453] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-10-16T17:24:50.358594] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-16T17:24:50.358697] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-16T17:24:50.358762] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-16T17:24:50.358799] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-16T17:24:50.739893] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:51.088464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:24:51.142813] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-16T17:24:51.476350] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:24:51.942894] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-16T17:24:52.742830] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-16T17:24:52.861253] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:24:53.178025] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:24:53.542828] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-16T17:24:54.145023] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:24:54.342858] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-16T17:24:55.142846] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-16T17:24:55.212574] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:24:55.943873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-16T17:24:55.946229] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T17:24:56.157281] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:24:56.742820] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-16T17:24:57.411425] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:24:57.542837] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-16T17:24:58.106604] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T17:24:58.112728] [INFO ] [REMOTE ] AVNS: Full fetch complete (48471 records). [2025-10-16T17:24:58.112851] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-16T17:24:58.350913] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-16T17:24:58.503370] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-16T17:24:58.503449] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-16T17:24:58.504058] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-16T17:24:58.504121] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-16T17:24:58.505233] [DEBUG] [LOCAL ] AVNS: Trimmed 48471 records to 33913 (keeping 200 days of data) [2025-10-16T17:24:58.700013] [DEBUG] [LOCAL ] AVNS: Primary data saved (33913 records). [2025-10-16T17:24:58.700146] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-16T17:24:58.700222] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNS took 36.7s. Estimated remaining: 4h 50m 44s. Rate: 7.5 symbols/min [2025-10-16T17:24:58.870206] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:24:58.887930] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:24:58.893489] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-16T17:24:58.893546] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-16T17:24:58.893699] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-16T17:24:58.893754] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-16T17:24:58.893799] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-16T17:24:58.893847] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-16T17:24:59.147995] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-16T17:24:59.250591] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:24:59.942855] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-16T17:25:00.175974] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:25:00.201401] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:25:00.742860] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-16T17:25:01.389933] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:25:01.442975] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T17:25:01.542809] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-16T17:25:02.342821] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-16T17:25:02.754975] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T17:25:03.142807] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-16T17:25:03.942787] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-16T17:25:04.351475] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T17:25:04.393970] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T17:25:04.742849] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-16T17:25:05.063155] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:25:05.542840] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-16T17:25:06.283582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:25:06.291114] [INFO ] [REMOTE ] AVTR: Full fetch complete (77641 records). [2025-10-16T17:25:06.291296] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-16T17:25:06.348005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-16T17:25:06.683877] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-16T17:25:06.683992] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-16T17:25:06.684822] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-16T17:25:06.684883] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-16T17:25:06.686226] [DEBUG] [LOCAL ] AVTR: Trimmed 77641 records to 53962 (keeping 200 days of data) [2025-10-16T17:25:06.996456] [DEBUG] [LOCAL ] AVTR: Primary data saved (53962 records). [2025-10-16T17:25:06.996585] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-16T17:25:06.996685] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 35.2s. Estimated remaining: 4h 50m 40s. Rate: 7.5 symbols/min [2025-10-16T17:25:07.166689] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-16T17:25:07.169260] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:07.193223] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T17:25:07.242701] [DEBUG] [LOCAL ] AWK: Loaded 48557 existing records from primary storage. [2025-10-16T17:25:07.243031] [INFO ] [MAIN ] AWK: Loaded 48557 existing records. [2025-10-16T17:25:07.419747] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:07.420054] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-16T17:25:07.420163] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-16T17:25:07.420673] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-16T17:25:07.420750] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-16T17:25:07.539880] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:25:07.791894] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:07.942814] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-16T17:25:08.075287] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:25:08.742919] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-16T17:25:09.494374] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:25:09.542776] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-16T17:25:09.679073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:25:10.342878] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-16T17:25:10.836247] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:25:11.142834] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-16T17:25:11.775964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:25:11.942803] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-16T17:25:12.004076] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T17:25:12.742840] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-16T17:25:12.927599] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:25:13.542836] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-16T17:25:14.342786] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-16T17:25:14.500194] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T17:25:14.768741] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T17:25:15.142813] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-16T17:25:15.478697] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:25:15.942824] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-16T17:25:16.601197] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:25:16.742799] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-16T17:25:17.542781] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-16T17:25:17.559853] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:25:17.651757] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:25:18.342808] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-16T17:25:18.475352] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:25:19.142848] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-16T17:25:19.942813] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-16T17:25:20.108702] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:25:20.425817] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:25:20.742855] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-16T17:25:21.121949] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:25:21.542880] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-16T17:25:22.161907] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:25:22.342812] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-16T17:25:23.056268] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:25:23.061510] [INFO ] [REMOTE ] AVY: Full fetch complete (56310 records). [2025-10-16T17:25:23.061669] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-16T17:25:23.062331] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:25:23.062416] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:25:23.062466] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:25:23.062504] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-16T17:25:23.062596] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-16T17:25:23.062697] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-16T17:25:23.062773] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-10-16T17:25:23.062845] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 48.7s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-16T17:25:23.148002] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-16T17:25:23.239801] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:23.259420] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:25:23.280870] [DEBUG] [LOCAL ] AWP: Loaded 21616 existing records from primary storage. [2025-10-16T17:25:23.281120] [INFO ] [MAIN ] AWP: Loaded 21616 existing records. [2025-10-16T17:25:23.453165] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:23.453358] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-16T17:25:23.453474] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-16T17:25:23.453848] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-16T17:25:23.453905] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-16T17:25:23.794483] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:23.942782] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-16T17:25:24.402382] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:25:24.742814] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-16T17:25:24.878809] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:25:24.882345] [INFO ] [REMOTE ] AWF: Full fetch complete (35839 records). [2025-10-16T17:25:24.882420] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-16T17:25:25.242171] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-16T17:25:25.242266] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-16T17:25:25.242746] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-16T17:25:25.242807] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-16T17:25:25.243597] [DEBUG] [LOCAL ] AWF: Trimmed 35839 records to 24143 (keeping 200 days of data) [2025-10-16T17:25:25.383410] [DEBUG] [LOCAL ] AWF: Primary data saved (24143 records). [2025-10-16T17:25:25.383532] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-16T17:25:25.383601] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AWF took 35.2s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-16T17:25:25.549694] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-16T17:25:25.574402] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:25.597003] [DEBUG] [LOCAL ] AWR: Loaded 22839 existing records from primary storage. [2025-10-16T17:25:25.597301] [INFO ] [MAIN ] AWR: Loaded 22839 existing records. [2025-10-16T17:25:25.778619] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:25.778914] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-16T17:25:25.779000] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-16T17:25:25.779226] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-16T17:25:25.779283] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-16T17:25:26.130022] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:25:26.149824] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:26.342775] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-16T17:25:26.451431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:25:27.142790] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-16T17:25:27.189201] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T17:25:27.942820] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-16T17:25:28.742848] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-16T17:25:28.886146] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T17:25:29.182834] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:25:29.188253] [INFO ] [REMOTE ] AWI: Full fetch complete (36062 records). [2025-10-16T17:25:29.188387] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-16T17:25:29.558490] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-16T17:25:29.612259] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-16T17:25:29.612480] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-16T17:25:29.613073] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-16T17:25:29.613152] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-16T17:25:29.630955] [DEBUG] [LOCAL ] AWI: Trimmed 36062 records to 25598 (keeping 200 days of data) [2025-10-16T17:25:29.632223] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:25:29.801094] [DEBUG] [LOCAL ] AWI: Primary data saved (25598 records). [2025-10-16T17:25:29.801261] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-16T17:25:29.801354] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWI took 31.1s. Estimated remaining: 4h 50m 3s. Rate: 7.5 symbols/min [2025-10-16T17:25:29.968544] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:29.997403] [DEBUG] [LOCAL ] AX: Loaded 28036 existing records from primary storage. [2025-10-16T17:25:29.997703] [INFO ] [MAIN ] AX: Loaded 28036 existing records. [2025-10-16T17:25:30.203385] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:30.203588] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-16T17:25:30.203636] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-16T17:25:30.203892] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-16T17:25:30.203934] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-16T17:25:30.347905] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-16T17:25:30.598476] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:31.046566] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:25:31.142779] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-16T17:25:31.175320] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:25:31.942819] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-16T17:25:32.742516] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:25:32.751974] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-16T17:25:33.105948] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:25:33.542849] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-16T17:25:34.135170] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:25:34.342849] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-16T17:25:34.972475] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:25:34.979024] [INFO ] [REMOTE ] AWK: Full fetch complete (70904 records). [2025-10-16T17:25:34.979206] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-16T17:25:35.145191] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-16T17:25:35.350233] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T17:25:35.404313] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-16T17:25:35.404392] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-16T17:25:35.405158] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-16T17:25:35.405221] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-16T17:25:35.406551] [DEBUG] [LOCAL ] AWK: Trimmed 70904 records to 48909 (keeping 200 days of data) [2025-10-16T17:25:35.709153] [DEBUG] [LOCAL ] AWK: Primary data saved (48909 records). [2025-10-16T17:25:35.709337] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-16T17:25:35.709451] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWK took 28.7s. Estimated remaining: 4h 49m 31s. Rate: 7.5 symbols/min [2025-10-16T17:25:35.882155] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:35.929099] [DEBUG] [LOCAL ] AXL: Loaded 50565 existing records from primary storage. [2025-10-16T17:25:35.929407] [INFO ] [MAIN ] AXL: Loaded 50565 existing records. [2025-10-16T17:25:35.950147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-16T17:25:36.114040] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:25:36.114259] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-16T17:25:36.114305] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-16T17:25:36.114502] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-16T17:25:36.114539] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-16T17:25:36.487408] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:25:36.519986] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:25:36.742843] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-16T17:25:37.084907] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:25:37.542840] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-16T17:25:38.342834] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-16T17:25:38.472259] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:25:38.766631] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:25:39.142801] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-16T17:25:39.235932] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:25:39.942818] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-16T17:25:40.658090] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:25:40.742787] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-16T17:25:41.262823] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T17:25:41.542876] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-16T17:25:42.089549] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:25:42.342837] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-16T17:25:42.610857] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T17:25:43.142885] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-16T17:25:43.408382] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:25:43.942794] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-16T17:25:44.742846] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-16T17:25:44.886071] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:25:44.912784] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:25:45.390969] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T17:25:45.542830] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-16T17:25:46.342817] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-16T17:25:47.142832] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-16T17:25:47.338745] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:25:47.530188] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:25:47.788871] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:25:47.942831] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-16T17:25:48.742825] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-16T17:25:49.463619] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T17:25:49.542789] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-16T17:25:49.659459] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:25:50.342441] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:25:50.347703] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-16T17:25:51.142823] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-16T17:25:51.681237] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:25:51.942874] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-16T17:25:52.518959] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:25:52.540836] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T17:25:52.742857] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-16T17:25:53.542822] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-16T17:25:54.150059] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:25:54.342851] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-16T17:25:55.142870] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-16T17:25:55.225692] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:25:55.277116] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T17:25:55.942862] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-16T17:25:56.021613] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:25:56.714147] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T17:25:56.742780] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-16T17:25:57.542839] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-16T17:25:57.879923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:25:58.342909] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-16T17:25:58.608110] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:25:59.142850] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-16T17:25:59.237543] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T17:25:59.241551] [INFO ] [REMOTE ] AWP: Full fetch complete (31951 records). [2025-10-16T17:25:59.241722] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-16T17:25:59.614067] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-16T17:25:59.614154] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-16T17:25:59.614576] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-16T17:25:59.614616] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-16T17:25:59.615448] [DEBUG] [LOCAL ] AWP: Trimmed 31951 records to 21759 (keeping 200 days of data) [2025-10-16T17:25:59.744050] [DEBUG] [LOCAL ] AWP: Primary data saved (21759 records). [2025-10-16T17:25:59.744187] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-16T17:25:59.744269] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWP took 36.7s. Estimated remaining: 4h 52m 24s. Rate: 7.4 symbols/min [2025-10-16T17:25:59.912214] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:25:59.944020] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-16T17:25:59.966837] [DEBUG] [LOCAL ] AXP: Loaded 53166 existing records from primary storage. [2025-10-16T17:25:59.967176] [INFO ] [MAIN ] AXP: Loaded 53166 existing records. [2025-10-16T17:26:00.143186] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:00.143449] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-16T17:26:00.143530] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-16T17:26:00.143905] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-16T17:26:00.143977] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-16T17:26:00.503486] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:00.742818] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-16T17:26:00.915241] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T17:26:00.972003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T17:26:01.542874] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-16T17:26:02.342843] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-16T17:26:02.596100] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:26:02.741092] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:26:02.744475] [INFO ] [REMOTE ] AWR: Full fetch complete (32329 records). [2025-10-16T17:26:02.744602] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-16T17:26:03.122254] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-16T17:26:03.122342] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-16T17:26:03.122790] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-16T17:26:03.122850] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-16T17:26:03.123711] [DEBUG] [LOCAL ] AWR: Trimmed 32329 records to 23000 (keeping 200 days of data) [2025-10-16T17:26:03.175894] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-16T17:26:03.263877] [DEBUG] [LOCAL ] AWR: Primary data saved (23000 records). [2025-10-16T17:26:03.264017] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-16T17:26:03.264098] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWR took 37.9s. Estimated remaining: 4h 51m 25s. Rate: 7.5 symbols/min [2025-10-16T17:26:03.444680] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:03.444921] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-16T17:26:03.444970] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-16T17:26:03.445091] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-16T17:26:03.445183] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-16T17:26:03.445248] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-16T17:26:03.445294] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-16T17:26:03.761873] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:26:03.838810] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:03.942775] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-16T17:26:04.742838] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-16T17:26:05.015534] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:26:05.553200] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-16T17:26:05.578629] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-16T17:26:06.235948] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:26:06.342853] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-16T17:26:07.020244] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T17:26:07.024186] [INFO ] [REMOTE ] AX: Full fetch complete (42274 records). [2025-10-16T17:26:07.024299] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-16T17:26:07.147912] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-16T17:26:07.400414] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-16T17:26:07.400486] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-16T17:26:07.401002] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-16T17:26:07.401063] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-16T17:26:07.401903] [DEBUG] [LOCAL ] AX: Trimmed 42274 records to 28285 (keeping 200 days of data) [2025-10-16T17:26:07.561498] [DEBUG] [LOCAL ] AX: Primary data saved (28285 records). [2025-10-16T17:26:07.561629] [INFO ] [MAIN ] AX: Full history saved. [2025-10-16T17:26:07.561742] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 37.8s. Estimated remaining: 4h 50m 35s. Rate: 7.5 symbols/min [2025-10-16T17:26:07.733757] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:07.772247] [DEBUG] [LOCAL ] AXS: Loaded 38593 existing records from primary storage. [2025-10-16T17:26:07.772670] [INFO ] [MAIN ] AXS: Loaded 38593 existing records. [2025-10-16T17:26:07.874813] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T17:26:07.944814] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-16T17:26:07.975751] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:07.977378] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-16T17:26:07.977295] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T17:26:07.977525] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-16T17:26:07.984441] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-16T17:26:07.984529] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-16T17:26:08.017188] [INFO ] [REMOTE ] AXL: Full fetch complete (73061 records). [2025-10-16T17:26:08.050069] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-16T17:26:08.540695] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:26:08.731234] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:08.750494] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-16T17:26:08.755357] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-16T17:26:08.755411] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-16T17:26:08.756298] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-16T17:26:08.756363] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-16T17:26:08.757893] [DEBUG] [LOCAL ] AXL: Trimmed 73061 records to 50921 (keeping 200 days of data) [2025-10-16T17:26:09.039838] [DEBUG] [LOCAL ] AXL: Primary data saved (50921 records). [2025-10-16T17:26:09.039966] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-16T17:26:09.040044] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 33.3s. Estimated remaining: 4h 49m 15s. Rate: 7.5 symbols/min [2025-10-16T17:26:09.205921] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:09.253813] [DEBUG] [LOCAL ] AXTA: Loaded 52253 existing records from primary storage. [2025-10-16T17:26:09.254144] [INFO ] [MAIN ] AXTA: Loaded 52253 existing records. [2025-10-16T17:26:09.426196] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:09.426434] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-16T17:26:09.426514] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-16T17:26:09.426883] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-16T17:26:09.426951] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-16T17:26:09.547870] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-16T17:26:09.785237] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:10.026716] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:26:10.342866] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-16T17:26:11.142790] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-16T17:26:11.594390] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T17:26:11.749571] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:26:11.942788] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-16T17:26:12.295757] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:26:12.742815] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-16T17:26:13.053922] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T17:26:13.542835] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-16T17:26:13.903258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T17:26:14.158919] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:26:14.342810] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-16T17:26:15.142815] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-16T17:26:15.924607] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T17:26:15.942763] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-16T17:26:16.387396] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:26:16.421670] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:26:16.742816] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-16T17:26:17.542853] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-16T17:26:18.342922] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-16T17:26:18.743734] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T17:26:19.021570] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T17:26:19.061810] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:26:19.142803] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-16T17:26:19.942822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-16T17:26:20.742876] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-16T17:26:20.826682] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:26:21.134063] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:26:21.542892] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-16T17:26:22.342816] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-16T17:26:22.957899] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-16T17:26:23.142845] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-16T17:26:23.242207] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:26:23.531621] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:26:23.588062] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:26:23.942838] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-16T17:26:24.429161] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:26:24.742822] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-16T17:26:25.542846] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-16T17:26:26.342885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-16T17:26:26.809064] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T17:26:27.142841] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-16T17:26:27.211203] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:26:27.374686] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:26:27.942849] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-16T17:26:28.742853] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-16T17:26:29.011103] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T17:26:29.542816] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-16T17:26:29.582074] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:26:30.167843] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:26:30.342825] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-16T17:26:30.822009] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T17:26:30.822803] [INFO ] [REMOTE ] AXR: Full fetch complete (4411 records). [2025-10-16T17:26:30.822872] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-16T17:26:30.823214] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:26:30.823297] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:26:30.823342] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:26:30.823419] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-16T17:26:30.823496] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-16T17:26:30.823558] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-16T17:26:30.823629] [DEBUG] [LOCAL ] AXR: No derivative data file found to delete. [2025-10-16T17:26:30.823757] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 27.6s. Estimated remaining: 4h 51m 39s. Rate: 7.4 symbols/min [2025-10-16T17:26:31.142836] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-16T17:26:31.635570] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T17:26:31.942890] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-16T17:26:32.742884] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-16T17:26:32.902683] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T17:26:33.197194] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:26:33.542838] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-16T17:26:34.342888] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-16T17:26:34.893273] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T17:26:34.996030] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:26:35.142834] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-16T17:26:35.774820] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:26:35.942808] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-16T17:26:36.648630] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T17:26:36.742802] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-16T17:26:37.542861] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-16T17:26:38.320681] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-16T17:26:38.330309] [INFO ] [REMOTE ] AXP: Full fetch complete (77087 records). [2025-10-16T17:26:38.330468] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-16T17:26:38.771791] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T17:26:38.829629] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-16T17:26:38.828690] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-16T17:26:38.831092] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-16T17:26:38.832171] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-16T17:26:38.832421] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-16T17:26:38.857060] [DEBUG] [LOCAL ] AXP: Trimmed 77087 records to 53555 (keeping 200 days of data) [2025-10-16T17:26:38.858861] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:26:39.182079] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-16T17:26:39.236266] [DEBUG] [LOCAL ] AXP: Primary data saved (53555 records). [2025-10-16T17:26:39.236412] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-16T17:26:39.236806] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXP took 39.5s. Estimated remaining: 4h 51m 35s. Rate: 7.4 symbols/min [2025-10-16T17:26:40.672757] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:26:40.681139] [INFO ] [REMOTE ] AXTA: Full fetch complete (75375 records). [2025-10-16T17:26:40.681486] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-16T17:26:40.870780] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:26:40.928318] [INFO ] [REMOTE ] AXS: Full fetch complete (55880 records). [2025-10-16T17:26:40.966961] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-16T17:26:41.444742] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-16T17:26:41.450422] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-16T17:26:41.456373] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-16T17:26:41.475789] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-16T17:26:41.559227] [DEBUG] [LOCAL ] AXTA: Trimmed 75375 records to 52641 (keeping 200 days of data) [2025-10-16T17:26:41.578539] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-16T17:26:41.578895] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-16T17:26:41.579546] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-16T17:26:41.579630] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-16T17:26:41.662316] [DEBUG] [LOCAL ] AXS: Trimmed 55880 records to 38896 (keeping 200 days of data) [2025-10-16T17:26:42.008371] [DEBUG] [LOCAL ] AXTA: Primary data saved (52641 records). [2025-10-16T17:26:42.009017] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-16T17:26:42.010247] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXTA took 33.0s. Estimated remaining: 4h 50m 29s. Rate: 7.5 symbols/min [2025-10-16T17:26:42.125712] [DEBUG] [LOCAL ] AXS: Primary data saved (38896 records). [2025-10-16T17:26:42.125872] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-16T17:26:42.125954] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXS took 34.6s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-16T17:26:42.734581] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.742791] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-16T17:26:42.786914] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-16T17:26:42.819003] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.817863] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-16T17:26:42.847826] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-16T17:26:42.846058] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.866899] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:42.867564] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-16T17:26:42.867839] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-16T17:26:42.962078] [DEBUG] [LOCAL ] AZO: Loaded 11036 existing records from primary storage. [2025-10-16T17:26:42.985759] [INFO ] [MAIN ] AZO: Loaded 11036 existing records. [2025-10-16T17:26:43.077506] [DEBUG] [LOCAL ] AZZ: Loaded 22700 existing records from primary storage. [2025-10-16T17:26:43.122373] [INFO ] [MAIN ] AZZ: Loaded 22700 existing records. [2025-10-16T17:26:43.099958] [DEBUG] [LOCAL ] AYI: Loaded 24967 existing records from primary storage. [2025-10-16T17:26:43.296540] [INFO ] [MAIN ] AYI: Loaded 24967 existing records. [2025-10-16T17:26:43.454675] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.502365] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.523476] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-16T17:26:43.550722] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-16T17:26:43.658391] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-16T17:26:43.696077] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:43.699626] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-16T17:26:43.757803] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.804048] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.817174] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-16T17:26:43.908127] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:43.901704] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-16T17:26:43.929496] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-16T17:26:43.929631] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-16T17:26:43.976196] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-16T17:26:44.108221] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-16T17:26:44.165242] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-16T17:26:44.535282] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.572136] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-16T17:26:44.903717] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.932382] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-16T17:26:44.963851] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:44.964547] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-16T17:26:45.126300] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:26:45.134057] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-16T17:26:45.725891] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:26:45.729729] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-16T17:26:45.803766] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:26:45.808301] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-16T17:26:45.885994] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:26:45.891213] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-16T17:26:45.969398] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T17:26:46.256221] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T17:26:46.342811] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-16T17:26:46.554874] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:26:46.555222] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-16T17:26:46.555359] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:26:46.555459] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-16T17:26:46.555524] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:26:46.555601] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-16T17:26:46.555720] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-16T17:26:46.555802] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-16T17:26:46.555889] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-16T17:26:46.555951] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 4.4s. Estimated remaining: 4h 48m 9s. Rate: 7.5 symbols/min [2025-10-16T17:26:46.737633] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:26:46.789075] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-16T17:26:46.789396] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-16T17:26:46.967262] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:26:46.977814] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-16T17:26:46.978366] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-16T17:26:46.978799] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:26:46.982694] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-16T17:26:46.983410] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-16T17:26:47.147130] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-16T17:26:47.379867] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:26:47.381730] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:26:47.692506] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:26:47.942812] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-16T17:26:48.742856] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-16T17:26:49.542785] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-16T17:26:49.790742] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T17:26:50.342838] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-16T17:26:51.142841] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-16T17:26:51.810911] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T17:26:51.945462] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-16T17:26:51.947901] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-16T17:26:52.098603] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:26:52.243014] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (4.30 seconds). [2025-10-16T17:26:52.742823] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-16T17:26:53.098235] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T17:26:53.542789] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-16T17:26:53.585832] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-16T17:26:54.349792] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-16T17:26:54.353584] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T17:26:55.142808] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-16T17:26:55.942886] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-16T17:26:56.525565] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:26:56.653291] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T17:26:56.697327] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-16T17:26:56.742796] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-16T17:26:57.542867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-16T17:26:58.342785] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-16T17:26:58.670784] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:26:59.062313] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-16T17:26:59.142838] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-16T17:26:59.362637] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:26:59.942820] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-16T17:27:00.742858] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-16T17:27:01.350181] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:27:01.542837] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-16T17:27:01.811403] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-16T17:27:02.283192] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T17:27:02.342836] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-16T17:27:02.457626] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:27:03.142835] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-16T17:27:03.942773] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-16T17:27:04.331111] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:27:04.682100] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-16T17:27:04.739212] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:27:04.742763] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-16T17:27:05.469384] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T17:27:05.542827] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-16T17:27:06.322793] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T17:27:06.342809] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-16T17:27:07.142793] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-16T17:27:07.267246] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:27:07.942838] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-16T17:27:08.096296] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:27:08.742835] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-16T17:27:09.542818] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-16T17:27:09.752199] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:27:09.756019] [INFO ] [REMOTE ] AYI: Full fetch complete (37024 records). [2025-10-16T17:27:09.756173] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-16T17:27:10.156536] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-16T17:27:10.156625] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-16T17:27:10.157223] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-16T17:27:10.157278] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-16T17:27:10.158317] [DEBUG] [LOCAL ] AYI: Trimmed 37024 records to 25059 (keeping 200 days of data) [2025-10-16T17:27:10.315307] [DEBUG] [LOCAL ] AYI: Primary data saved (25059 records). [2025-10-16T17:27:10.315466] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-16T17:27:10.315555] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AYI took 28.2s. Estimated remaining: 4h 50m 50s. Rate: 7.5 symbols/min [2025-10-16T17:27:10.359134] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-16T17:27:10.495061] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:10.501495] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:27:10.504553] [INFO ] [REMOTE ] AZO: Full fetch complete (15947 records). [2025-10-16T17:27:10.504694] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-16T17:27:10.878966] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-16T17:27:10.903116] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-16T17:27:10.915358] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-16T17:27:11.104262] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-16T17:27:11.104431] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-16T17:27:11.104949] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-16T17:27:11.105105] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-16T17:27:11.127109] [DEBUG] [LOCAL ] AZO: Trimmed 15947 records to 11071 (keeping 200 days of data) [2025-10-16T17:27:11.154624] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-16T17:27:11.188004] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:11.216987] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-16T17:27:11.237818] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-16T17:27:11.239899] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-16T17:27:11.242949] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-16T17:27:11.553175] [DEBUG] [LOCAL ] AZO: Primary data saved (11071 records). [2025-10-16T17:27:11.568842] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-16T17:27:11.569342] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 29.4s. Estimated remaining: 4h 49m 29s. Rate: 7.5 symbols/min [2025-10-16T17:27:11.693872] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:11.768866] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T17:27:11.859858] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:11.913220] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-16T17:27:11.913602] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-16T17:27:11.947978] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-16T17:27:12.097924] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:12.098130] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-16T17:27:12.098179] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-16T17:27:12.098396] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-16T17:27:12.098435] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-16T17:27:12.465785] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:12.742799] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-16T17:27:12.836199] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:27:13.542789] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-16T17:27:13.627119] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-16T17:27:14.352543] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:27:14.351584] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-16T17:27:15.060348] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-16T17:27:15.142783] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-16T17:27:15.942783] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-16T17:27:16.569406] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:27:16.573497] [INFO ] [REMOTE ] AZZ: Full fetch complete (31907 records). [2025-10-16T17:27:16.573585] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-16T17:27:16.755716] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-16T17:27:16.952758] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-16T17:27:16.952841] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-16T17:27:16.953341] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-16T17:27:16.953429] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-16T17:27:16.954251] [DEBUG] [LOCAL ] AZZ: Trimmed 31907 records to 22902 (keeping 200 days of data) [2025-10-16T17:27:17.118084] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-16T17:27:17.134007] [DEBUG] [LOCAL ] AZZ: Primary data saved (22902 records). [2025-10-16T17:27:17.134110] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-16T17:27:17.134189] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AZZ took 35.0s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-16T17:27:17.304138] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:17.355364] [DEBUG] [LOCAL ] BAH: Loaded 51719 existing records from primary storage. [2025-10-16T17:27:17.355747] [INFO ] [MAIN ] BAH: Loaded 51719 existing records. [2025-10-16T17:27:17.526099] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:17.526343] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-16T17:27:17.526411] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-16T17:27:17.526615] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-16T17:27:17.526692] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-16T17:27:17.557246] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-16T17:27:17.872037] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:18.348037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-16T17:27:18.364228] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T17:27:19.034093] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T17:27:19.142818] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-16T17:27:19.735503] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T17:27:19.942805] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-16T17:27:20.176992] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:27:20.742890] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-16T17:27:20.950508] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T17:27:21.542818] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-16T17:27:22.328479] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T17:27:22.342770] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-16T17:27:22.478415] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:27:23.142825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-16T17:27:23.599621] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:27:23.942857] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-16T17:27:24.549457] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:27:24.742868] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-16T17:27:24.962741] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T17:27:25.542909] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-16T17:27:26.342890] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-16T17:27:26.412881] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T17:27:26.876955] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:27:26.920963] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:27:26.950911] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T17:27:26.957946] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-16T17:27:26.958092] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-16T17:27:27.143106] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-16T17:27:27.362598] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-16T17:27:27.362711] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-16T17:27:27.363526] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-16T17:27:27.363569] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-16T17:27:27.365048] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54180 (keeping 200 days of data) [2025-10-16T17:27:27.685869] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-16T17:27:27.685997] [INFO ] [MAIN ] BA: Full history saved. [2025-10-16T17:27:27.686590] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 41.1s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-16T17:27:27.858157] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:27.897870] [DEBUG] [LOCAL ] BAK: Loaded 39305 existing records from primary storage. [2025-10-16T17:27:27.898137] [INFO ] [MAIN ] BAK: Loaded 39305 existing records. [2025-10-16T17:27:27.952551] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-16T17:27:28.078230] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:28.078436] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-16T17:27:28.078482] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-16T17:27:28.078808] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-16T17:27:28.078878] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-16T17:27:28.424528] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:28.742901] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-16T17:27:29.542865] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-16T17:27:29.873890] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T17:27:29.992271] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-16T17:27:30.342904] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-16T17:27:30.754772] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T17:27:31.142800] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-16T17:27:31.268212] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T17:27:31.952805] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-16T17:27:31.976815] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T17:27:32.742784] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-16T17:27:33.480611] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-16T17:27:33.542886] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-16T17:27:34.300125] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-16T17:27:34.349854] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-16T17:27:34.364422] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:27:35.142826] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-16T17:27:35.942831] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-16T17:27:36.262839] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-16T17:27:36.522427] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T17:27:36.742845] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-16T17:27:36.816091] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:27:36.885809] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T17:27:37.542860] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-16T17:27:38.342843] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-16T17:27:38.972683] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T17:27:39.142810] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-16T17:27:39.735392] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:27:39.840961] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-16T17:27:39.942861] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-16T17:27:40.742856] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-16T17:27:41.228632] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T17:27:41.542889] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-16T17:27:41.769938] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:27:42.342873] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-16T17:27:43.101462] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:27:43.142797] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-16T17:27:43.413882] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-16T17:27:43.833827] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:27:43.942856] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-16T17:27:44.563968] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:27:44.742843] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-16T17:27:45.421129] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:27:45.542867] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-16T17:27:46.186058] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T17:27:46.342837] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-16T17:27:47.048228] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:27:47.054892] [INFO ] [REMOTE ] BAH: Full fetch complete (75238 records). [2025-10-16T17:27:47.055015] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-16T17:27:47.150094] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-16T17:27:47.454861] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-16T17:27:47.454967] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-16T17:27:47.456169] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-16T17:27:47.456237] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-16T17:27:47.458183] [DEBUG] [LOCAL ] BAH: Trimmed 75238 records to 52097 (keeping 200 days of data) [2025-10-16T17:27:47.821153] [DEBUG] [LOCAL ] BAH: Primary data saved (52097 records). [2025-10-16T17:27:47.821350] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-16T17:27:47.822263] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BAH took 30.7s. Estimated remaining: 4h 51m 13s. Rate: 7.4 symbols/min [2025-10-16T17:27:47.948006] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-16T17:27:48.010667] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:48.080579] [DEBUG] [LOCAL ] BALL: Loaded 51888 existing records from primary storage. [2025-10-16T17:27:48.081092] [INFO ] [MAIN ] BALL: Loaded 51888 existing records. [2025-10-16T17:27:48.277817] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:48.278155] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-16T17:27:48.278206] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-16T17:27:48.278735] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-16T17:27:48.278797] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-16T17:27:48.700481] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:48.743078] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-16T17:27:48.744984] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-16T17:27:48.755525] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T17:27:48.766310] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-16T17:27:48.766741] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-16T17:27:49.185900] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-16T17:27:49.186024] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-16T17:27:49.187237] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-16T17:27:49.187311] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-16T17:27:49.189585] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54198 (keeping 200 days of data) [2025-10-16T17:27:49.544737] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-16T17:27:49.558038] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-16T17:27:49.558264] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-16T17:27:49.558825] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 38.0s. Estimated remaining: 4h 49m 59s. Rate: 7.5 symbols/min [2025-10-16T17:27:49.741505] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:49.741777] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-16T17:27:49.741825] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-16T17:27:49.741959] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-16T17:27:49.742005] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-16T17:27:49.742046] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-16T17:27:49.742079] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-16T17:27:50.184327] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:50.335342] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T17:27:50.345274] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-16T17:27:50.546878] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:27:50.651897] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-16T17:27:51.142864] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-16T17:27:51.203560] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T17:27:51.942817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-16T17:27:52.742789] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-16T17:27:53.016521] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:27:53.542815] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-16T17:27:53.626635] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T17:27:54.296779] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T17:27:54.342776] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-16T17:27:55.151625] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-16T17:27:55.172497] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:27:55.942894] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-16T17:27:56.474591] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:27:56.742752] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-16T17:27:57.142964] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T17:27:57.165010] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-16T17:27:57.174397] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-16T17:27:57.174553] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-16T17:27:57.542798] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-16T17:27:57.596143] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-16T17:27:57.596280] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-16T17:27:57.597362] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-16T17:27:57.597479] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-16T17:27:57.599242] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T17:27:57.728573] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:27:57.974982] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-16T17:27:57.975130] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-16T17:27:57.975211] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BABA took 47.7s. Estimated remaining: 4h 49m 55s. Rate: 7.5 symbols/min [2025-10-16T17:27:58.141318] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:58.194560] [DEBUG] [LOCAL ] BAM: Loaded 52107 existing records from primary storage. [2025-10-16T17:27:58.194900] [INFO ] [MAIN ] BAM: Loaded 52107 existing records. [2025-10-16T17:27:58.351021] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-16T17:27:58.381157] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:27:58.381370] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-16T17:27:58.381435] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-16T17:27:58.381813] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-16T17:27:58.381871] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-16T17:27:58.745809] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:27:58.792371] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:27:58.798421] [INFO ] [REMOTE ] BAK: Full fetch complete (56952 records). [2025-10-16T17:27:58.798610] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-16T17:27:59.154822] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-16T17:27:59.217556] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-16T17:27:59.214428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T17:27:59.218029] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-16T17:27:59.219715] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-16T17:27:59.221328] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-16T17:27:59.223606] [DEBUG] [LOCAL ] BAK: Trimmed 56952 records to 39589 (keeping 200 days of data) [2025-10-16T17:27:59.438978] [DEBUG] [LOCAL ] BAK: Primary data saved (39589 records). [2025-10-16T17:27:59.439142] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-16T17:27:59.439223] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 31.8s. Estimated remaining: 4h 48m 39s. Rate: 7.5 symbols/min [2025-10-16T17:27:59.603557] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:27:59.603758] [DEBUG] [LOCAL ] BANC: No existing data file found in primary storage. [2025-10-16T17:27:59.603803] [WARN ] [MAIN ] BANC: No existing data found, performing full refresh instead. [2025-10-16T17:27:59.603910] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-16T17:27:59.603950] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-16T17:27:59.603990] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-16T17:27:59.604022] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-16T17:27:59.950552] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-16T17:27:59.956792] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:00.742797] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-16T17:28:01.055624] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T17:28:01.421939] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:28:01.542827] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-16T17:28:02.342848] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-16T17:28:02.552913] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:28:02.897022] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:28:03.142814] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-16T17:28:03.861906] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T17:28:03.942811] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-16T17:28:04.742856] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-16T17:28:04.875083] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T17:28:05.542825] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-16T17:28:05.660601] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:28:06.071241] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T17:28:06.342833] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-16T17:28:07.147006] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-16T17:28:07.149982] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T17:28:07.942877] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-16T17:28:08.033333] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:28:08.523867] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:28:08.683830] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T17:28:08.742806] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-16T17:28:09.542863] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-16T17:28:10.342890] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-16T17:28:10.476976] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:28:11.142821] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-16T17:28:11.275213] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T17:28:11.694962] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:28:11.942861] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-16T17:28:12.742805] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-16T17:28:12.902243] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T17:28:13.290153] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T17:28:13.542806] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-16T17:28:14.208084] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:28:14.342823] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-16T17:28:14.970483] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T17:28:15.142785] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-16T17:28:15.228291] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T17:28:15.942851] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-16T17:28:16.742878] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-16T17:28:16.929605] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:28:16.936679] [INFO ] [REMOTE ] BALL: Full fetch complete (75576 records). [2025-10-16T17:28:16.936878] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-16T17:28:17.334953] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-16T17:28:17.335124] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-16T17:28:17.336202] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-16T17:28:17.336287] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-16T17:28:17.337977] [DEBUG] [LOCAL ] BALL: Trimmed 75576 records to 52278 (keeping 200 days of data) [2025-10-16T17:28:17.571719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-16T17:28:17.584296] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:28:17.688107] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T17:28:17.710959] [DEBUG] [LOCAL ] BALL: Primary data saved (52278 records). [2025-10-16T17:28:17.711096] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-16T17:28:17.712043] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALL took 29.9s. Estimated remaining: 4h 50m 16s. Rate: 7.4 symbols/min [2025-10-16T17:28:17.897930] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:17.925799] [DEBUG] [LOCAL ] BAP: Loaded 25781 existing records from primary storage. [2025-10-16T17:28:17.926044] [INFO ] [MAIN ] BAP: Loaded 25781 existing records. [2025-10-16T17:28:18.113300] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:18.113503] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-16T17:28:18.113554] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-16T17:28:18.113817] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-16T17:28:18.113873] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-16T17:28:18.352202] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-16T17:28:18.469275] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:19.142800] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-16T17:28:19.253585] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:28:19.942862] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-16T17:28:20.087731] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:28:20.620220] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T17:28:20.742890] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-16T17:28:21.306183] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:28:21.542886] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-16T17:28:22.342840] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-16T17:28:22.441614] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:28:22.902068] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:28:22.923927] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:28:23.142872] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-16T17:28:23.942860] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-16T17:28:24.586163] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T17:28:24.742849] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-16T17:28:24.876664] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:28:25.496491] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:28:25.542836] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-16T17:28:26.342863] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-16T17:28:27.142793] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-16T17:28:27.335513] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T17:28:27.364914] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T17:28:27.942852] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-16T17:28:28.742792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-16T17:28:28.819511] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T17:28:28.821581] [INFO ] [REMOTE ] BALY: Full fetch complete (16390 records). [2025-10-16T17:28:28.821696] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-16T17:28:29.026681] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T17:28:29.027081] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:28:29.027219] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:28:29.027298] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-16T17:28:29.027379] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-16T17:28:29.027437] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-16T17:28:29.027484] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-16T17:28:29.027553] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BALY took 39.5s. Estimated remaining: 4h 50m 41s. Rate: 7.4 symbols/min [2025-10-16T17:28:29.214818] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:29.235241] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-16T17:28:29.242525] [INFO ] [REMOTE ] BAM: Full fetch complete (75023 records). [2025-10-16T17:28:29.242753] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-16T17:28:29.525344] [DEBUG] [LOCAL ] BARK: Loaded 38160 existing records from primary storage. [2025-10-16T17:28:29.579003] [INFO ] [MAIN ] BARK: Loaded 38160 existing records. [2025-10-16T17:28:29.557813] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-16T17:28:29.790088] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-16T17:28:29.790563] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-16T17:28:29.812208] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-16T17:28:29.830122] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-16T17:28:29.870503] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:29.884599] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-16T17:28:29.884930] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-16T17:28:29.885981] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:28:29.890871] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-16T17:28:29.891246] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-16T17:28:29.912304] [DEBUG] [LOCAL ] BAM: Trimmed 75023 records to 52489 (keeping 200 days of data) [2025-10-16T17:28:30.366317] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-16T17:28:30.493016] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:30.588072] [DEBUG] [LOCAL ] BAM: Primary data saved (52489 records). [2025-10-16T17:28:30.588204] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-16T17:28:30.588283] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BAM took 32.6s. Estimated remaining: 4h 49m 27s. Rate: 7.5 symbols/min [2025-10-16T17:28:30.752839] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:30.802102] [DEBUG] [LOCAL ] BAX: Loaded 53529 existing records from primary storage. [2025-10-16T17:28:30.802402] [INFO ] [MAIN ] BAX: Loaded 53529 existing records. [2025-10-16T17:28:30.976934] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:30.977131] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-16T17:28:30.977177] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-16T17:28:30.977611] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-16T17:28:30.977702] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-16T17:28:31.150417] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-16T17:28:31.352706] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:31.843386] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T17:28:31.924417] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-16T17:28:31.931462] [INFO ] [REMOTE ] BANC: Full fetch complete (74544 records). [2025-10-16T17:28:31.931630] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-16T17:28:31.952556] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-16T17:28:32.320620] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-16T17:28:32.320789] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-16T17:28:32.321633] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-16T17:28:32.321809] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-16T17:28:32.323594] [DEBUG] [LOCAL ] BANC: Trimmed 74544 records to 51734 (keeping 200 days of data) [2025-10-16T17:28:32.348791] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:28:32.664024] [DEBUG] [LOCAL ] BANC: Primary data saved (51734 records). [2025-10-16T17:28:32.664191] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-16T17:28:32.664285] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BANC took 33.2s. Estimated remaining: 4h 48m 18s. Rate: 7.5 symbols/min [2025-10-16T17:28:32.747939] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-16T17:28:32.835735] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:32.882999] [DEBUG] [LOCAL ] BB: Loaded 52914 existing records from primary storage. [2025-10-16T17:28:32.883325] [INFO ] [MAIN ] BB: Loaded 52914 existing records. [2025-10-16T17:28:33.059721] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:33.059976] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-16T17:28:33.060024] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-16T17:28:33.060330] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-16T17:28:33.060369] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-16T17:28:33.423556] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:33.440983] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:28:33.542799] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-16T17:28:34.291184] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:28:34.342891] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-16T17:28:35.142837] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-16T17:28:35.728875] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-16T17:28:35.845019] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:28:35.942870] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-16T17:28:36.026041] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:28:36.742839] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-16T17:28:37.194266] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T17:28:37.542786] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-16T17:28:37.846230] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:28:38.342810] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-16T17:28:39.142786] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-16T17:28:39.552559] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T17:28:39.942857] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-16T17:28:40.021279] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:28:40.148521] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:28:40.742802] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-16T17:28:40.799987] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:28:41.542826] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-16T17:28:42.342814] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-16T17:28:42.506398] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T17:28:42.938440] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T17:28:43.142893] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-16T17:28:43.756736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T17:28:43.942844] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-16T17:28:44.742839] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-16T17:28:45.031000] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:28:45.076322] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T17:28:45.542814] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-16T17:28:46.342793] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-16T17:28:46.750321] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T17:28:47.006500] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:28:47.142864] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-16T17:28:47.826845] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:28:47.942802] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-16T17:28:48.742857] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-16T17:28:49.050616] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T17:28:49.267208] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:28:49.542914] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-16T17:28:49.688217] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:28:50.342894] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-16T17:28:50.936730] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:28:51.142885] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-16T17:28:51.531236] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:28:51.536119] [INFO ] [REMOTE ] BAP: Full fetch complete (37481 records). [2025-10-16T17:28:51.536230] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-16T17:28:51.913553] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-16T17:28:51.913665] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-16T17:28:51.914150] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-16T17:28:51.914192] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-16T17:28:51.915002] [DEBUG] [LOCAL ] BAP: Trimmed 37481 records to 25985 (keeping 200 days of data) [2025-10-16T17:28:51.967616] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-16T17:28:52.079318] [DEBUG] [LOCAL ] BAP: Primary data saved (25985 records). [2025-10-16T17:28:52.079475] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-16T17:28:52.079560] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BAP took 34.4s. Estimated remaining: 4h 50m 5s. Rate: 7.4 symbols/min [2025-10-16T17:28:52.250778] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:28:52.307008] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-16T17:28:52.307373] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-16T17:28:52.482258] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:28:52.482459] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-16T17:28:52.482506] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-16T17:28:52.482755] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-16T17:28:52.482811] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-16T17:28:52.748742] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-16T17:28:52.841081] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:28:53.211901] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T17:28:53.542867] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-16T17:28:53.851088] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T17:28:54.128393] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T17:28:54.342831] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-16T17:28:55.142862] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-16T17:28:55.579277] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T17:28:55.942870] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-16T17:28:56.560982] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:28:56.742799] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-16T17:28:57.092534] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-16T17:28:57.542881] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-16T17:28:57.769915] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T17:28:58.342881] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-16T17:28:58.714017] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T17:28:59.142855] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-16T17:28:59.947924] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-16T17:28:59.967149] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T17:29:00.022762] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-16T17:29:00.347373] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:29:00.352518] [INFO ] [REMOTE ] BARK: Full fetch complete (56259 records). [2025-10-16T17:29:00.352720] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-16T17:29:00.734917] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-16T17:29:00.735002] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-16T17:29:00.735688] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-16T17:29:00.735750] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-16T17:29:00.737007] [DEBUG] [LOCAL ] BARK: Trimmed 56259 records to 38444 (keeping 200 days of data) [2025-10-16T17:29:00.782948] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-16T17:29:00.968929] [DEBUG] [LOCAL ] BARK: Primary data saved (38444 records). [2025-10-16T17:29:00.969117] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-16T17:29:00.969637] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 31.9s. Estimated remaining: 4h 50m 5s. Rate: 7.4 symbols/min [2025-10-16T17:29:01.134351] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:01.175875] [DEBUG] [LOCAL ] BBAR: Loaded 42354 existing records from primary storage. [2025-10-16T17:29:01.176153] [INFO ] [MAIN ] BBAR: Loaded 42354 existing records. [2025-10-16T17:29:01.349381] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:01.349618] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-16T17:29:01.349693] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-16T17:29:01.349893] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-16T17:29:01.349932] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-16T17:29:01.551093] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-16T17:29:01.718793] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:01.889637] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T17:29:02.342817] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-16T17:29:03.142901] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-16T17:29:03.365019] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-16T17:29:03.381152] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T17:29:03.942849] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-16T17:29:04.491046] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:29:04.500894] [INFO ] [REMOTE ] BB: Full fetch complete (77004 records). [2025-10-16T17:29:04.501063] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-16T17:29:04.754159] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-16T17:29:04.935868] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-16T17:29:04.936051] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-16T17:29:04.936942] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-16T17:29:04.937140] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-16T17:29:04.961686] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:29:04.970229] [DEBUG] [LOCAL ] BB: Trimmed 77004 records to 53298 (keeping 200 days of data) [2025-10-16T17:29:05.268979] [DEBUG] [LOCAL ] BB: Primary data saved (53298 records). [2025-10-16T17:29:05.269133] [INFO ] [MAIN ] BB: Full history saved. [2025-10-16T17:29:05.269774] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BB took 32.6s. Estimated remaining: 4h 49m 19s. Rate: 7.4 symbols/min [2025-10-16T17:29:05.440159] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:05.494514] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-16T17:29:05.494849] [INFO ] [MAIN ] BBD: Loaded 53260 existing records. [2025-10-16T17:29:05.559351] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-16T17:29:05.674535] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:05.674766] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-16T17:29:05.674819] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-16T17:29:05.675184] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-16T17:29:05.675243] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-16T17:29:06.025984] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:06.256360] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T17:29:06.342822] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-16T17:29:06.652072] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T17:29:06.832197] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:29:07.142807] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-16T17:29:07.942889] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-16T17:29:08.625445] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:29:08.745462] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-16T17:29:08.748732] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-16T17:29:09.418861] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:29:09.542849] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-16T17:29:10.245516] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T17:29:10.342819] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-16T17:29:11.142819] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-16T17:29:11.453783] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T17:29:11.882049] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:29:11.942810] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-16T17:29:12.742774] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-16T17:29:12.830358] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:29:12.837337] [INFO ] [REMOTE ] BAX: Full fetch complete (77613 records). [2025-10-16T17:29:12.837453] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-16T17:29:13.242575] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-16T17:29:13.242715] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-16T17:29:13.243711] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-16T17:29:13.243794] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-16T17:29:13.267175] [DEBUG] [LOCAL ] BAX: Trimmed 77613 records to 53919 (keeping 200 days of data) [2025-10-16T17:29:13.269086] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:29:13.549757] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-16T17:29:13.598292] [DEBUG] [LOCAL ] BAX: Primary data saved (53919 records). [2025-10-16T17:29:13.598395] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-16T17:29:13.598467] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BAX took 43.0s. Estimated remaining: 4h 49m 14s. Rate: 7.4 symbols/min [2025-10-16T17:29:13.767162] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:13.797455] [DEBUG] [LOCAL ] BBDC: Loaded 33095 existing records from primary storage. [2025-10-16T17:29:13.797764] [INFO ] [MAIN ] BBDC: Loaded 33095 existing records. [2025-10-16T17:29:13.970356] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:13.970573] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-16T17:29:13.970623] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-16T17:29:13.970835] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-16T17:29:13.970882] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-16T17:29:14.341224] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:14.351735] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-16T17:29:14.372741] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:29:14.827257] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T17:29:15.142862] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-16T17:29:15.920969] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:29:15.942769] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-16T17:29:16.451757] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:29:16.742812] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-16T17:29:17.285787] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T17:29:17.542814] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-16T17:29:17.980526] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T17:29:18.342821] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-16T17:29:18.419081] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:29:19.142828] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-16T17:29:19.942778] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-16T17:29:20.136708] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:29:20.273402] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T17:29:20.742884] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-16T17:29:20.831517] [DEBUG] [REMOTE ] BBDC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-16T17:29:20.831874] [WARN ] [REMOTE ] BBDC: No data returned for month 2025-04 [2025-10-16T17:29:20.831963] [FATAL] [REMOTE ] BBDC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:29:20.832058] [FATAL] [MAIN ] BBDC: Failed to fetch primary data. [2025-10-16T17:29:20.832127] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:29:20.832199] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-16T17:29:20.832299] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-16T17:29:20.832342] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-10-16T17:29:20.832483] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-10-16T17:29:20.832564] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBDC took 7.2s. Estimated remaining: 4h 48m 58s. Rate: 7.4 symbols/min [2025-10-16T17:29:21.018486] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:21.025316] [DEBUG] [LOCAL ] BBDO: Loaded 5027 existing records from primary storage. [2025-10-16T17:29:21.025505] [INFO ] [MAIN ] BBDO: Loaded 5027 existing records. [2025-10-16T17:29:21.227846] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:21.228280] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-16T17:29:21.228357] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-16T17:29:21.236782] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-16T17:29:21.251428] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-16T17:29:21.286486] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:29:21.547994] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-16T17:29:21.639149] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:22.342896] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-16T17:29:23.151211] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-16T17:29:23.157402] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:29:23.294258] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:29:23.942864] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-16T17:29:24.742886] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-16T17:29:25.350440] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T17:29:25.467892] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:29:25.525042] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-16T17:29:25.542764] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-16T17:29:26.342826] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-16T17:29:27.142856] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-16T17:29:27.858517] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T17:29:27.942841] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-16T17:29:28.026386] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:29:28.033321] [INFO ] [REMOTE ] BBAR: Full fetch complete (61319 records). [2025-10-16T17:29:28.033501] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-16T17:29:28.455426] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-16T17:29:28.455535] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-16T17:29:28.456362] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-16T17:29:28.456559] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-16T17:29:28.458245] [DEBUG] [LOCAL ] BBAR: Trimmed 61319 records to 42696 (keeping 200 days of data) [2025-10-16T17:29:28.577624] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:29:28.748580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-16T17:29:28.756516] [DEBUG] [LOCAL ] BBAR: Primary data saved (42696 records). [2025-10-16T17:29:28.757529] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-16T17:29:28.757924] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAR took 27.8s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-16T17:29:28.926615] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:28.926811] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-16T17:29:28.926853] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-16T17:29:28.926959] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-16T17:29:28.926999] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-16T17:29:28.927039] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-16T17:29:28.927095] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-16T17:29:29.274508] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:29.542832] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-16T17:29:30.121998] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T17:29:30.342880] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-16T17:29:30.452427] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:29:30.528621] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-16T17:29:30.756458] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T17:29:31.142826] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-16T17:29:31.942786] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-16T17:29:32.593146] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:29:32.742821] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-16T17:29:33.233546] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T17:29:33.542878] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-16T17:29:34.342853] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-16T17:29:34.525158] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T17:29:34.644854] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T17:29:35.142780] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-16T17:29:35.257118] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:29:35.942833] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-16T17:29:36.742788] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-16T17:29:36.972783] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T17:29:37.409207] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:29:37.542849] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-16T17:29:38.342846] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-16T17:29:38.440367] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T17:29:38.877174] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-16T17:29:38.944193] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:29:39.142822] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-16T17:29:39.942873] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-16T17:29:40.632371] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:29:40.639290] [INFO ] [REMOTE ] BBD: Full fetch complete (77277 records). [2025-10-16T17:29:40.639419] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-16T17:29:40.747999] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-16T17:29:41.035004] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-16T17:29:41.035112] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-16T17:29:41.035993] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-16T17:29:41.036060] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-16T17:29:41.037632] [DEBUG] [LOCAL ] BBD: Trimmed 77277 records to 53650 (keeping 200 days of data) [2025-10-16T17:29:41.353265] [DEBUG] [LOCAL ] BBD: Primary data saved (53650 records). [2025-10-16T17:29:41.353490] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-16T17:29:41.354064] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 36.1s. Estimated remaining: 4h 49m 25s. Rate: 7.4 symbols/min [2025-10-16T17:29:41.508971] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:29:41.525284] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:41.527309] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-16T17:29:41.527352] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-16T17:29:41.527455] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-16T17:29:41.527495] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-16T17:29:41.527536] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-16T17:29:41.527567] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-16T17:29:41.547887] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-16T17:29:41.876916] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:42.115792] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:29:42.342786] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-16T17:29:42.583592] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-16T17:29:43.109402] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:29:43.142786] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-16T17:29:43.942919] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-16T17:29:44.131320] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:29:44.131746] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-16T17:29:44.131853] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:29:44.131944] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-16T17:29:44.132027] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:29:44.132119] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-16T17:29:44.132223] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-16T17:29:44.132277] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-16T17:29:44.132321] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-16T17:29:44.132366] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBT took 2.8s. Estimated remaining: 4h 48m 25s. Rate: 7.4 symbols/min [2025-10-16T17:29:44.318407] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:44.318622] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-16T17:29:44.318699] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-16T17:29:44.318822] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-16T17:29:44.318879] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-16T17:29:44.318988] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-16T17:29:44.319046] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-16T17:29:44.704792] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:44.742844] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-16T17:29:45.407074] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T17:29:45.542845] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-16T17:29:46.024273] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-16T17:29:46.031272] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-16T17:29:46.031417] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-16T17:29:46.344165] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-16T17:29:46.431037] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T17:29:46.459170] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-16T17:29:46.460712] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-16T17:29:46.461661] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-16T17:29:46.461734] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-16T17:29:46.463348] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T17:29:46.769476] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-16T17:29:46.769604] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-16T17:29:46.770566] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBAI took 54.7s. Estimated remaining: 4h 47m 25s. Rate: 7.5 symbols/min [2025-10-16T17:29:46.937094] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:46.937243] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-16T17:29:46.937281] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-16T17:29:46.937390] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-16T17:29:46.937448] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-16T17:29:46.937491] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-16T17:29:46.937525] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-16T17:29:47.149719] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-16T17:29:47.226090] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:29:47.319279] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:47.942866] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-16T17:29:48.228902] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:29:48.355326] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T17:29:48.742825] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-16T17:29:49.542794] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-16T17:29:49.790912] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T17:29:50.342829] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-16T17:29:50.401742] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T17:29:51.142876] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-16T17:29:51.366899] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T17:29:51.942892] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-16T17:29:51.997223] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T17:29:52.524160] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T17:29:52.742867] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-16T17:29:53.542827] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-16T17:29:53.715194] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T17:29:53.716739] [INFO ] [REMOTE ] BBDO: Full fetch complete (7489 records). [2025-10-16T17:29:53.716836] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-16T17:29:54.107017] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-16T17:29:54.107109] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-16T17:29:54.107318] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-16T17:29:54.107358] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-16T17:29:54.107871] [DEBUG] [LOCAL ] BBDO: Trimmed 7489 records to 5066 (keeping 200 days of data) [2025-10-16T17:29:54.137459] [DEBUG] [LOCAL ] BBDO: Primary data saved (5066 records). [2025-10-16T17:29:54.137602] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-16T17:29:54.137703] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBDO took 33.3s. Estimated remaining: 4h 47m 10s. Rate: 7.5 symbols/min [2025-10-16T17:29:54.309028] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:54.352535] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-16T17:29:54.355474] [DEBUG] [LOCAL ] BBVA: Loaded 49092 existing records from primary storage. [2025-10-16T17:29:54.355884] [INFO ] [MAIN ] BBVA: Loaded 49092 existing records. [2025-10-16T17:29:54.533254] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:29:54.533444] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-16T17:29:54.533490] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-16T17:29:54.533921] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-16T17:29:54.533988] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-16T17:29:54.717313] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T17:29:54.911292] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:54.982927] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T17:29:55.142785] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-16T17:29:55.942886] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-16T17:29:56.714542] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T17:29:56.742797] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-16T17:29:56.994705] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:29:57.508522] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:29:57.542822] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-16T17:29:58.342835] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-16T17:29:58.636633] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T17:29:58.639165] [INFO ] [REMOTE ] BBN: Full fetch complete (25527 records). [2025-10-16T17:29:58.639243] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-16T17:29:58.994858] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-16T17:29:58.994957] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-16T17:29:58.995377] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-16T17:29:58.995437] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-16T17:29:58.996449] [DEBUG] [LOCAL ] BBN: Trimmed 25527 records to 18148 (keeping 200 days of data) [2025-10-16T17:29:59.104214] [DEBUG] [LOCAL ] BBN: Primary data saved (18148 records). [2025-10-16T17:29:59.104349] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-16T17:29:59.104418] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 30.3s. Estimated remaining: 4h 46m 33s. Rate: 7.5 symbols/min [2025-10-16T17:29:59.148046] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-16T17:29:59.273665] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:29:59.273921] [DEBUG] [LOCAL ] BBW: No existing data file found in primary storage. [2025-10-16T17:29:59.273974] [WARN ] [MAIN ] BBW: No existing data found, performing full refresh instead. [2025-10-16T17:29:59.274142] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-16T17:29:59.274265] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-16T17:29:59.274321] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-16T17:29:59.274354] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-16T17:29:59.480593] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:29:59.664407] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:29:59.942789] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-16T17:30:00.566602] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T17:30:00.742783] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-16T17:30:00.850870] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:30:01.542795] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-16T17:30:01.599006] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:30:02.342836] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-16T17:30:03.142835] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-16T17:30:03.250486] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T17:30:03.286082] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:30:03.689925] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T17:30:03.942808] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-16T17:30:04.742816] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-16T17:30:04.768207] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T17:30:05.542832] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-16T17:30:06.342794] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-16T17:30:06.404726] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T17:30:06.513152] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T17:30:07.142854] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-16T17:30:07.270536] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:30:07.603017] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T17:30:07.942899] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-16T17:30:08.443284] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:30:08.742827] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-16T17:30:09.374771] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T17:30:09.542835] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-16T17:30:10.342847] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-16T17:30:10.439090] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:30:11.142865] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-16T17:30:11.880814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T17:30:11.942807] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-16T17:30:12.026723] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:30:12.617292] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T17:30:12.742837] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-16T17:30:13.542820] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-16T17:30:13.759077] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T17:30:13.762291] [INFO ] [REMOTE ] BBUC: Full fetch complete (19033 records). [2025-10-16T17:30:13.762389] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-16T17:30:14.129515] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-16T17:30:14.129601] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-16T17:30:14.129991] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-16T17:30:14.130053] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-16T17:30:14.130633] [DEBUG] [LOCAL ] BBUC: Trimmed 19033 records to 13949 (keeping 200 days of data) [2025-10-16T17:30:14.214467] [DEBUG] [LOCAL ] BBUC: Primary data saved (13949 records). [2025-10-16T17:30:14.214670] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-16T17:30:14.214765] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBUC took 27.4s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-16T17:30:14.355507] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-16T17:30:14.392534] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:14.453959] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-16T17:30:14.454284] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-16T17:30:14.594847] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:30:14.622795] [INFO ] [REMOTE ] BBU: Full fetch complete (7334 records). [2025-10-16T17:30:14.642298] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-16T17:30:14.661570] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:30:14.685518] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:14.685602] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:30:14.685790] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-16T17:30:14.685918] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-16T17:30:14.685841] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:30:14.686076] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-16T17:30:14.686143] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-16T17:30:14.686181] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-16T17:30:14.686219] [DEBUG] [LOCAL ] BBU: No derivative data file found to delete. [2025-10-16T17:30:14.686247] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-16T17:30:14.686350] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-16T17:30:14.686451] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBU took 30.6s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-16T17:30:15.030032] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:15.144372] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-16T17:30:15.234498] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:15.268878] [DEBUG] [LOCAL ] BBY: Loaded 53445 existing records from primary storage. [2025-10-16T17:30:15.269230] [INFO ] [MAIN ] BBY: Loaded 53445 existing records. [2025-10-16T17:30:15.444162] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:15.444368] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-16T17:30:15.444414] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-16T17:30:15.444673] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-16T17:30:15.444732] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-16T17:30:15.793832] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:15.906251] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T17:30:15.942771] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-16T17:30:16.662559] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:30:16.742827] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-16T17:30:17.547897] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-16T17:30:17.565898] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T17:30:17.892123] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T17:30:18.342821] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-16T17:30:19.012139] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:30:19.142836] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-16T17:30:19.664361] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:30:19.942886] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-16T17:30:20.298769] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T17:30:20.742819] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-16T17:30:20.762222] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:30:21.542869] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-16T17:30:22.342854] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-16T17:30:22.814606] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T17:30:23.142853] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-16T17:30:23.409004] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:30:23.957291] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-16T17:30:23.968259] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:30:24.742853] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-16T17:30:24.810905] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T17:30:25.542865] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-16T17:30:25.647838] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:30:26.342862] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-16T17:30:26.475026] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:30:27.142828] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-16T17:30:27.232477] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:30:27.942829] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-16T17:30:27.994437] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T17:30:28.259426] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:30:28.742837] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-16T17:30:29.542839] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-16T17:30:29.684560] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:30:29.863459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T17:30:30.342817] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-16T17:30:31.099245] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T17:30:31.142829] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-16T17:30:31.942805] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-16T17:30:32.053897] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:30:32.742819] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-16T17:30:32.929943] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:30:33.542793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-16T17:30:33.628727] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:30:34.342834] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-16T17:30:34.561166] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:30:34.567757] [INFO ] [REMOTE ] BBVA: Full fetch complete (71777 records). [2025-10-16T17:30:34.567928] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-16T17:30:34.955491] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-16T17:30:34.955586] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-16T17:30:34.956369] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-16T17:30:34.956434] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-16T17:30:34.957866] [DEBUG] [LOCAL ] BBVA: Trimmed 71777 records to 49475 (keeping 200 days of data) [2025-10-16T17:30:35.159595] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-16T17:30:35.271035] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:30:35.300048] [DEBUG] [LOCAL ] BBVA: Primary data saved (49475 records). [2025-10-16T17:30:35.300196] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-16T17:30:35.300306] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBVA took 41.2s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-16T17:30:35.469911] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:35.508765] [DEBUG] [LOCAL ] BC: Loaded 44083 existing records from primary storage. [2025-10-16T17:30:35.509126] [INFO ] [MAIN ] BC: Loaded 44083 existing records. [2025-10-16T17:30:35.700530] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:30:35.705134] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:35.710698] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-16T17:30:35.711206] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-16T17:30:35.711742] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-16T17:30:35.711811] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-16T17:30:35.948063] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-16T17:30:36.065584] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:36.742848] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-16T17:30:36.796042] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T17:30:37.297552] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:30:37.542909] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-16T17:30:38.251027] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:30:38.342846] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-16T17:30:39.142876] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-16T17:30:39.365336] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:30:39.702875] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T17:30:39.942858] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-16T17:30:40.736340] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:30:40.747589] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-16T17:30:41.475666] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:30:41.542831] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-16T17:30:42.342830] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-16T17:30:42.567979] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:30:42.717076] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T17:30:42.722689] [INFO ] [REMOTE ] BBW: Full fetch complete (39791 records). [2025-10-16T17:30:42.722847] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-16T17:30:43.139870] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-16T17:30:43.140008] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-16T17:30:43.140865] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-16T17:30:43.140937] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-16T17:30:43.142419] [DEBUG] [LOCAL ] BBW: Trimmed 39791 records to 27636 (keeping 200 days of data) [2025-10-16T17:30:43.142996] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-16T17:30:43.310883] [DEBUG] [LOCAL ] BBW: Primary data saved (27636 records). [2025-10-16T17:30:43.311035] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-16T17:30:43.311112] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBW took 44.2s. Estimated remaining: 4h 47m 55s. Rate: 7.4 symbols/min [2025-10-16T17:30:43.475359] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:43.510993] [DEBUG] [LOCAL ] BCAT: Loaded 34198 existing records from primary storage. [2025-10-16T17:30:43.511299] [INFO ] [MAIN ] BCAT: Loaded 34198 existing records. [2025-10-16T17:30:43.688393] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:43.688772] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-16T17:30:43.689017] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-16T17:30:43.689281] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-16T17:30:43.689449] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-16T17:30:43.947931] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-16T17:30:44.060948] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:30:44.086149] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:44.742790] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-16T17:30:45.166587] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-16T17:30:45.542873] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-16T17:30:45.573871] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T17:30:45.839899] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:30:46.342826] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-16T17:30:47.142816] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-16T17:30:47.269690] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:30:47.276595] [INFO ] [REMOTE ] BBWI: Full fetch complete (77626 records). [2025-10-16T17:30:47.276749] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-16T17:30:47.671416] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-16T17:30:47.671566] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-16T17:30:47.672439] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-16T17:30:47.672552] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-16T17:30:47.674029] [DEBUG] [LOCAL ] BBWI: Trimmed 77626 records to 53974 (keeping 200 days of data) [2025-10-16T17:30:47.914364] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:30:47.944445] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-16T17:30:48.039023] [DEBUG] [LOCAL ] BBWI: Primary data saved (53974 records). [2025-10-16T17:30:48.039187] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-16T17:30:48.040052] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 33.8s. Estimated remaining: 4h 47m 15s. Rate: 7.4 symbols/min [2025-10-16T17:30:48.206106] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:48.236769] [DEBUG] [LOCAL ] BCC: Loaded 28504 existing records from primary storage. [2025-10-16T17:30:48.237036] [INFO ] [MAIN ] BCC: Loaded 28504 existing records. [2025-10-16T17:30:48.410756] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:48.411004] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-16T17:30:48.411075] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-16T17:30:48.411346] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-16T17:30:48.411384] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-16T17:30:48.743795] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-16T17:30:48.766194] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:49.241120] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T17:30:49.248308] [INFO ] [REMOTE ] BBY: Full fetch complete (77394 records). [2025-10-16T17:30:49.248482] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-16T17:30:49.543482] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-16T17:30:49.672132] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-16T17:30:49.672359] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-16T17:30:49.673367] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-16T17:30:49.673588] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-16T17:30:49.675634] [DEBUG] [LOCAL ] BBY: Trimmed 77394 records to 53831 (keeping 200 days of data) [2025-10-16T17:30:49.700836] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T17:30:49.848928] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T17:30:50.074619] [DEBUG] [LOCAL ] BBY: Primary data saved (53831 records). [2025-10-16T17:30:50.074805] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-16T17:30:50.074890] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 35.4s. Estimated remaining: 4h 46m 11s. Rate: 7.5 symbols/min [2025-10-16T17:30:50.257373] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:30:50.306778] [DEBUG] [LOCAL ] BCE: Loaded 52247 existing records from primary storage. [2025-10-16T17:30:50.307114] [INFO ] [MAIN ] BCE: Loaded 52247 existing records. [2025-10-16T17:30:50.349624] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-16T17:30:50.493114] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:30:50.493408] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-16T17:30:50.493473] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-16T17:30:50.493934] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-16T17:30:50.493993] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-16T17:30:50.820500] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:30:50.876580] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:30:51.142861] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-16T17:30:51.827738] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:30:51.942824] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-16T17:30:52.607943] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:30:52.742823] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-16T17:30:53.332382] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:30:53.542809] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-16T17:30:54.342827] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-16T17:30:54.662366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:30:54.751572] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T17:30:55.142813] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-16T17:30:55.528215] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T17:30:55.942836] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-16T17:30:56.641026] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T17:30:56.742839] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-16T17:30:57.360026] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:30:57.542822] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-16T17:30:58.342776] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-16T17:30:58.408349] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T17:30:58.809681] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T17:30:59.142813] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-16T17:30:59.792122] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:30:59.942810] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-16T17:31:00.188110] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T17:31:00.742813] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-16T17:31:00.988341] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:31:01.542815] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-16T17:31:02.288888] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:31:02.342822] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-16T17:31:03.085095] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:31:03.142819] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-16T17:31:03.795713] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:31:03.942863] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-16T17:31:04.675042] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:31:04.742846] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-16T17:31:04.990280] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-16T17:31:05.542895] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-16T17:31:06.333398] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:31:06.342819] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-16T17:31:06.922154] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T17:31:07.142847] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-16T17:31:07.861247] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:31:07.942839] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-16T17:31:08.484149] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T17:31:08.742881] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-16T17:31:09.038103] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:31:09.042970] [INFO ] [REMOTE ] BC: Full fetch complete (63466 records). [2025-10-16T17:31:09.043068] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-16T17:31:09.043752] [FATAL] [VALIDATOR ] BC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:31:09.043835] [FATAL] [MAIN ] BC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:31:09.043880] [WARN ] [MAIN ] BC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:31:09.043967] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-16T17:31:09.044047] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-16T17:31:09.044096] [INFO ] [LOCAL ] BC: Starting deletion of derivative data. [2025-10-16T17:31:09.044382] [DEBUG] [LOCAL ] BC: Deleted derivative data file. [2025-10-16T17:31:09.044493] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 33.7s. Estimated remaining: 4h 47m 45s. Rate: 7.4 symbols/min [2025-10-16T17:31:09.210338] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:09.210510] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-16T17:31:09.210547] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-16T17:31:09.210682] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-16T17:31:09.210736] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-16T17:31:09.210790] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-16T17:31:09.210856] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-16T17:31:09.551154] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-16T17:31:09.555759] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:10.296160] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:31:10.300715] [INFO ] [REMOTE ] BCAT: Full fetch complete (50000 records). [2025-10-16T17:31:10.300823] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-16T17:31:10.348067] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-16T17:31:10.732231] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-16T17:31:10.732323] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-16T17:31:10.732929] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-16T17:31:10.732994] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-16T17:31:10.734167] [DEBUG] [LOCAL ] BCAT: Trimmed 50000 records to 34487 (keeping 200 days of data) [2025-10-16T17:31:10.935097] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T17:31:10.966226] [DEBUG] [LOCAL ] BCAT: Primary data saved (34487 records). [2025-10-16T17:31:10.966377] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-16T17:31:10.966786] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 27.7s. Estimated remaining: 4h 46m 40s. Rate: 7.5 symbols/min [2025-10-16T17:31:11.144465] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:11.142846] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-16T17:31:11.171534] [DEBUG] [LOCAL ] BCO: Loaded 25461 existing records from primary storage. [2025-10-16T17:31:11.171829] [INFO ] [MAIN ] BCO: Loaded 25461 existing records. [2025-10-16T17:31:11.347744] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:11.347990] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-16T17:31:11.348036] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-16T17:31:11.348269] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-16T17:31:11.348326] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-16T17:31:11.698462] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:11.942856] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-16T17:31:12.519949] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T17:31:12.710348] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:31:12.743057] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-16T17:31:12.742963] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T17:31:13.542845] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-16T17:31:14.342870] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-16T17:31:14.444898] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:31:14.494397] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:31:15.142789] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-16T17:31:15.231538] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T17:31:15.942820] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-16T17:31:16.742843] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-16T17:31:16.947922] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:31:17.330084] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:31:17.450142] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T17:31:17.542862] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-16T17:31:18.342780] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-16T17:31:18.508221] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T17:31:19.142814] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-16T17:31:19.588316] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T17:31:19.942826] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-16T17:31:20.570923] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:31:20.742857] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-16T17:31:21.262987] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:31:21.267591] [INFO ] [REMOTE ] BCC: Full fetch complete (41282 records). [2025-10-16T17:31:21.267772] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-16T17:31:21.544272] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-16T17:31:21.686594] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-16T17:31:21.686719] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-16T17:31:21.687331] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-16T17:31:21.687409] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-16T17:31:21.688592] [DEBUG] [LOCAL ] BCC: Trimmed 41282 records to 28737 (keeping 200 days of data) [2025-10-16T17:31:21.796016] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:31:21.889761] [DEBUG] [LOCAL ] BCC: Primary data saved (28737 records). [2025-10-16T17:31:21.889906] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-16T17:31:21.889992] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 33.8s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-16T17:31:22.058686] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:22.111015] [DEBUG] [LOCAL ] BCS: Loaded 53442 existing records from primary storage. [2025-10-16T17:31:22.111354] [INFO ] [MAIN ] BCS: Loaded 53442 existing records. [2025-10-16T17:31:22.296015] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:22.296254] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-16T17:31:22.296301] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-16T17:31:22.296485] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-16T17:31:22.296524] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-16T17:31:22.351265] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-16T17:31:22.671895] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:23.142898] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-16T17:31:23.334448] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:31:23.469168] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:31:23.942856] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-16T17:31:24.742836] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-16T17:31:25.087087] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:31:25.542825] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-16T17:31:25.791860] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:31:25.877805] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:31:26.342838] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-16T17:31:26.733056] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:31:27.142855] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-16T17:31:27.931366] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:31:27.942809] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-16T17:31:28.175744] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:31:28.742828] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-16T17:31:28.917111] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:31:29.542831] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-16T17:31:30.342822] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-16T17:31:30.552043] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T17:31:30.837201] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:31:31.048335] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T17:31:31.142821] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-16T17:31:31.942806] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-16T17:31:32.742848] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-16T17:31:33.039820] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:31:33.042489] [INFO ] [REMOTE ] BCO: Full fetch complete (36259 records). [2025-10-16T17:31:33.042568] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-16T17:31:33.203351] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:31:33.455800] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-16T17:31:33.455875] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-16T17:31:33.456406] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-16T17:31:33.456451] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-16T17:31:33.457289] [DEBUG] [LOCAL ] BCO: Trimmed 36259 records to 25583 (keeping 200 days of data) [2025-10-16T17:31:33.547104] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-16T17:31:33.613715] [DEBUG] [LOCAL ] BCO: Primary data saved (25583 records). [2025-10-16T17:31:33.613852] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-16T17:31:33.613947] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCO took 22.6s. Estimated remaining: 4h 47m 24s. Rate: 7.4 symbols/min [2025-10-16T17:31:33.785966] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:33.807848] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:31:33.837368] [DEBUG] [LOCAL ] BCSF: Loaded 28156 existing records from primary storage. [2025-10-16T17:31:33.837676] [INFO ] [MAIN ] BCSF: Loaded 28156 existing records. [2025-10-16T17:31:34.011632] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:34.011846] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-16T17:31:34.011893] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-16T17:31:34.012085] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-16T17:31:34.012124] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-16T17:31:34.343312] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-16T17:31:34.365259] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:35.008141] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:31:35.142839] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-16T17:31:35.942833] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-16T17:31:36.282348] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T17:31:36.470141] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:31:36.742868] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-16T17:31:37.269011] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:31:37.542857] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-16T17:31:38.342838] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-16T17:31:38.710907] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:31:38.740209] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T17:31:39.142837] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-16T17:31:39.942833] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-16T17:31:40.086090] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T17:31:40.119565] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:31:40.679489] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:31:40.742828] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-16T17:31:41.542842] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-16T17:31:42.331912] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:31:42.343092] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-16T17:31:43.142804] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-16T17:31:43.294145] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:31:43.301816] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-16T17:31:43.302023] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-16T17:31:43.714917] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-16T17:31:43.725207] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-16T17:31:43.726402] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-16T17:31:43.726488] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-16T17:31:43.728175] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:31:43.736204] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 52634 (keeping 200 days of data) [2025-10-16T17:31:43.949302] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-16T17:31:44.064434] [DEBUG] [LOCAL ] BCE: Primary data saved (52634 records). [2025-10-16T17:31:44.064611] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-16T17:31:44.065342] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCE took 54.0s. Estimated remaining: 4h 47m 37s. Rate: 7.4 symbols/min [2025-10-16T17:31:44.233988] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:44.253433] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T17:31:44.278227] [DEBUG] [LOCAL ] BCX: Loaded 22028 existing records from primary storage. [2025-10-16T17:31:44.278515] [INFO ] [MAIN ] BCX: Loaded 22028 existing records. [2025-10-16T17:31:44.452122] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:31:44.452393] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-16T17:31:44.452442] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-16T17:31:44.452896] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-16T17:31:44.452980] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-16T17:31:44.748049] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-16T17:31:44.808448] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:45.466341] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:31:45.542803] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-16T17:31:46.342783] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-16T17:31:46.567937] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T17:31:46.816083] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:31:47.142864] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-16T17:31:47.784924] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:31:47.942855] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-16T17:31:48.742836] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-16T17:31:49.082289] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T17:31:49.176110] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:31:49.182760] [INFO ] [REMOTE ] BCH: Full fetch complete (41559 records). [2025-10-16T17:31:49.183018] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-16T17:31:49.184133] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:31:49.184258] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:31:49.184304] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:31:49.184351] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-16T17:31:49.184490] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-16T17:31:49.184537] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-16T17:31:49.184797] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-10-16T17:31:49.184888] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCH took 40.1s. Estimated remaining: 4h 47m 2s. Rate: 7.4 symbols/min [2025-10-16T17:31:49.406662] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:31:49.406840] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-10-16T17:31:49.406878] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-10-16T17:31:49.406988] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-16T17:31:49.407028] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-16T17:31:49.407069] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-16T17:31:49.407101] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-16T17:31:49.548730] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-16T17:31:49.793584] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:31:49.962983] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:31:50.342820] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-16T17:31:51.142823] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-16T17:31:51.404491] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T17:31:51.510611] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T17:31:51.942811] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-16T17:31:52.560947] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:31:52.742907] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-16T17:31:53.542976] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-16T17:31:53.896459] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T17:31:53.904048] [INFO ] [REMOTE ] BCS: Full fetch complete (77510 records). [2025-10-16T17:31:53.904215] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-16T17:31:54.205554] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T17:31:54.342342] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-16T17:31:54.342417] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-16T17:31:54.343231] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-16T17:31:54.343285] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-16T17:31:54.344130] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-16T17:31:54.345680] [DEBUG] [LOCAL ] BCS: Trimmed 77510 records to 53832 (keeping 200 days of data) [2025-10-16T17:31:54.675340] [DEBUG] [LOCAL ] BCS: Primary data saved (53832 records). [2025-10-16T17:31:54.675476] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-16T17:31:54.676233] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCS took 32.8s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-16T17:31:54.740092] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:31:55.142765] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-16T17:31:55.546118] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:31:55.942782] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-16T17:31:56.098290] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T17:31:56.742826] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-16T17:31:57.113482] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:31:57.542882] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-16T17:31:57.674365] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:31:58.342924] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-16T17:31:58.466052] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:31:59.143061] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-16T17:31:59.405964] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:31:59.942818] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-16T17:32:00.379934] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T17:32:00.742794] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-16T17:32:00.861015] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T17:32:01.542899] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-16T17:32:02.203719] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:32:02.342814] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-16T17:32:02.519605] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:32:03.142814] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-16T17:32:03.502102] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T17:32:03.942768] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-16T17:32:04.187042] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T17:32:04.742828] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-16T17:32:05.048906] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:32:05.542904] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-16T17:32:05.619839] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:32:06.342860] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-16T17:32:06.915328] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:32:07.142937] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-16T17:32:07.552829] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:32:07.942904] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-16T17:32:08.538703] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T17:32:08.742871] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-16T17:32:09.482435] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T17:32:09.548772] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-16T17:32:09.559198] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:32:10.342875] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-16T17:32:11.037093] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:32:11.041678] [INFO ] [REMOTE ] BCSF: Full fetch complete (39461 records). [2025-10-16T17:32:11.041784] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-16T17:32:11.148127] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-16T17:32:11.414617] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-16T17:32:11.414753] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-16T17:32:11.415362] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-16T17:32:11.415415] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-16T17:32:11.416421] [DEBUG] [LOCAL ] BCSF: Trimmed 39461 records to 28381 (keeping 200 days of data) [2025-10-16T17:32:11.540377] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T17:32:11.545890] [INFO ] [REMOTE ] BDC: Full fetch complete (35918 records). [2025-10-16T17:32:11.546829] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-16T17:32:11.963696] [DEBUG] [LOCAL ] BCSF: Primary data saved (28381 records). [2025-10-16T17:32:11.982152] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-16T17:32:12.002000] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 38.4s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-16T17:32:12.039567] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-16T17:32:12.039692] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-16T17:32:12.040337] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-16T17:32:12.040383] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-16T17:32:12.041521] [DEBUG] [LOCAL ] BDC: Trimmed 35918 records to 24680 (keeping 200 days of data) [2025-10-16T17:32:12.199301] [DEBUG] [LOCAL ] BDC: Primary data saved (24680 records). [2025-10-16T17:32:12.199444] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-16T17:32:12.199518] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BDC took 23.0s. Estimated remaining: 4h 46m 27s. Rate: 7.4 symbols/min [2025-10-16T17:32:12.422464] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:32:12.427352] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-16T17:32:13.523180] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T17:32:13.527166] [INFO ] [REMOTE ] BCX: Full fetch complete (33652 records). [2025-10-16T17:32:13.527259] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-16T17:32:13.527904] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:32:13.527985] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:32:13.528032] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:32:13.528069] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-16T17:32:13.528123] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-16T17:32:13.528157] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-10-16T17:32:13.528342] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-10-16T17:32:13.528429] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BCX took 29.5s. Estimated remaining: 4h 45m 19s. Rate: 7.5 symbols/min [2025-10-16T17:32:14.073936] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.179920] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.244996] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.265239] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:14.308405] [DEBUG] [LOCAL ] BDJ: Loaded 29470 existing records from primary storage. [2025-10-16T17:32:14.308877] [INFO ] [MAIN ] BDJ: Loaded 29470 existing records. [2025-10-16T17:32:14.463852] [DEBUG] [LOCAL ] BDX: Loaded 52176 existing records from primary storage. [2025-10-16T17:32:14.542050] [INFO ] [MAIN ] BDX: Loaded 52176 existing records. [2025-10-16T17:32:14.547743] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:14.595032] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-16T17:32:14.610424] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-16T17:32:14.609682] [DEBUG] [LOCAL ] BDN: Loaded 47666 existing records from primary storage. [2025-10-16T17:32:14.616008] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-16T17:32:14.629317] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-16T17:32:14.653755] [INFO ] [MAIN ] BDN: Loaded 47666 existing records. [2025-10-16T17:32:14.684467] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-16T17:32:14.791404] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-16T17:32:15.082998] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.173534] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.241189] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-16T17:32:15.286763] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-16T17:32:15.276506] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.292102] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-16T17:32:15.280959] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:15.297378] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.313666] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-16T17:32:15.319014] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-16T17:32:15.313490] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-16T17:32:15.349184] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-16T17:32:15.343684] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-16T17:32:15.406576] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-16T17:32:15.485344] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-16T17:32:16.177294] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.284037] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-16T17:32:16.570429] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.586546] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-16T17:32:16.677184] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.682734] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-16T17:32:16.736472] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:16.736830] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-16T17:32:17.592455] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T17:32:17.599073] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-16T17:32:18.058634] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T17:32:18.068265] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-16T17:32:18.339419] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:32:18.345910] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-16T17:32:18.484132] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T17:32:18.495913] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-16T17:32:19.059052] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-16T17:32:19.142789] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-16T17:32:19.384722] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:32:19.483932] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:32:19.866472] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T17:32:19.942777] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-16T17:32:20.742868] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-16T17:32:20.804806] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:32:21.155771] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:32:21.542878] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-16T17:32:22.342874] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-16T17:32:22.433311] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:32:22.878450] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:32:23.142843] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-16T17:32:23.223111] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T17:32:23.942838] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-16T17:32:24.742844] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-16T17:32:25.003545] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-16T17:32:25.282145] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T17:32:25.542849] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-16T17:32:26.175074] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:32:26.342805] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-16T17:32:26.889131] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T17:32:27.142856] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-16T17:32:27.704159] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:32:27.942922] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-16T17:32:28.742842] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-16T17:32:29.297122] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-16T17:32:29.341552] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:32:29.542851] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-16T17:32:30.342837] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-16T17:32:30.518851] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:32:31.142824] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-16T17:32:31.522393] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:32:31.570666] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:32:31.942889] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-16T17:32:32.742823] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-16T17:32:33.182800] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T17:32:33.259075] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T17:32:33.542847] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-16T17:32:34.342841] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-16T17:32:34.485320] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T17:32:35.150482] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-16T17:32:35.156424] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:32:35.942867] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-16T17:32:36.141554] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:32:36.584282] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:32:36.742807] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-16T17:32:36.866617] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T17:32:37.542809] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-16T17:32:38.209637] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:32:38.342819] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-16T17:32:39.080845] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:32:39.142803] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-16T17:32:39.942811] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-16T17:32:40.061458] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:32:40.430030] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:32:40.742831] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-16T17:32:41.542825] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-16T17:32:41.765517] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:32:42.342820] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-16T17:32:42.621452] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T17:32:43.101095] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:32:43.142843] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-16T17:32:43.942802] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-16T17:32:44.054842] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T17:32:44.062405] [INFO ] [REMOTE ] BDN: Full fetch complete (69350 records). [2025-10-16T17:32:44.062557] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-16T17:32:44.491487] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-16T17:32:44.491574] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-16T17:32:44.492339] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-16T17:32:44.492404] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-16T17:32:44.494375] [DEBUG] [LOCAL ] BDN: Trimmed 69350 records to 48013 (keeping 200 days of data) [2025-10-16T17:32:44.718103] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:32:44.725724] [INFO ] [REMOTE ] BDX: Full fetch complete (75559 records). [2025-10-16T17:32:44.729197] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-16T17:32:44.753532] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-16T17:32:45.119179] [DEBUG] [LOCAL ] BDN: Primary data saved (48013 records). [2025-10-16T17:32:45.119461] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-16T17:32:45.119925] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 31.6s. Estimated remaining: 4h 48m 39s. Rate: 7.4 symbols/min [2025-10-16T17:32:45.335767] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-16T17:32:45.335930] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-16T17:32:45.337221] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-16T17:32:45.337309] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-16T17:32:45.412946] [DEBUG] [LOCAL ] BDX: Trimmed 75559 records to 52564 (keeping 200 days of data) [2025-10-16T17:32:45.415917] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:45.416591] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-16T17:32:45.416694] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-16T17:32:45.417103] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-16T17:32:45.417186] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-16T17:32:45.417240] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-16T17:32:45.417279] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-16T17:32:46.081613] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:46.084135] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-16T17:32:46.092877] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:32:46.221564] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-16T17:32:46.238461] [DEBUG] [LOCAL ] BDX: Primary data saved (52564 records). [2025-10-16T17:32:46.238632] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-16T17:32:46.238796] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDX took 32.7s. Estimated remaining: 4h 47m 29s. Rate: 7.4 symbols/min [2025-10-16T17:32:46.347089] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-16T17:32:46.415849] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:46.416440] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-10-16T17:32:46.416494] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-10-16T17:32:46.416603] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-16T17:32:46.416672] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-16T17:32:46.416739] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-16T17:32:46.416774] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-16T17:32:46.701130] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-16T17:32:46.780452] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:47.142783] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-16T17:32:47.348176] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:32:47.352621] [INFO ] [REMOTE ] BDJ: Full fetch complete (43090 records). [2025-10-16T17:32:47.352801] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-16T17:32:47.456304] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T17:32:47.729828] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-16T17:32:47.729936] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-16T17:32:47.730525] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-16T17:32:47.730586] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-16T17:32:47.731546] [DEBUG] [LOCAL ] BDJ: Trimmed 43090 records to 29694 (keeping 200 days of data) [2025-10-16T17:32:47.906668] [DEBUG] [LOCAL ] BDJ: Primary data saved (29694 records). [2025-10-16T17:32:47.906809] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-16T17:32:47.906888] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDJ took 34.4s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-16T17:32:47.947949] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-16T17:32:48.076831] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:32:48.139378] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-16T17:32:48.139720] [INFO ] [MAIN ] BEN: Loaded 53122 existing records. [2025-10-16T17:32:48.314590] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:32:48.314846] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-16T17:32:48.314893] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-16T17:32:48.315267] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-16T17:32:48.315323] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-16T17:32:48.680497] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:32:48.742809] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-16T17:32:48.991610] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-16T17:32:49.542800] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-16T17:32:49.937271] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T17:32:50.003846] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T17:32:50.342815] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-16T17:32:51.142823] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-16T17:32:51.942850] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-16T17:32:52.148624] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T17:32:52.742845] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-16T17:32:53.542823] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-16T17:32:53.714846] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:32:53.763447] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T17:32:53.814050] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-16T17:32:54.110081] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:32:54.342842] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-16T17:32:54.673976] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T17:32:55.142811] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-16T17:32:55.464129] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T17:32:55.942821] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-16T17:32:56.169090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T17:32:56.742901] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-16T17:32:57.027348] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-16T17:32:57.542822] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-16T17:32:57.948006] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T17:32:58.342865] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-16T17:32:59.142877] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-16T17:32:59.942855] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-16T17:33:00.090691] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T17:33:00.431495] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T17:33:00.432408] [INFO ] [REMOTE ] BEDU: Full fetch complete (1332 records). [2025-10-16T17:33:00.432500] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-16T17:33:00.610102] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-16T17:33:00.610328] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:33:00.610417] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:33:00.610512] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-16T17:33:00.610593] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-16T17:33:00.610631] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-16T17:33:00.610738] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-16T17:33:00.610817] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BEDU took 15.5s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-16T17:33:00.748047] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-16T17:33:00.795306] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:00.832903] [DEBUG] [LOCAL ] BEP: Loaded 38951 existing records from primary storage. [2025-10-16T17:33:00.833218] [INFO ] [MAIN ] BEP: Loaded 38951 existing records. [2025-10-16T17:33:01.006461] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:01.006686] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-16T17:33:01.006744] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-16T17:33:01.006980] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-16T17:33:01.007035] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-16T17:33:01.379630] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:01.542849] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-16T17:33:02.137507] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-16T17:33:02.144620] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-16T17:33:02.144797] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-16T17:33:02.348934] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-16T17:33:02.553967] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-16T17:33:02.554147] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-16T17:33:02.555056] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-16T17:33:02.555138] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-16T17:33:02.556724] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 54051 (keeping 200 days of data) [2025-10-16T17:33:02.710145] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:33:02.850841] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T17:33:02.952953] [DEBUG] [LOCAL ] BE: Primary data saved (54051 records). [2025-10-16T17:33:02.953109] [INFO ] [MAIN ] BE: Full history saved. [2025-10-16T17:33:02.953944] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BE took 49.4s. Estimated remaining: 4h 45m 59s. Rate: 7.4 symbols/min [2025-10-16T17:33:03.121763] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:03.151082] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-16T17:33:03.169849] [DEBUG] [LOCAL ] BEPC: Loaded 46488 existing records from primary storage. [2025-10-16T17:33:03.170130] [INFO ] [MAIN ] BEPC: Loaded 46488 existing records. [2025-10-16T17:33:03.355369] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:03.355596] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-16T17:33:03.355663] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-16T17:33:03.355940] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-16T17:33:03.355995] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-16T17:33:03.708708] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:03.942770] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-16T17:33:04.008800] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:33:04.671117] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:33:04.742844] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-16T17:33:05.202934] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:33:05.542808] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-16T17:33:06.342851] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-16T17:33:06.693512] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T17:33:06.752072] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:33:07.142838] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-16T17:33:07.942846] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-16T17:33:08.053340] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T17:33:08.660916] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:33:08.742778] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-16T17:33:09.529665] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:33:09.542789] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-16T17:33:10.169473] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:33:10.342837] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-16T17:33:11.095909] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:33:11.142812] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-16T17:33:11.782322] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:33:11.942826] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-16T17:33:12.551435] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:33:12.742862] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-16T17:33:13.334375] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:33:13.542879] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-16T17:33:14.328068] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T17:33:14.342776] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-16T17:33:15.077370] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:33:15.142791] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-16T17:33:15.942822] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-16T17:33:16.015220] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T17:33:16.742901] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-16T17:33:17.039906] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T17:33:17.310979] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:33:17.542826] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-16T17:33:17.751954] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:33:18.342839] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-16T17:33:18.872344] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T17:33:19.142844] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-16T17:33:19.764310] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:33:19.942872] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-16T17:33:20.742805] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-16T17:33:20.931947] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T17:33:21.497697] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T17:33:21.542775] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-16T17:33:22.342821] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-16T17:33:22.478311] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:33:23.123898] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:33:23.142798] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-16T17:33:23.684010] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T17:33:23.942891] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-16T17:33:24.742806] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-16T17:33:24.957982] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:33:25.513126] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T17:33:25.518605] [INFO ] [REMOTE ] BEP: Full fetch complete (58943 records). [2025-10-16T17:33:25.518725] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-16T17:33:25.519417] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:33:25.519508] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:33:25.519550] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:33:25.519588] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-16T17:33:25.519665] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-16T17:33:25.519723] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-10-16T17:33:25.519894] [DEBUG] [LOCAL ] BEP: Deleted derivative data file. [2025-10-16T17:33:25.520329] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEP took 24.9s. Estimated remaining: 4h 47m 56s. Rate: 7.4 symbols/min [2025-10-16T17:33:25.551946] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-16T17:33:25.700888] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:25.701088] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-16T17:33:25.701143] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-16T17:33:25.701251] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-16T17:33:25.701292] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-16T17:33:25.701332] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-16T17:33:25.701364] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-16T17:33:26.054412] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:26.082246] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:33:26.342924] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-16T17:33:27.090111] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:33:27.142777] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-16T17:33:27.942834] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-16T17:33:28.206888] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T17:33:28.213681] [INFO ] [REMOTE ] BEKE: Full fetch complete (77341 records). [2025-10-16T17:33:28.213820] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-16T17:33:28.654734] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-16T17:33:28.655325] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-16T17:33:28.655567] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:33:28.658936] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-16T17:33:28.659138] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-16T17:33:28.660713] [DEBUG] [LOCAL ] BEKE: Trimmed 77341 records to 53596 (keeping 200 days of data) [2025-10-16T17:33:28.745569] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-16T17:33:29.000209] [DEBUG] [LOCAL ] BEKE: Primary data saved (53596 records). [2025-10-16T17:33:29.012828] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-16T17:33:29.016404] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 42.8s. Estimated remaining: 4h 47m 8s. Rate: 7.4 symbols/min [2025-10-16T17:33:29.063678] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T17:33:29.202175] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:29.208518] [DEBUG] [LOCAL ] BEPI: Loaded 3616 existing records from primary storage. [2025-10-16T17:33:29.208711] [INFO ] [MAIN ] BEPI: Loaded 3616 existing records. [2025-10-16T17:33:29.380836] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:29.381067] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-16T17:33:29.381113] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-16T17:33:29.381248] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-16T17:33:29.381285] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-16T17:33:29.545558] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-16T17:33:29.741956] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:30.214356] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:33:30.334402] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:33:30.344127] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-16T17:33:30.911801] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:33:31.142817] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-16T17:33:31.942829] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-16T17:33:32.626638] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T17:33:32.742833] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-16T17:33:33.122800] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-16T17:33:33.137628] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:33:33.145130] [INFO ] [REMOTE ] BEN: Full fetch complete (77090 records). [2025-10-16T17:33:33.145308] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-16T17:33:33.555228] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-16T17:33:33.560281] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-16T17:33:33.560356] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-16T17:33:33.561284] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-16T17:33:33.561442] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-16T17:33:33.563026] [DEBUG] [LOCAL ] BEN: Trimmed 77090 records to 53511 (keeping 200 days of data) [2025-10-16T17:33:33.886672] [DEBUG] [LOCAL ] BEN: Primary data saved (53511 records). [2025-10-16T17:33:33.886829] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-16T17:33:33.886909] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEN took 46.0s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-16T17:33:34.058775] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:34.065160] [DEBUG] [LOCAL ] BEPJ: Loaded 3112 existing records from primary storage. [2025-10-16T17:33:34.065357] [INFO ] [MAIN ] BEPJ: Loaded 3112 existing records. [2025-10-16T17:33:34.253728] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:34.253983] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-16T17:33:34.254056] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-16T17:33:34.254203] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-16T17:33:34.254244] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-16T17:33:34.348210] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-16T17:33:34.377431] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:33:34.639207] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:34.743876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T17:33:35.142857] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-16T17:33:35.618573] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T17:33:35.942902] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-16T17:33:36.713468] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:33:36.742817] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-16T17:33:37.542855] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-16T17:33:38.047827] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:33:38.230161] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:33:38.342782] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-16T17:33:39.142833] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-16T17:33:39.710962] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:33:39.947904] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-16T17:33:39.973885] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:33:40.742844] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-16T17:33:40.837076] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:33:41.542865] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-16T17:33:42.174464] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T17:33:42.344163] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-16T17:33:42.346255] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T17:33:42.353138] [INFO ] [REMOTE ] BEPC: Full fetch complete (68925 records). [2025-10-16T17:33:42.353250] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-16T17:33:42.747927] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-16T17:33:42.748017] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-16T17:33:42.748864] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-16T17:33:42.748930] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-16T17:33:42.750376] [DEBUG] [LOCAL ] BEPC: Trimmed 68925 records to 46866 (keeping 200 days of data) [2025-10-16T17:33:42.978257] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T17:33:43.058276] [DEBUG] [LOCAL ] BEPC: Primary data saved (46866 records). [2025-10-16T17:33:43.058444] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-16T17:33:43.059118] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEPC took 40.1s. Estimated remaining: 4h 46m 33s. Rate: 7.4 symbols/min [2025-10-16T17:33:43.148065] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-16T17:33:43.249302] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:43.249484] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-10-16T17:33:43.249523] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-10-16T17:33:43.249700] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-16T17:33:43.249775] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-16T17:33:43.249840] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-16T17:33:43.249877] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-16T17:33:43.627137] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:43.721876] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:33:43.942809] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-16T17:33:44.425443] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T17:33:44.742809] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-16T17:33:45.212543] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:33:45.542826] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-16T17:33:46.160255] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T17:33:46.342818] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-16T17:33:46.795499] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:33:47.142815] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-16T17:33:47.595790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:33:47.942811] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-16T17:33:48.487373] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-16T17:33:48.488335] [INFO ] [REMOTE ] BEPI: Full fetch complete (4742 records). [2025-10-16T17:33:48.488414] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-16T17:33:48.747956] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-16T17:33:48.851787] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-16T17:33:48.851863] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-16T17:33:48.852014] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-16T17:33:48.852086] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-16T17:33:48.852461] [DEBUG] [LOCAL ] BEPI: Trimmed 4742 records to 3629 (keeping 200 days of data) [2025-10-16T17:33:48.874336] [DEBUG] [LOCAL ] BEPI: Primary data saved (3629 records). [2025-10-16T17:33:48.874460] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-16T17:33:48.874539] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPI took 19.9s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-16T17:33:49.046107] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:49.083334] [DEBUG] [LOCAL ] BFH: Loaded 41564 existing records from primary storage. [2025-10-16T17:33:49.083627] [INFO ] [MAIN ] BFH: Loaded 41564 existing records. [2025-10-16T17:33:49.262239] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:49.262546] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-16T17:33:49.262604] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-16T17:33:49.262892] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-16T17:33:49.262961] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-16T17:33:49.368866] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T17:33:49.548780] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-16T17:33:49.630821] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:50.206626] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-16T17:33:50.342807] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-16T17:33:51.142829] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-16T17:33:51.198783] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T17:33:51.203194] [INFO ] [REMOTE ] BEPH: Full fetch complete (7598 records). [2025-10-16T17:33:51.203311] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-16T17:33:51.550638] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-16T17:33:51.550742] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-16T17:33:51.550933] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-16T17:33:51.550970] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-16T17:33:51.551352] [DEBUG] [LOCAL ] BEPH: Trimmed 7598 records to 5205 (keeping 200 days of data) [2025-10-16T17:33:51.583753] [DEBUG] [LOCAL ] BEPH: Primary data saved (5205 records). [2025-10-16T17:33:51.583866] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-16T17:33:51.583932] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPH took 26.1s. Estimated remaining: 4h 45m 12s. Rate: 7.4 symbols/min [2025-10-16T17:33:51.749524] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:33:51.764583] [DEBUG] [LOCAL ] BFK: Loaded 13505 existing records from primary storage. [2025-10-16T17:33:51.764853] [INFO ] [MAIN ] BFK: Loaded 13505 existing records. [2025-10-16T17:33:51.937441] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:33:51.937701] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-16T17:33:51.937756] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-16T17:33:51.937949] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-16T17:33:51.938003] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-16T17:33:51.949131] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-16T17:33:52.288839] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:33:52.499697] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:33:52.743382] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-16T17:33:52.745701] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:33:53.543049] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-16T17:33:53.857916] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:33:54.342816] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-16T17:33:54.863323] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T17:33:55.142834] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-16T17:33:55.247176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:33:55.942867] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-16T17:33:56.566288] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:33:56.742809] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-16T17:33:56.846126] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T17:33:57.542830] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-16T17:33:58.266061] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:33:58.342779] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-16T17:33:58.866825] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T17:33:59.142883] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-16T17:33:59.824764] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:33:59.861481] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:33:59.942821] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-16T17:34:00.449700] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T17:34:00.742861] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-16T17:34:01.542817] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-16T17:34:01.784708] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:34:02.285637] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T17:34:02.342814] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-16T17:34:02.775442] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T17:34:03.142818] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-16T17:34:03.942857] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-16T17:34:04.634269] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T17:34:04.742819] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-16T17:34:05.542914] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-16T17:34:05.867984] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T17:34:06.161944] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T17:34:06.329093] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:34:06.342815] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-16T17:34:06.661632] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-16T17:34:07.142882] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-16T17:34:07.942812] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-16T17:34:08.466629] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:34:08.715278] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T17:34:08.742877] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-16T17:34:09.315585] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:34:09.542823] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-16T17:34:10.342888] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-16T17:34:10.808357] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T17:34:10.922991] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T17:34:11.142856] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-16T17:34:11.942863] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-16T17:34:12.376978] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:34:12.537482] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-16T17:34:12.742827] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-16T17:34:13.542797] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-16T17:34:14.118496] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:34:14.137401] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T17:34:14.342845] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-16T17:34:15.142867] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-16T17:34:15.633628] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T17:34:15.942851] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-16T17:34:16.742864] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-16T17:34:16.791693] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T17:34:17.409470] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:34:17.543810] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-16T17:34:17.548397] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T17:34:18.342812] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-16T17:34:18.931675] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:34:19.142815] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-16T17:34:19.291118] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T17:34:19.942867] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-16T17:34:20.376909] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:34:20.381938] [INFO ] [REMOTE ] BFAM: Full fetch complete (47279 records). [2025-10-16T17:34:20.382081] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-16T17:34:20.750127] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-16T17:34:20.753350] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-16T17:34:20.753402] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-16T17:34:20.753975] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-16T17:34:20.754036] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-16T17:34:20.755308] [DEBUG] [LOCAL ] BFAM: Trimmed 47279 records to 34121 (keeping 200 days of data) [2025-10-16T17:34:20.948057] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:34:20.953993] [INFO ] [REMOTE ] BFK: Full fetch complete (19059 records). [2025-10-16T17:34:20.955064] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-16T17:34:21.144438] [DEBUG] [LOCAL ] BFAM: Primary data saved (34121 records). [2025-10-16T17:34:21.160795] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-16T17:34:21.162102] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BFAM took 38.1s. Estimated remaining: 4h 48m 4s. Rate: 7.3 symbols/min [2025-10-16T17:34:21.528692] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:21.553525] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-16T17:34:21.543824] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-16T17:34:21.554244] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-16T17:34:21.554711] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-16T17:34:21.556466] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-16T17:34:21.557592] [DEBUG] [LOCAL ] BFK: Trimmed 19059 records to 13686 (keeping 200 days of data) [2025-10-16T17:34:21.638905] [DEBUG] [LOCAL ] BFK: Primary data saved (13686 records). [2025-10-16T17:34:21.639068] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-16T17:34:21.639163] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFK took 30.1s. Estimated remaining: 4h 46m 52s. Rate: 7.4 symbols/min [2025-10-16T17:34:21.846169] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:21.848590] [DEBUG] [LOCAL ] BFLY: Loaded 51836 existing records from primary storage. [2025-10-16T17:34:21.849289] [INFO ] [MAIN ] BFLY: Loaded 51836 existing records. [2025-10-16T17:34:21.966547] [DEBUG] [LOCAL ] BFS: Loaded 9589 existing records from primary storage. [2025-10-16T17:34:21.983105] [INFO ] [MAIN ] BFS: Loaded 9589 existing records. [2025-10-16T17:34:22.085875] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:22.120398] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-16T17:34:22.120789] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-16T17:34:22.121148] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-16T17:34:22.121217] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-16T17:34:22.295405] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:34:22.387311] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:22.390768] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-16T17:34:22.389207] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T17:34:22.406255] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-16T17:34:22.423193] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-16T17:34:22.482423] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-16T17:34:22.490782] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-16T17:34:22.845953] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:22.884758] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:34:23.067606] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:23.142784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-16T17:34:23.849241] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:34:23.942831] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-16T17:34:24.031333] [DEBUG] [REMOTE ] BFS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-16T17:34:24.031683] [WARN ] [REMOTE ] BFS: No data returned for month 2025-01 [2025-10-16T17:34:24.031789] [FATAL] [REMOTE ] BFS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:34:24.031904] [FATAL] [MAIN ] BFS: Failed to fetch primary data. [2025-10-16T17:34:24.031993] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:34:24.032092] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-16T17:34:24.032176] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-16T17:34:24.032215] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-16T17:34:24.032347] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-10-16T17:34:24.032430] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFS took 2.4s. Estimated remaining: 4h 45m 56s. Rate: 7.4 symbols/min [2025-10-16T17:34:24.209071] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:24.222379] [DEBUG] [LOCAL ] BFZ: Loaded 11947 existing records from primary storage. [2025-10-16T17:34:24.222597] [INFO ] [MAIN ] BFZ: Loaded 11947 existing records. [2025-10-16T17:34:24.405246] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:24.405480] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-16T17:34:24.405537] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-16T17:34:24.405734] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-16T17:34:24.405792] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-16T17:34:24.746293] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-16T17:34:24.768913] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:25.542900] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-16T17:34:25.978622] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:34:25.979506] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4406 records). [2025-10-16T17:34:25.979596] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-16T17:34:26.343091] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-16T17:34:26.408903] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-16T17:34:26.409176] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-16T17:34:26.409382] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-16T17:34:26.409530] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-16T17:34:26.410343] [DEBUG] [LOCAL ] BEPJ: Trimmed 4406 records to 3119 (keeping 200 days of data) [2025-10-16T17:34:26.433212] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3119 records). [2025-10-16T17:34:26.433349] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-16T17:34:26.452981] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BEPJ took 52.6s. Estimated remaining: 4h 45m 1s. Rate: 7.4 symbols/min [2025-10-16T17:34:26.524624] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:34:26.675984] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:26.724719] [DEBUG] [LOCAL ] BG: Loaded 50524 existing records from primary storage. [2025-10-16T17:34:26.725028] [INFO ] [MAIN ] BG: Loaded 50524 existing records. [2025-10-16T17:34:26.895941] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:26.896162] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-16T17:34:26.896230] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-16T17:34:26.896558] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-16T17:34:26.896634] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-16T17:34:27.147903] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-16T17:34:27.253212] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:27.923218] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:34:27.929724] [INFO ] [REMOTE ] BFH: Full fetch complete (60168 records). [2025-10-16T17:34:27.929899] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-16T17:34:27.947920] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-16T17:34:28.306665] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T17:34:28.395304] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-16T17:34:28.395390] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-16T17:34:28.396150] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-16T17:34:28.396217] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-16T17:34:28.397516] [DEBUG] [LOCAL ] BFH: Trimmed 60168 records to 41891 (keeping 200 days of data) [2025-10-16T17:34:28.653355] [DEBUG] [LOCAL ] BFH: Primary data saved (41891 records). [2025-10-16T17:34:28.653485] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-16T17:34:28.653562] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFH took 39.8s. Estimated remaining: 4h 44m 4s. Rate: 7.4 symbols/min [2025-10-16T17:34:28.748471] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-16T17:34:28.824032] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:28.842134] [DEBUG] [LOCAL ] BGB: Loaded 17952 existing records from primary storage. [2025-10-16T17:34:28.842403] [INFO ] [MAIN ] BGB: Loaded 17952 existing records. [2025-10-16T17:34:29.013436] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:29.013639] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-16T17:34:29.013722] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-16T17:34:29.013945] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-16T17:34:29.014004] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-16T17:34:29.365505] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:29.475968] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:34:29.542808] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-16T17:34:30.342824] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-16T17:34:30.578398] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:34:31.120710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:34:31.142796] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-16T17:34:31.172263] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:34:31.942847] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-16T17:34:32.460865] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T17:34:32.732304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:34:32.742763] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-16T17:34:33.542933] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-16T17:34:34.342823] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-16T17:34:34.366137] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:34:34.482909] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:34:35.004307] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T17:34:35.142890] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-16T17:34:35.942858] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-16T17:34:35.961162] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T17:34:36.742812] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-16T17:34:37.401370] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-16T17:34:37.471457] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:34:37.542833] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-16T17:34:38.342793] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-16T17:34:38.425005] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:34:39.142815] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-16T17:34:39.942840] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-16T17:34:40.146304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:34:40.722962] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:34:40.742768] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-16T17:34:41.012352] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T17:34:41.542835] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-16T17:34:42.178458] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:34:42.352749] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-16T17:34:42.374442] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:34:43.130972] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T17:34:43.142775] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-16T17:34:43.942790] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-16T17:34:43.964521] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:34:44.742822] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-16T17:34:44.971440] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:34:45.419445] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-16T17:34:45.542810] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-16T17:34:46.342788] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-16T17:34:46.735224] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:34:47.142812] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-16T17:34:47.786854] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T17:34:47.942804] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-16T17:34:48.742835] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-16T17:34:48.866136] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:34:49.431497] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T17:34:49.542810] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-16T17:34:49.710514] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T17:34:50.123598] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T17:34:50.342866] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-16T17:34:51.142816] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-16T17:34:51.377107] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-16T17:34:51.379712] [INFO ] [REMOTE ] BFZ: Full fetch complete (17487 records). [2025-10-16T17:34:51.379803] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-16T17:34:51.754318] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-16T17:34:51.754399] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-16T17:34:51.754757] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-16T17:34:51.754818] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-16T17:34:51.755355] [DEBUG] [LOCAL ] BFZ: Trimmed 17487 records to 12108 (keeping 200 days of data) [2025-10-16T17:34:51.827971] [DEBUG] [LOCAL ] BFZ: Primary data saved (12108 records). [2025-10-16T17:34:51.828109] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-16T17:34:51.828188] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFZ took 27.8s. Estimated remaining: 4h 46m 0s. Rate: 7.4 symbols/min [2025-10-16T17:34:51.947969] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-16T17:34:51.999537] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:34:52.018446] [DEBUG] [LOCAL ] BGH: Loaded 17264 existing records from primary storage. [2025-10-16T17:34:52.018711] [INFO ] [MAIN ] BGH: Loaded 17264 existing records. [2025-10-16T17:34:52.195821] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:34:52.196072] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-16T17:34:52.196121] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-16T17:34:52.196303] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-16T17:34:52.196361] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-16T17:34:52.561015] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:34:52.742867] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-16T17:34:53.082037] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T17:34:53.488706] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:34:53.542835] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-16T17:34:53.756441] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T17:34:54.342832] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-16T17:34:54.521291] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T17:34:55.142901] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-16T17:34:55.901374] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T17:34:55.942803] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-16T17:34:56.031866] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T17:34:56.742910] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-16T17:34:56.902616] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:34:57.542793] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-16T17:34:57.922850] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T17:34:58.342869] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-16T17:34:59.148011] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-16T17:34:59.169033] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:34:59.877797] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:34:59.942821] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-16T17:35:00.159459] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T17:35:00.742842] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-16T17:35:01.542810] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-16T17:35:01.742151] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:35:01.744874] [INFO ] [REMOTE ] BGB: Full fetch complete (26708 records). [2025-10-16T17:35:01.744953] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-16T17:35:01.745450] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:35:01.745531] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:35:01.745573] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:35:01.745611] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-16T17:35:01.745689] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-16T17:35:01.745744] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-10-16T17:35:01.745856] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-10-16T17:35:01.745921] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BGB took 33.1s. Estimated remaining: 4h 46m 7s. Rate: 7.4 symbols/min [2025-10-16T17:35:01.924549] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:01.941668] [DEBUG] [LOCAL ] BGR: Loaded 13605 existing records from primary storage. [2025-10-16T17:35:01.941899] [INFO ] [MAIN ] BGR: Loaded 13605 existing records. [2025-10-16T17:35:02.095369] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T17:35:02.195868] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:02.196301] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-16T17:35:02.196390] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-16T17:35:02.201930] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-16T17:35:02.207828] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-16T17:35:02.214895] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T17:35:02.347687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-16T17:35:02.638858] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:03.142858] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-16T17:35:03.942833] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-16T17:35:04.202304] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T17:35:04.210820] [INFO ] [REMOTE ] BG: Full fetch complete (73010 records). [2025-10-16T17:35:04.210993] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-16T17:35:04.336492] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:35:04.639914] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-16T17:35:04.640021] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-16T17:35:04.640858] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-16T17:35:04.640922] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-16T17:35:04.642319] [DEBUG] [LOCAL ] BG: Trimmed 73010 records to 50912 (keeping 200 days of data) [2025-10-16T17:35:04.742943] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-16T17:35:04.953080] [DEBUG] [LOCAL ] BG: Primary data saved (50912 records). [2025-10-16T17:35:04.953220] [INFO ] [MAIN ] BG: Full history saved. [2025-10-16T17:35:04.954737] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BG took 38.5s. Estimated remaining: 4h 45m 18s. Rate: 7.4 symbols/min [2025-10-16T17:35:05.120631] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:05.171218] [DEBUG] [LOCAL ] BGS: Loaded 50534 existing records from primary storage. [2025-10-16T17:35:05.171531] [INFO ] [MAIN ] BGS: Loaded 50534 existing records. [2025-10-16T17:35:05.352334] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:05.352625] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-16T17:35:05.352707] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-16T17:35:05.353006] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-16T17:35:05.353062] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-16T17:35:05.546363] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-16T17:35:05.720081] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:05.730973] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:35:05.813389] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:35:06.342853] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-16T17:35:06.574570] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:35:07.046488] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T17:35:07.142806] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-16T17:35:07.942792] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-16T17:35:08.090702] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T17:35:08.742857] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-16T17:35:08.890974] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T17:35:09.542824] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-16T17:35:10.342831] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-16T17:35:10.355079] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:35:10.962331] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-16T17:35:10.969432] [INFO ] [REMOTE ] BFLY: Full fetch complete (75503 records). [2025-10-16T17:35:10.969577] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-16T17:35:11.153793] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-16T17:35:11.378750] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-16T17:35:11.378854] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-16T17:35:11.379757] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-16T17:35:11.379820] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-16T17:35:11.381434] [DEBUG] [LOCAL ] BFLY: Trimmed 75503 records to 52222 (keeping 200 days of data) [2025-10-16T17:35:11.687837] [DEBUG] [LOCAL ] BFLY: Primary data saved (52222 records). [2025-10-16T17:35:11.687985] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-16T17:35:11.688092] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BFLY took 50.5s. Estimated remaining: 4h 44m 59s. Rate: 7.4 symbols/min [2025-10-16T17:35:11.867675] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:11.877713] [DEBUG] [LOCAL ] BGSF: Loaded 7984 existing records from primary storage. [2025-10-16T17:35:11.877945] [INFO ] [MAIN ] BGSF: Loaded 7984 existing records. [2025-10-16T17:35:11.952581] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-16T17:35:12.110901] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:12.105310] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:35:12.111466] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-16T17:35:12.115688] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-16T17:35:12.122397] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-16T17:35:12.123301] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-16T17:35:12.264902] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T17:35:12.503260] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:12.634552] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T17:35:12.742849] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-16T17:35:13.497131] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:35:13.542817] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-16T17:35:13.913481] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T17:35:14.342899] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-16T17:35:14.764005] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T17:35:15.142856] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-16T17:35:15.942841] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-16T17:35:16.099061] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T17:35:16.742900] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-16T17:35:17.184605] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T17:35:17.542841] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-16T17:35:17.784868] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:35:17.891768] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T17:35:18.342810] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-16T17:35:18.788946] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T17:35:19.142956] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-16T17:35:19.942795] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-16T17:35:20.144710] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:35:20.147774] [INFO ] [REMOTE ] BGH: Full fetch complete (22896 records). [2025-10-16T17:35:20.147870] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-16T17:35:20.547787] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-16T17:35:20.547868] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-16T17:35:20.548235] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-16T17:35:20.548275] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-16T17:35:20.549084] [DEBUG] [LOCAL ] BGH: Trimmed 22896 records to 17362 (keeping 200 days of data) [2025-10-16T17:35:20.654563] [DEBUG] [LOCAL ] BGH: Primary data saved (17362 records). [2025-10-16T17:35:20.654754] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-16T17:35:20.654840] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGH took 28.8s. Estimated remaining: 4h 44m 58s. Rate: 7.4 symbols/min [2025-10-16T17:35:20.747927] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-16T17:35:20.831118] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:20.849249] [DEBUG] [LOCAL ] BGT: Loaded 16412 existing records from primary storage. [2025-10-16T17:35:20.849511] [INFO ] [MAIN ] BGT: Loaded 16412 existing records. [2025-10-16T17:35:21.036832] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T17:35:21.042333] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:21.046264] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-16T17:35:21.046335] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-16T17:35:21.046512] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-16T17:35:21.046568] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-16T17:35:21.155196] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T17:35:21.430158] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:21.542804] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-16T17:35:22.342844] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-16T17:35:22.411534] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:35:23.126535] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T17:35:23.142810] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-16T17:35:23.942818] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-16T17:35:24.005613] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:35:24.742845] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-16T17:35:25.047192] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:35:25.542822] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-16T17:35:26.342892] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-16T17:35:26.422042] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T17:35:26.461249] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T17:35:26.685000] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:35:27.142842] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-16T17:35:27.942832] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-16T17:35:28.103886] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:35:28.742865] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-16T17:35:28.825337] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:35:29.542819] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-16T17:35:29.726951] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T17:35:30.097707] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:35:30.342818] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-16T17:35:31.142820] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-16T17:35:31.781237] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:35:31.942815] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-16T17:35:32.117014] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:35:32.742799] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-16T17:35:32.991697] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:35:33.542797] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-16T17:35:33.657882] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:35:34.269912] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:35:34.342816] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-16T17:35:35.142839] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-16T17:35:35.440447] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:35:35.942834] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-16T17:35:36.742805] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-16T17:35:36.770692] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:35:36.773722] [INFO ] [REMOTE ] BGR: Full fetch complete (19980 records). [2025-10-16T17:35:36.773822] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-16T17:35:37.098374] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:35:37.213167] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-16T17:35:37.213248] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-16T17:35:37.213632] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-16T17:35:37.213710] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-16T17:35:37.214409] [DEBUG] [LOCAL ] BGR: Trimmed 19980 records to 13687 (keeping 200 days of data) [2025-10-16T17:35:37.297947] [DEBUG] [LOCAL ] BGR: Primary data saved (13687 records). [2025-10-16T17:35:37.298096] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-16T17:35:37.298175] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGR took 35.6s. Estimated remaining: 4h 45m 58s. Rate: 7.4 symbols/min [2025-10-16T17:35:37.469704] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:37.481476] [DEBUG] [LOCAL ] BGX: Loaded 11151 existing records from primary storage. [2025-10-16T17:35:37.481703] [INFO ] [MAIN ] BGX: Loaded 11151 existing records. [2025-10-16T17:35:37.548028] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-16T17:35:37.663433] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:37.663676] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-16T17:35:37.663737] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-16T17:35:37.663937] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-16T17:35:37.663990] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-16T17:35:37.784735] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T17:35:37.816611] [INFO ] [REMOTE ] BGSF: Full fetch complete (9581 records). [2025-10-16T17:35:37.851817] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-16T17:35:38.197200] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:38.352195] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-16T17:35:38.439815] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-16T17:35:38.439893] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-16T17:35:38.440121] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-16T17:35:38.440160] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-16T17:35:38.440679] [DEBUG] [LOCAL ] BGSF: Trimmed 9581 records to 8063 (keeping 200 days of data) [2025-10-16T17:35:38.487321] [DEBUG] [LOCAL ] BGSF: Primary data saved (8063 records). [2025-10-16T17:35:38.487465] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-16T17:35:38.487545] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGSF took 26.8s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-16T17:35:38.654909] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:38.675724] [DEBUG] [LOCAL ] BGY: Loaded 21983 existing records from primary storage. [2025-10-16T17:35:38.675992] [INFO ] [MAIN ] BGY: Loaded 21983 existing records. [2025-10-16T17:35:38.852314] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:38.852559] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-16T17:35:38.852606] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-16T17:35:38.852906] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-16T17:35:38.852967] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-16T17:35:39.147917] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-16T17:35:39.224355] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:39.306916] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:35:39.402709] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:35:39.942828] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-16T17:35:40.011390] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:35:40.742809] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-16T17:35:41.267771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:35:41.542835] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-16T17:35:41.690454] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T17:35:42.159706] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T17:35:42.342811] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-16T17:35:43.142868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-16T17:35:43.343614] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:35:43.942818] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-16T17:35:44.742806] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-16T17:35:44.784340] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T17:35:44.873716] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:35:44.875793] [INFO ] [REMOTE ] BGT: Full fetch complete (24177 records). [2025-10-16T17:35:44.875865] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-16T17:35:45.246963] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-16T17:35:45.247054] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-16T17:35:45.247500] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-16T17:35:45.247554] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-16T17:35:45.248213] [DEBUG] [LOCAL ] BGT: Trimmed 24177 records to 16514 (keeping 200 days of data) [2025-10-16T17:35:45.346196] [DEBUG] [LOCAL ] BGT: Primary data saved (16514 records). [2025-10-16T17:35:45.346336] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-16T17:35:45.346415] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGT took 24.7s. Estimated remaining: 4h 44m 36s. Rate: 7.4 symbols/min [2025-10-16T17:35:45.516381] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:45.534026] [DEBUG] [LOCAL ] BH: Loaded 16248 existing records from primary storage. [2025-10-16T17:35:45.534228] [INFO ] [MAIN ] BH: Loaded 16248 existing records. [2025-10-16T17:35:45.547986] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-16T17:35:45.719619] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:45.719862] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-16T17:35:45.719909] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-16T17:35:45.720061] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-16T17:35:45.720098] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-16T17:35:46.122454] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:46.136230] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T17:35:46.342875] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-16T17:35:46.891456] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T17:35:47.142822] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-16T17:35:47.557935] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T17:35:47.942918] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-16T17:35:47.953842] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T17:35:48.742812] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-16T17:35:49.061208] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:35:49.286939] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T17:35:49.542883] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-16T17:35:50.342842] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-16T17:35:50.441519] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T17:35:51.142832] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-16T17:35:51.822574] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:35:51.942781] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-16T17:35:52.076550] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:35:52.591213] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:35:52.742844] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-16T17:35:53.504289] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T17:35:53.542775] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-16T17:35:54.342868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-16T17:35:54.806044] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T17:35:55.142833] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-16T17:35:55.897247] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T17:35:55.942860] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-16T17:35:56.071771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T17:35:56.081114] [INFO ] [REMOTE ] BGS: Full fetch complete (72680 records). [2025-10-16T17:35:56.081346] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-16T17:35:56.496317] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-16T17:35:56.496458] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-16T17:35:56.497370] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-16T17:35:56.497439] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-16T17:35:56.499006] [DEBUG] [LOCAL ] BGS: Trimmed 72680 records to 50921 (keeping 200 days of data) [2025-10-16T17:35:56.712048] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T17:35:56.750608] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-16T17:35:56.820036] [DEBUG] [LOCAL ] BGS: Primary data saved (50921 records). [2025-10-16T17:35:56.820232] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-16T17:35:56.820992] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGS took 51.9s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-16T17:35:56.999010] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:35:57.049288] [DEBUG] [LOCAL ] BHC: Loaded 46689 existing records from primary storage. [2025-10-16T17:35:57.049799] [INFO ] [MAIN ] BHC: Loaded 46689 existing records. [2025-10-16T17:35:57.249415] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:35:57.249706] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-16T17:35:57.249780] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-16T17:35:57.250023] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-16T17:35:57.250092] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-16T17:35:57.558352] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-16T17:35:57.598436] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:35:57.965425] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T17:35:58.128359] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:35:58.342845] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-16T17:35:59.142792] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-16T17:35:59.219398] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T17:35:59.942814] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-16T17:36:00.725779] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:36:00.742768] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-16T17:36:01.194835] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:36:01.542827] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-16T17:36:02.267235] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T17:36:02.342797] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-16T17:36:02.410791] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:36:03.142834] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-16T17:36:03.860019] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:36:03.942796] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-16T17:36:04.051097] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T17:36:04.742824] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-16T17:36:04.903698] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T17:36:05.515713] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T17:36:05.542814] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-16T17:36:06.343023] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-16T17:36:06.359736] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T17:36:07.142876] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-16T17:36:07.419249] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:36:07.942819] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-16T17:36:08.742801] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-16T17:36:08.772692] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:36:08.833361] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T17:36:09.542780] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-16T17:36:09.852057] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T17:36:09.854575] [INFO ] [REMOTE ] BGX: Full fetch complete (16672 records). [2025-10-16T17:36:09.854689] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-16T17:36:10.212912] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-16T17:36:10.212990] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-16T17:36:10.213313] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-16T17:36:10.213351] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-16T17:36:10.213919] [DEBUG] [LOCAL ] BGX: Trimmed 16672 records to 11261 (keeping 200 days of data) [2025-10-16T17:36:10.281299] [DEBUG] [LOCAL ] BGX: Primary data saved (11261 records). [2025-10-16T17:36:10.281426] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-16T17:36:10.281500] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGX took 33.0s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-16T17:36:10.345440] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-16T17:36:10.455888] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:10.468179] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:36:10.491142] [DEBUG] [LOCAL ] BHE: Loaded 23842 existing records from primary storage. [2025-10-16T17:36:10.491402] [INFO ] [MAIN ] BHE: Loaded 23842 existing records. [2025-10-16T17:36:10.669294] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:10.670331] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-16T17:36:10.670392] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-16T17:36:10.671080] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-16T17:36:10.671139] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-16T17:36:11.020475] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:11.142835] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-16T17:36:11.942856] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-16T17:36:12.095078] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T17:36:12.370053] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T17:36:12.742784] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-16T17:36:12.955709] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T17:36:13.526908] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:36:13.542782] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-16T17:36:14.342839] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-16T17:36:14.476230] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T17:36:15.142826] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-16T17:36:15.285620] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T17:36:15.942835] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-16T17:36:16.449328] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T17:36:16.742917] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-16T17:36:17.065598] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T17:36:17.069137] [INFO ] [REMOTE ] BGY: Full fetch complete (33173 records). [2025-10-16T17:36:17.069244] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-16T17:36:17.450868] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-16T17:36:17.450985] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-16T17:36:17.451542] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-16T17:36:17.451594] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-16T17:36:17.452535] [DEBUG] [LOCAL ] BGY: Trimmed 33173 records to 22120 (keeping 200 days of data) [2025-10-16T17:36:17.546890] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-16T17:36:17.585816] [DEBUG] [LOCAL ] BGY: Primary data saved (22120 records). [2025-10-16T17:36:17.586061] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-16T17:36:17.586201] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BGY took 39.1s. Estimated remaining: 4h 45m 14s. Rate: 7.4 symbols/min [2025-10-16T17:36:17.761052] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:17.775197] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T17:36:17.801063] [DEBUG] [LOCAL ] BHK: Loaded 23743 existing records from primary storage. [2025-10-16T17:36:17.801310] [INFO ] [MAIN ] BHK: Loaded 23743 existing records. [2025-10-16T17:36:17.977539] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:17.977776] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-16T17:36:17.977829] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-16T17:36:17.977992] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-16T17:36:17.978031] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-16T17:36:18.329233] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:18.342769] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-16T17:36:18.937549] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:36:19.142874] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-16T17:36:19.429156] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T17:36:19.942852] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-16T17:36:20.132394] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T17:36:20.742839] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-16T17:36:21.314413] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:36:21.487274] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T17:36:21.542773] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-16T17:36:22.342820] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-16T17:36:22.712833] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T17:36:23.144458] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-16T17:36:23.146877] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T17:36:23.942796] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-16T17:36:24.026555] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:36:24.742788] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-16T17:36:24.788604] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T17:36:25.542797] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-16T17:36:25.626287] [DEBUG] [REMOTE ] BHK: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T17:36:25.626531] [WARN ] [REMOTE ] BHK: No data returned for month 2025-03 [2025-10-16T17:36:25.626615] [FATAL] [REMOTE ] BHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:36:25.626721] [FATAL] [MAIN ] BHK: Failed to fetch primary data. [2025-10-16T17:36:25.626787] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:36:25.626861] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-16T17:36:25.626922] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-16T17:36:25.626957] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-16T17:36:25.627135] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-16T17:36:25.627216] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BHK took 8.0s. Estimated remaining: 4h 45m 5s. Rate: 7.4 symbols/min [2025-10-16T17:36:25.797477] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:25.845056] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-16T17:36:25.845377] [INFO ] [MAIN ] BHP: Loaded 53372 existing records. [2025-10-16T17:36:26.028232] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:26.028460] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-16T17:36:26.028512] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-16T17:36:26.028938] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-16T17:36:26.029024] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-16T17:36:26.348618] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-16T17:36:26.392540] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:26.419797] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:36:27.142784] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-16T17:36:27.541923] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T17:36:27.942834] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-16T17:36:28.248208] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T17:36:28.742789] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-16T17:36:28.772470] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:36:29.542824] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-16T17:36:30.342895] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-16T17:36:30.481074] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:36:31.142793] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-16T17:36:31.392406] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:36:31.395956] [INFO ] [REMOTE ] BHE: Full fetch complete (36361 records). [2025-10-16T17:36:31.396134] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-16T17:36:31.728029] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-16T17:36:31.810867] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-16T17:36:31.810940] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-16T17:36:31.811410] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-16T17:36:31.811449] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-16T17:36:31.812206] [DEBUG] [LOCAL ] BHE: Trimmed 36361 records to 24043 (keeping 200 days of data) [2025-10-16T17:36:31.944139] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-16T17:36:31.958062] [DEBUG] [LOCAL ] BHE: Primary data saved (24043 records). [2025-10-16T17:36:31.958145] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-16T17:36:31.958216] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHE took 21.7s. Estimated remaining: 4h 44m 43s. Rate: 7.4 symbols/min [2025-10-16T17:36:32.126157] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:32.147952] [DEBUG] [LOCAL ] BHR: Loaded 22093 existing records from primary storage. [2025-10-16T17:36:32.148167] [INFO ] [MAIN ] BHR: Loaded 22093 existing records. [2025-10-16T17:36:32.328335] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:32.328516] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-16T17:36:32.328582] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-16T17:36:32.328899] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-16T17:36:32.328979] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-16T17:36:32.691260] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:32.726936] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T17:36:32.742771] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-16T17:36:32.950787] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:36:32.953011] [INFO ] [REMOTE ] BH: Full fetch complete (19528 records). [2025-10-16T17:36:32.953080] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-16T17:36:33.318155] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-16T17:36:33.318250] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-16T17:36:33.318625] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-16T17:36:33.318706] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-16T17:36:33.319334] [DEBUG] [LOCAL ] BH: Trimmed 19528 records to 16356 (keeping 200 days of data) [2025-10-16T17:36:33.413393] [DEBUG] [LOCAL ] BH: Primary data saved (16356 records). [2025-10-16T17:36:33.413532] [INFO ] [MAIN ] BH: Full history saved. [2025-10-16T17:36:33.413611] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BH took 48.1s. Estimated remaining: 4h 43m 43s. Rate: 7.4 symbols/min [2025-10-16T17:36:33.555153] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-16T17:36:33.587115] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:33.587237] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-16T17:36:33.587275] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-16T17:36:33.587382] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-16T17:36:33.587425] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-16T17:36:33.587467] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-16T17:36:33.587502] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-16T17:36:33.930984] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T17:36:33.975411] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:34.342815] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-16T17:36:34.773617] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:36:35.132466] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T17:36:35.143164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-16T17:36:35.942811] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-16T17:36:36.280711] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T17:36:36.596352] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T17:36:36.602972] [INFO ] [REMOTE ] BHC: Full fetch complete (67491 records). [2025-10-16T17:36:36.603127] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-16T17:36:36.747889] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-16T17:36:37.031431] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-16T17:36:37.031509] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-16T17:36:37.032289] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-16T17:36:37.032351] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-16T17:36:37.033588] [DEBUG] [LOCAL ] BHC: Trimmed 67491 records to 47069 (keeping 200 days of data) [2025-10-16T17:36:37.291372] [DEBUG] [LOCAL ] BHC: Primary data saved (47069 records). [2025-10-16T17:36:37.291504] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-16T17:36:37.292305] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHC took 40.5s. Estimated remaining: 4h 43m 2s. Rate: 7.4 symbols/min [2025-10-16T17:36:37.459986] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:36:37.510293] [DEBUG] [LOCAL ] BHVN: Loaded 50605 existing records from primary storage. [2025-10-16T17:36:37.510622] [INFO ] [MAIN ] BHVN: Loaded 50605 existing records. [2025-10-16T17:36:37.551942] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-16T17:36:37.686588] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:36:37.686877] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-16T17:36:37.686936] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-16T17:36:37.687343] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-16T17:36:37.687409] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-16T17:36:38.028563] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:36:38.342778] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-16T17:36:38.450121] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T17:36:38.649100] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:36:39.142799] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-16T17:36:39.948212] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-16T17:36:39.953583] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T17:36:40.232784] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-16T17:36:40.742841] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-16T17:36:41.155902] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T17:36:41.309627] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:36:41.542831] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-16T17:36:41.815308] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T17:36:42.342844] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-16T17:36:43.142817] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-16T17:36:43.843049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:36:43.942783] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-16T17:36:44.313674] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:36:44.742803] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-16T17:36:45.397371] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:36:45.542807] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-16T17:36:46.342838] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-16T17:36:46.652700] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T17:36:46.746008] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-16T17:36:46.873448] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:36:47.142880] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-16T17:36:47.942854] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-16T17:36:48.702116] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T17:36:48.742811] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-16T17:36:49.110521] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T17:36:49.468320] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T17:36:49.542777] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-16T17:36:50.342757] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-16T17:36:50.508443] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T17:36:51.142827] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-16T17:36:51.765038] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:36:51.942906] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-16T17:36:52.742864] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-16T17:36:53.019958] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:36:53.152286] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T17:36:53.542787] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-16T17:36:53.650447] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T17:36:54.342811] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-16T17:36:55.142855] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-16T17:36:55.599253] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T17:36:55.633756] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-16T17:36:55.942843] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-16T17:36:56.037919] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:36:56.742874] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-16T17:36:57.117367] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T17:36:57.127966] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-16T17:36:57.542827] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-16T17:36:57.891004] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T17:36:58.342824] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-16T17:36:59.142894] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-16T17:36:59.942826] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-16T17:37:00.487505] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-16T17:37:00.742787] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-16T17:37:00.807265] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T17:37:00.853449] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:37:01.190910] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:37:01.542843] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-16T17:37:02.342843] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-16T17:37:02.890280] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T17:37:02.894158] [INFO ] [REMOTE ] BHR: Full fetch complete (31396 records). [2025-10-16T17:37:02.894319] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-16T17:37:03.151807] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-16T17:37:03.262537] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-16T17:37:03.262618] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-16T17:37:03.263174] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-16T17:37:03.263236] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-16T17:37:03.263991] [DEBUG] [LOCAL ] BHR: Trimmed 31396 records to 22248 (keeping 200 days of data) [2025-10-16T17:37:03.388764] [DEBUG] [LOCAL ] BHR: Primary data saved (22248 records). [2025-10-16T17:37:03.388897] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-16T17:37:03.389007] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHR took 31.4s. Estimated remaining: 4h 45m 13s. Rate: 7.4 symbols/min [2025-10-16T17:37:03.558615] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:03.612022] [DEBUG] [LOCAL ] BILL: Loaded 52497 existing records from primary storage. [2025-10-16T17:37:03.612381] [INFO ] [MAIN ] BILL: Loaded 52497 existing records. [2025-10-16T17:37:03.787700] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:03.787979] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-16T17:37:03.788027] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-16T17:37:03.788207] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-16T17:37:03.788246] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-16T17:37:03.952752] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-16T17:37:04.157287] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:04.325994] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:37:04.742792] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-16T17:37:05.105572] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T17:37:05.106290] [INFO ] [REMOTE ] BHV: Full fetch complete (1385 records). [2025-10-16T17:37:05.106359] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-16T17:37:05.284792] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-16T17:37:05.285339] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:37:05.285413] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:37:05.285485] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-16T17:37:05.285548] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-16T17:37:05.285597] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-16T17:37:05.297957] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-16T17:37:05.298112] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHV took 31.9s. Estimated remaining: 4h 44m 17s. Rate: 7.4 symbols/min [2025-10-16T17:37:05.397841] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-16T17:37:05.502783] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:05.527415] [DEBUG] [LOCAL ] BIO: Loaded 24027 existing records from primary storage. [2025-10-16T17:37:05.527694] [INFO ] [MAIN ] BIO: Loaded 24027 existing records. [2025-10-16T17:37:05.548116] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-16T17:37:05.713608] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:05.713824] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-16T17:37:05.713872] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-16T17:37:05.714049] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-16T17:37:05.714087] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-16T17:37:06.056914] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:06.349275] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-16T17:37:06.373115] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:37:07.142787] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-16T17:37:07.335314] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:37:07.519960] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:37:07.942879] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-16T17:37:08.742869] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-16T17:37:08.811937] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:37:09.270976] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-16T17:37:09.279092] [INFO ] [REMOTE ] BHP: Full fetch complete (77441 records). [2025-10-16T17:37:09.279414] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-16T17:37:09.551430] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-16T17:37:09.705272] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-16T17:37:09.705369] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-16T17:37:09.706274] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-16T17:37:09.706345] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-16T17:37:09.707977] [DEBUG] [LOCAL ] BHP: Trimmed 77441 records to 53762 (keeping 200 days of data) [2025-10-16T17:37:10.033219] [DEBUG] [LOCAL ] BHP: Primary data saved (53762 records). [2025-10-16T17:37:10.033375] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-16T17:37:10.033919] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHP took 44.4s. Estimated remaining: 4h 43m 43s. Rate: 7.4 symbols/min [2025-10-16T17:37:10.208796] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:10.251802] [DEBUG] [LOCAL ] BIP: Loaded 39192 existing records from primary storage. [2025-10-16T17:37:10.252137] [INFO ] [MAIN ] BIP: Loaded 39192 existing records. [2025-10-16T17:37:10.350268] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-16T17:37:10.431204] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:10.432208] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-16T17:37:10.432441] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-16T17:37:10.432714] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-16T17:37:10.432786] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-16T17:37:10.608332] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T17:37:10.822423] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:11.142826] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-16T17:37:11.177964] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:37:11.327232] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T17:37:11.942839] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-16T17:37:12.748124] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-16T17:37:12.761188] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:37:13.542823] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-16T17:37:13.973597] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T17:37:13.980156] [INFO ] [REMOTE ] BHVN: Full fetch complete (70520 records). [2025-10-16T17:37:13.980272] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-16T17:37:14.291114] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:37:14.347875] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-16T17:37:14.418172] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-16T17:37:14.418248] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-16T17:37:14.419220] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-16T17:37:14.419299] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-16T17:37:14.420707] [DEBUG] [LOCAL ] BHVN: Trimmed 70520 records to 50989 (keeping 200 days of data) [2025-10-16T17:37:14.714691] [DEBUG] [LOCAL ] BHVN: Primary data saved (50989 records). [2025-10-16T17:37:14.714802] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-16T17:37:14.715488] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHVN took 37.4s. Estimated remaining: 4h 43m 8s. Rate: 7.4 symbols/min [2025-10-16T17:37:14.892620] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:14.933311] [DEBUG] [LOCAL ] BIPC: Loaded 41257 existing records from primary storage. [2025-10-16T17:37:14.933685] [INFO ] [MAIN ] BIPC: Loaded 41257 existing records. [2025-10-16T17:37:15.130160] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:15.130368] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-16T17:37:15.130539] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-16T17:37:15.146423] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-16T17:37:15.140504] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-16T17:37:15.146602] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-16T17:37:15.251971] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:37:15.524167] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:15.541302] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:37:15.942849] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-16T17:37:16.742820] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-16T17:37:16.797231] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T17:37:17.428468] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T17:37:17.542809] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-16T17:37:18.046272] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T17:37:18.342891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-16T17:37:18.800907] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:37:19.142819] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-16T17:37:19.720892] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:37:19.942839] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-16T17:37:20.613581] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T17:37:20.742781] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-16T17:37:21.255556] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:37:21.542826] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-16T17:37:22.331083] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:37:22.342766] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-16T17:37:22.993441] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:37:23.142821] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-16T17:37:23.863520] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T17:37:23.942805] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-16T17:37:24.721542] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T17:37:24.742777] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-16T17:37:25.516162] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:37:25.542774] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-16T17:37:26.226445] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T17:37:26.342811] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-16T17:37:26.790218] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:37:27.142800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-16T17:37:27.942849] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-16T17:37:28.087208] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:37:28.323722] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T17:37:28.742867] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-16T17:37:29.363303] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T17:37:29.542818] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-16T17:37:30.124165] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:37:30.342820] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-16T17:37:30.987463] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T17:37:31.142819] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-16T17:37:31.801248] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T17:37:31.942785] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-16T17:37:32.603040] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:37:32.742821] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-16T17:37:33.080636] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:37:33.542869] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-16T17:37:34.295121] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:37:34.342800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-16T17:37:35.103582] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:37:35.142772] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-16T17:37:35.277483] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T17:37:35.942807] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-16T17:37:36.254290] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T17:37:36.742813] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-16T17:37:37.316793] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T17:37:37.542806] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-16T17:37:38.342784] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-16T17:37:38.423609] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:37:38.429188] [INFO ] [REMOTE ] BIP: Full fetch complete (57499 records). [2025-10-16T17:37:38.429285] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-16T17:37:38.806340] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-16T17:37:38.806414] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-16T17:37:38.807071] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-16T17:37:38.807132] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-16T17:37:38.808223] [DEBUG] [LOCAL ] BIP: Trimmed 57499 records to 39510 (keeping 200 days of data) [2025-10-16T17:37:39.050517] [DEBUG] [LOCAL ] BIP: Primary data saved (39510 records). [2025-10-16T17:37:39.050715] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-16T17:37:39.050822] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BIP took 29.0s. Estimated remaining: 4h 45m 3s. Rate: 7.3 symbols/min [2025-10-16T17:37:39.143586] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-16T17:37:39.233800] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:39.238865] [DEBUG] [LOCAL ] BIPH: Loaded 2518 existing records from primary storage. [2025-10-16T17:37:39.239092] [INFO ] [MAIN ] BIPH: Loaded 2518 existing records. [2025-10-16T17:37:39.418991] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:39.419479] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-16T17:37:39.419703] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-16T17:37:39.425126] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-16T17:37:39.425221] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-16T17:37:39.474416] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T17:37:39.698865] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-16T17:37:39.742774] [INFO ] [REMOTE ] BILL: Full fetch complete (76098 records). [2025-10-16T17:37:39.748556] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-16T17:37:39.924824] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:39.947880] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-16T17:37:40.239605] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-16T17:37:40.239713] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-16T17:37:40.240545] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-16T17:37:40.240587] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-16T17:37:40.241954] [DEBUG] [LOCAL ] BILL: Trimmed 76098 records to 52887 (keeping 200 days of data) [2025-10-16T17:37:40.543273] [DEBUG] [LOCAL ] BILL: Primary data saved (52887 records). [2025-10-16T17:37:40.543408] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-16T17:37:40.543486] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BILL took 37.2s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-16T17:37:40.742851] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-16T17:37:40.788910] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T17:37:40.819998] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T17:37:41.542199] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:37:41.544771] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-16T17:37:41.546992] [INFO ] [REMOTE ] BIO: Full fetch complete (34265 records). [2025-10-16T17:37:41.547158] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-16T17:37:41.931025] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-16T17:37:41.931101] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-16T17:37:41.931570] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-16T17:37:41.931609] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-16T17:37:41.932380] [DEBUG] [LOCAL ] BIO: Trimmed 34265 records to 24218 (keeping 200 days of data) [2025-10-16T17:37:42.079608] [DEBUG] [LOCAL ] BIO: Primary data saved (24218 records). [2025-10-16T17:37:42.079767] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-16T17:37:42.079851] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIO took 36.8s. Estimated remaining: 4h 43m 7s. Rate: 7.4 symbols/min [2025-10-16T17:37:42.149696] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T17:37:42.342847] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-16T17:37:42.766271] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T17:37:43.142821] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-16T17:37:43.942873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-16T17:37:44.538819] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T17:37:44.564898] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T17:37:44.742873] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-16T17:37:45.542873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-16T17:37:46.135060] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T17:37:46.134909] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:37:46.342790] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-16T17:37:46.780407] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:37:47.142824] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-16T17:37:47.942880] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-16T17:37:48.343029] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T17:37:48.688063] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:37:48.694230] [INFO ] [REMOTE ] BIPC: Full fetch complete (60276 records). [2025-10-16T17:37:48.694391] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-16T17:37:48.747896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-16T17:37:49.137186] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-16T17:37:49.137272] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-16T17:37:49.138017] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-16T17:37:49.138083] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-16T17:37:49.139357] [DEBUG] [LOCAL ] BIPC: Trimmed 60276 records to 41583 (keeping 200 days of data) [2025-10-16T17:37:49.319926] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:37:49.389556] [DEBUG] [LOCAL ] BIPC: Primary data saved (41583 records). [2025-10-16T17:37:49.389722] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-16T17:37:49.390345] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPC took 34.7s. Estimated remaining: 4h 42m 52s. Rate: 7.4 symbols/min [2025-10-16T17:37:49.542923] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-16T17:37:49.908146] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T17:37:50.342847] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-16T17:37:50.873080] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T17:37:51.142838] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-16T17:37:55.147312] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (4.00 seconds). [2025-10-16T17:37:55.148138] [INFO ] [REMOTE ] BIPH: Full fetch complete (3983 records). [2025-10-16T17:37:55.148206] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-16T17:37:55.498052] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-16T17:37:55.498114] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-16T17:37:55.498234] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-16T17:37:55.498274] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-16T17:37:55.498601] [DEBUG] [LOCAL ] BIPH: Trimmed 3983 records to 2526 (keeping 200 days of data) [2025-10-16T17:37:55.513497] [DEBUG] [LOCAL ] BIPH: Primary data saved (2526 records). [2025-10-16T17:37:55.513561] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-16T17:37:55.513624] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPH took 16.5s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-16T17:37:56.076410] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.169472] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.211191] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.237805] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:37:56.240705] [DEBUG] [LOCAL ] BIPJ: Loaded 3164 existing records from primary storage. [2025-10-16T17:37:56.241004] [INFO ] [MAIN ] BIPJ: Loaded 3164 existing records. [2025-10-16T17:37:56.313143] [DEBUG] [LOCAL ] BIPI: Loaded 2999 existing records from primary storage. [2025-10-16T17:37:56.329994] [INFO ] [MAIN ] BIPI: Loaded 2999 existing records. [2025-10-16T17:37:56.475974] [DEBUG] [LOCAL ] BIT: Loaded 23665 existing records from primary storage. [2025-10-16T17:37:56.559064] [INFO ] [MAIN ] BIT: Loaded 23665 existing records. [2025-10-16T17:37:56.562830] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:56.631990] [DEBUG] [LOCAL ] BIRK: Loaded 51107 existing records from primary storage. [2025-10-16T17:37:56.632081] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-16T17:37:56.674408] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-16T17:37:56.674596] [INFO ] [MAIN ] BIRK: Loaded 51107 existing records. [2025-10-16T17:37:56.720539] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-16T17:37:56.741670] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-16T17:37:56.874514] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:56.942525] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-16T17:37:56.988566] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-16T17:37:57.026990] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:57.053190] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-16T17:37:57.069091] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-16T17:37:57.090344] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-16T17:37:57.090633] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-16T17:37:57.090537] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-16T17:37:57.148518] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-16T17:37:57.253990] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:37:57.453614] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-16T17:37:57.516059] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-16T17:37:57.600696] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-16T17:37:57.664728] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-16T17:37:57.972710] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.079782] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-16T17:37:58.300285] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.362290] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-16T17:37:58.347496] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.387949] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-16T17:37:58.550518] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:37:58.550854] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-16T17:37:58.852498] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T17:37:58.854049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-16T17:37:58.932910] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:37:58.934953] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-16T17:37:59.310964] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:37:59.312235] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-16T17:37:59.539046] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T17:37:59.540573] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-16T17:37:59.553701] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:37:59.558386] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-16T17:37:59.587876] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-16T17:37:59.589094] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-16T17:37:59.834162] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:37:59.942848] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-16T17:37:59.984629] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:38:00.059524] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T17:38:00.380368] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:38:00.742920] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-16T17:38:01.127470] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T17:38:01.375835] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:38:01.542805] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-16T17:38:01.967411] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T17:38:02.342815] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-16T17:38:02.969757] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T17:38:03.142843] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-16T17:38:03.942811] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-16T17:38:04.624011] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:38:04.742900] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-16T17:38:04.949632] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:38:05.056944] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T17:38:05.542878] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-16T17:38:05.988128] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T17:38:06.342849] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-16T17:38:06.786163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:38:07.142883] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-16T17:38:07.515581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T17:38:07.942824] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-16T17:38:08.742863] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-16T17:38:09.234369] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:38:09.535104] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T17:38:09.545075] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-16T17:38:10.113603] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:38:10.342835] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-16T17:38:10.949202] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T17:38:11.142800] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-16T17:38:11.479620] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:38:11.942844] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-16T17:38:12.511157] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:38:12.742854] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-16T17:38:13.321499] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:38:13.322401] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4333 records). [2025-10-16T17:38:13.322468] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-16T17:38:13.548037] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-16T17:38:13.695892] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-16T17:38:13.695965] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-16T17:38:13.696114] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-16T17:38:13.696169] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-16T17:38:13.696540] [DEBUG] [LOCAL ] BIPJ: Trimmed 4333 records to 3180 (keeping 200 days of data) [2025-10-16T17:38:13.715304] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3180 records). [2025-10-16T17:38:13.715412] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-16T17:38:13.715497] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 36s. Rate: 7.4 symbols/min [2025-10-16T17:38:13.884930] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:13.936001] [DEBUG] [LOCAL ] BJ: Loaded 51595 existing records from primary storage. [2025-10-16T17:38:13.936339] [INFO ] [MAIN ] BJ: Loaded 51595 existing records. [2025-10-16T17:38:14.116689] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:14.116915] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-16T17:38:14.116969] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-16T17:38:14.117299] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-16T17:38:14.117339] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-16T17:38:14.347902] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-16T17:38:14.495117] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:14.842673] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T17:38:15.142842] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-16T17:38:15.350105] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:38:15.587507] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:38:15.588381] [INFO ] [REMOTE ] BIPI: Full fetch complete (4762 records). [2025-10-16T17:38:15.588447] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-16T17:38:15.935659] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-16T17:38:15.935743] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-16T17:38:15.935902] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-16T17:38:15.935966] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-16T17:38:15.936318] [DEBUG] [LOCAL ] BIPI: Trimmed 4762 records to 3012 (keeping 200 days of data) [2025-10-16T17:38:15.945772] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-16T17:38:15.955928] [DEBUG] [LOCAL ] BIPI: Primary data saved (3012 records). [2025-10-16T17:38:15.955996] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-16T17:38:15.956068] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIPI took 20.4s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-16T17:38:16.130503] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:16.179431] [DEBUG] [LOCAL ] BK: Loaded 53543 existing records from primary storage. [2025-10-16T17:38:16.179782] [INFO ] [MAIN ] BK: Loaded 53543 existing records. [2025-10-16T17:38:16.352928] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:16.353139] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-16T17:38:16.353195] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-16T17:38:16.353583] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-16T17:38:16.353624] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-16T17:38:16.699247] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:16.742788] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-16T17:38:17.438894] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T17:38:17.542809] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-16T17:38:17.902810] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T17:38:18.342869] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-16T17:38:18.900680] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T17:38:19.142924] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-16T17:38:19.892985] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T17:38:19.942819] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-16T17:38:20.009601] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:38:20.742841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-16T17:38:20.873891] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:38:21.542816] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-16T17:38:22.123621] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T17:38:22.342841] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-16T17:38:23.142800] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-16T17:38:23.259250] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T17:38:23.599428] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T17:38:23.942881] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-16T17:38:24.143300] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:38:24.742836] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-16T17:38:25.432721] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T17:38:25.542850] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-16T17:38:26.342862] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-16T17:38:26.565733] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:38:27.018396] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:38:27.053543] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:38:27.142829] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-16T17:38:27.942867] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-16T17:38:28.742778] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-16T17:38:28.968694] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:38:29.357823] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:38:29.542853] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-16T17:38:30.008354] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:38:30.342788] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-16T17:38:31.142880] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-16T17:38:31.514193] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:38:31.520970] [INFO ] [REMOTE ] BIRK: Full fetch complete (73323 records). [2025-10-16T17:38:31.521124] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-16T17:38:31.911675] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-16T17:38:31.911828] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-16T17:38:31.912681] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-16T17:38:31.912783] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-16T17:38:31.914186] [DEBUG] [LOCAL ] BIRK: Trimmed 73323 records to 51493 (keeping 200 days of data) [2025-10-16T17:38:31.961752] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-16T17:38:32.229601] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T17:38:32.252946] [DEBUG] [LOCAL ] BIRK: Primary data saved (51493 records). [2025-10-16T17:38:32.253054] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-16T17:38:32.253692] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIRK took 36.7s. Estimated remaining: 4h 43m 37s. Rate: 7.4 symbols/min [2025-10-16T17:38:32.422374] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:32.471604] [DEBUG] [LOCAL ] BKD: Loaded 50474 existing records from primary storage. [2025-10-16T17:38:32.471918] [INFO ] [MAIN ] BKD: Loaded 50474 existing records. [2025-10-16T17:38:32.651555] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:32.651877] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-16T17:38:32.651935] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-16T17:38:32.652408] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-16T17:38:32.652510] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-16T17:38:32.768486] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-16T17:38:32.806152] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:38:33.076186] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:33.403454] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T17:38:33.542804] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-16T17:38:34.173231] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T17:38:34.342769] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-16T17:38:34.445887] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T17:38:35.142820] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-16T17:38:35.942835] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-16T17:38:36.267044] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T17:38:36.503990] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:38:36.742777] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-16T17:38:37.542894] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-16T17:38:37.717479] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:38:37.957298] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T17:38:37.961226] [INFO ] [REMOTE ] BIT: Full fetch complete (32124 records). [2025-10-16T17:38:37.961303] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-16T17:38:38.340923] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-16T17:38:38.341013] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-16T17:38:38.341703] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-16T17:38:38.341764] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-16T17:38:38.342519] [DEBUG] [LOCAL ] BIT: Trimmed 32124 records to 23884 (keeping 200 days of data) [2025-10-16T17:38:38.342888] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-16T17:38:38.484962] [DEBUG] [LOCAL ] BIT: Primary data saved (23884 records). [2025-10-16T17:38:38.485080] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-16T17:38:38.485153] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIT took 43.0s. Estimated remaining: 4h 43m 14s. Rate: 7.4 symbols/min [2025-10-16T17:38:38.662368] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:38.704259] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:38:38.724005] [DEBUG] [LOCAL ] BKE: Loaded 33979 existing records from primary storage. [2025-10-16T17:38:38.724254] [INFO ] [MAIN ] BKE: Loaded 33979 existing records. [2025-10-16T17:38:38.902218] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:38.902470] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-16T17:38:38.902518] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-16T17:38:38.902873] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-16T17:38:38.902932] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-16T17:38:39.153307] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-16T17:38:39.271662] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:39.872278] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:38:39.942769] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-16T17:38:40.722804] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T17:38:40.742775] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-16T17:38:41.146906] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T17:38:41.542832] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-16T17:38:42.342844] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-16T17:38:42.555371] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:38:43.080510] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T17:38:43.142779] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-16T17:38:43.387974] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T17:38:43.942845] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-16T17:38:44.320399] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T17:38:44.742862] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-16T17:38:45.248887] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:38:45.542834] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-16T17:38:46.342836] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-16T17:38:46.390495] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:38:46.628612] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T17:38:47.142839] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-16T17:38:47.942797] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-16T17:38:48.113590] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T17:38:48.742830] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-16T17:38:49.024978] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T17:38:49.217015] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:38:49.542832] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-16T17:38:50.342864] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-16T17:38:50.495148] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:38:50.868693] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T17:38:51.142812] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-16T17:38:51.942880] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-16T17:38:52.143573] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T17:38:52.742868] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-16T17:38:52.959224] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T17:38:52.966402] [INFO ] [REMOTE ] BK: Full fetch complete (77673 records). [2025-10-16T17:38:52.966572] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-16T17:38:53.418426] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-16T17:38:53.418604] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-16T17:38:53.419528] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-16T17:38:53.419613] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-16T17:38:53.448728] [DEBUG] [LOCAL ] BK: Trimmed 77673 records to 53933 (keeping 200 days of data) [2025-10-16T17:38:53.450448] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:38:53.549789] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-16T17:38:53.795925] [DEBUG] [LOCAL ] BK: Primary data saved (53933 records). [2025-10-16T17:38:53.796090] [INFO ] [MAIN ] BK: Full history saved. [2025-10-16T17:38:53.796194] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BK took 37.8s. Estimated remaining: 4h 43m 58s. Rate: 7.3 symbols/min [2025-10-16T17:38:53.961677] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:38:53.995786] [DEBUG] [LOCAL ] BKH: Loaded 37090 existing records from primary storage. [2025-10-16T17:38:53.996072] [INFO ] [MAIN ] BKH: Loaded 37090 existing records. [2025-10-16T17:38:54.171140] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:38:54.171436] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-16T17:38:54.171485] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-16T17:38:54.171723] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-16T17:38:54.171780] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-16T17:38:54.343103] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-16T17:38:54.534826] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:38:54.569555] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T17:38:54.749555] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T17:38:55.142836] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-16T17:38:55.581099] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T17:38:55.942817] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-16T17:38:56.255798] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:38:56.742813] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-16T17:38:56.818521] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:38:57.542828] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-16T17:38:58.297136] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T17:38:58.342772] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-16T17:38:58.962834] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:38:59.142799] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-16T17:38:59.942872] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-16T17:39:00.027521] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T17:39:00.034098] [INFO ] [REMOTE ] BKD: Full fetch complete (72095 records). [2025-10-16T17:39:00.034206] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-16T17:39:00.450364] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:39:00.450517] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-16T17:39:00.450627] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-16T17:39:00.458192] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-16T17:39:00.458687] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-16T17:39:00.460103] [DEBUG] [LOCAL ] BKD: Trimmed 72095 records to 50839 (keeping 200 days of data) [2025-10-16T17:39:00.745234] [DEBUG] [LOCAL ] BKD: Primary data saved (50839 records). [2025-10-16T17:39:00.745575] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-16T17:39:00.746332] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BKD took 28.5s. Estimated remaining: 4h 43m 41s. Rate: 7.3 symbols/min [2025-10-16T17:39:00.745372] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-16T17:39:00.942057] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:00.991395] [DEBUG] [LOCAL ] BKKT: Loaded 36603 existing records from primary storage. [2025-10-16T17:39:00.991811] [INFO ] [MAIN ] BKKT: Loaded 36603 existing records. [2025-10-16T17:39:01.299681] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:39:01.332538] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:01.332869] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-16T17:39:01.332943] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-16T17:39:01.333298] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-16T17:39:01.333354] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-16T17:39:01.556498] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-16T17:39:01.815212] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:02.342787] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-16T17:39:02.823543] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T17:39:02.888379] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:39:03.142864] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-16T17:39:03.767473] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:39:03.942816] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-16T17:39:04.546718] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T17:39:04.742813] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-16T17:39:05.393261] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:39:05.542827] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-16T17:39:05.965097] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:39:05.969575] [INFO ] [REMOTE ] BKE: Full fetch complete (50411 records). [2025-10-16T17:39:05.969700] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-16T17:39:06.345120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-16T17:39:06.345361] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-16T17:39:06.345430] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-16T17:39:06.346196] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-16T17:39:06.346275] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-16T17:39:06.347985] [DEBUG] [LOCAL ] BKE: Trimmed 50411 records to 34197 (keeping 200 days of data) [2025-10-16T17:39:06.564273] [DEBUG] [LOCAL ] BKE: Primary data saved (34197 records). [2025-10-16T17:39:06.564386] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-16T17:39:06.564462] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKE took 28.1s. Estimated remaining: 4h 43m 16s. Rate: 7.3 symbols/min [2025-10-16T17:39:06.737669] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:06.747521] [DEBUG] [LOCAL ] BKN: Loaded 7312 existing records from primary storage. [2025-10-16T17:39:06.747752] [INFO ] [MAIN ] BKN: Loaded 7312 existing records. [2025-10-16T17:39:06.923964] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:06.924167] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-16T17:39:06.924218] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-16T17:39:06.924376] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-16T17:39:06.924432] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-16T17:39:07.147595] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-16T17:39:07.288281] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:07.310692] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T17:39:07.796737] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:39:07.942847] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-16T17:39:08.645069] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:39:08.651700] [INFO ] [REMOTE ] BJ: Full fetch complete (74416 records). [2025-10-16T17:39:08.651825] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-16T17:39:08.752566] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-16T17:39:09.045804] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-16T17:39:09.045944] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-16T17:39:09.046853] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-16T17:39:09.046922] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-16T17:39:09.048376] [DEBUG] [LOCAL ] BJ: Trimmed 74416 records to 51977 (keeping 200 days of data) [2025-10-16T17:39:09.369094] [DEBUG] [LOCAL ] BJ: Primary data saved (51977 records). [2025-10-16T17:39:09.369260] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-16T17:39:09.369619] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BJ took 55.7s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-16T17:39:09.371013] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T17:39:09.548059] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-16T17:39:09.552945] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:09.601469] [DEBUG] [LOCAL ] BKSY: Loaded 48700 existing records from primary storage. [2025-10-16T17:39:09.601813] [INFO ] [MAIN ] BKSY: Loaded 48700 existing records. [2025-10-16T17:39:09.778452] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:09.778722] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-16T17:39:09.778781] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-16T17:39:09.779138] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-16T17:39:09.779195] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-16T17:39:10.142114] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:10.165697] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:39:10.217281] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T17:39:10.342817] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-16T17:39:11.124663] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:39:11.142762] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-16T17:39:11.781226] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:39:11.942823] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-16T17:39:12.742874] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-16T17:39:13.240818] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T17:39:13.542819] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-16T17:39:14.342888] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-16T17:39:14.554833] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:39:15.079221] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:39:15.142783] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-16T17:39:15.697766] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:39:15.942893] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-16T17:39:16.695203] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T17:39:16.742825] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-16T17:39:17.542812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-16T17:39:17.730413] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T17:39:17.905092] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:39:18.074415] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T17:39:18.342840] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-16T17:39:19.142901] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-16T17:39:19.727476] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T17:39:19.942871] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-16T17:39:20.703849] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:39:20.708852] [INFO ] [REMOTE ] BKH: Full fetch complete (52837 records). [2025-10-16T17:39:20.709031] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-16T17:39:20.752689] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-16T17:39:21.090326] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-16T17:39:21.090405] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-16T17:39:21.091039] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-16T17:39:21.091112] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-16T17:39:21.092235] [DEBUG] [LOCAL ] BKH: Trimmed 52837 records to 37416 (keeping 200 days of data) [2025-10-16T17:39:21.309661] [DEBUG] [LOCAL ] BKH: Primary data saved (37416 records). [2025-10-16T17:39:21.309794] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-16T17:39:21.309871] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKH took 27.5s. Estimated remaining: 4h 42m 48s. Rate: 7.4 symbols/min [2025-10-16T17:39:21.483124] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:21.499613] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T17:39:21.515217] [DEBUG] [LOCAL ] BKT: Loaded 12457 existing records from primary storage. [2025-10-16T17:39:21.515413] [INFO ] [MAIN ] BKT: Loaded 12457 existing records. [2025-10-16T17:39:21.547988] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-16T17:39:21.691104] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:21.691294] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-16T17:39:21.691341] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-16T17:39:21.691537] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-16T17:39:21.691576] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-16T17:39:22.033723] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:22.342877] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-16T17:39:22.454919] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T17:39:22.808543] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-16T17:39:23.142827] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-16T17:39:23.424950] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T17:39:23.942899] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-16T17:39:23.957711] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T17:39:24.443521] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-16T17:39:24.742842] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-16T17:39:25.506005] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T17:39:25.542818] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-16T17:39:26.342871] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-16T17:39:27.142875] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-16T17:39:27.451477] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T17:39:27.834543] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:39:27.939593] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T17:39:27.947727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-16T17:39:28.742825] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-16T17:39:29.542777] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-16T17:39:29.636557] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:39:30.266866] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T17:39:30.342789] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-16T17:39:30.467208] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:39:31.120833] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T17:39:31.142773] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-16T17:39:31.656358] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T17:39:31.942807] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-16T17:39:32.742824] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-16T17:39:33.542807] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-16T17:39:33.658727] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T17:39:33.908691] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:39:34.342812] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-16T17:39:34.905935] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T17:39:35.016362] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:39:35.142821] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-16T17:39:35.942874] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-16T17:39:36.742785] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-16T17:39:36.880163] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:39:37.220916] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T17:39:37.228160] [INFO ] [REMOTE ] BKKT: Full fetch complete (51422 records). [2025-10-16T17:39:37.228504] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-16T17:39:37.553294] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-16T17:39:37.657622] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-16T17:39:37.657761] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-16T17:39:37.658762] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-16T17:39:37.658880] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-16T17:39:37.660776] [DEBUG] [LOCAL ] BKKT: Trimmed 51422 records to 36968 (keeping 200 days of data) [2025-10-16T17:39:37.886733] [DEBUG] [LOCAL ] BKKT: Primary data saved (36968 records). [2025-10-16T17:39:37.886927] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-16T17:39:37.887025] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKKT took 37.1s. Estimated remaining: 4h 43m 41s. Rate: 7.3 symbols/min [2025-10-16T17:39:38.075882] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:38.094063] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-16T17:39:38.128466] [DEBUG] [LOCAL ] BKU: Loaded 42161 existing records from primary storage. [2025-10-16T17:39:38.128918] [INFO ] [MAIN ] BKU: Loaded 42161 existing records. [2025-10-16T17:39:38.325290] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:38.325634] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-16T17:39:38.325722] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-16T17:39:38.326118] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-16T17:39:38.326176] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-16T17:39:38.348104] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-16T17:39:38.707221] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:38.867528] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T17:39:38.965491] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T17:39:39.142853] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-16T17:39:39.767190] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T17:39:39.769097] [INFO ] [REMOTE ] BKN: Full fetch complete (11286 records). [2025-10-16T17:39:39.769204] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-16T17:39:39.949687] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-16T17:39:40.155316] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-16T17:39:40.155386] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-16T17:39:40.155667] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-16T17:39:40.155728] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-16T17:39:40.156153] [DEBUG] [LOCAL ] BKN: Trimmed 11286 records to 7345 (keeping 200 days of data) [2025-10-16T17:39:40.199589] [DEBUG] [LOCAL ] BKN: Primary data saved (7345 records). [2025-10-16T17:39:40.199745] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-16T17:39:40.199830] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKN took 33.6s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-16T17:39:40.368766] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:40.397145] [DEBUG] [LOCAL ] BKV: Loaded 29596 existing records from primary storage. [2025-10-16T17:39:40.397398] [INFO ] [MAIN ] BKV: Loaded 29596 existing records. [2025-10-16T17:39:40.575986] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:40.576183] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-16T17:39:40.576230] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-16T17:39:40.576509] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-16T17:39:40.576548] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-16T17:39:40.755791] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-16T17:39:40.852298] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T17:39:40.951946] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:41.542884] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-16T17:39:42.342872] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-16T17:39:42.657712] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:39:42.785461] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T17:39:42.997444] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T17:39:43.142816] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-16T17:39:43.942873] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-16T17:39:44.377319] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T17:39:44.632909] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T17:39:44.742872] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-16T17:39:45.542859] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-16T17:39:46.309186] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T17:39:46.342859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-16T17:39:46.529111] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T17:39:47.142874] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-16T17:39:47.781547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T17:39:47.942834] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-16T17:39:48.563955] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T17:39:48.742877] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-16T17:39:49.133345] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:39:49.136463] [INFO ] [REMOTE ] BKT: Full fetch complete (16339 records). [2025-10-16T17:39:49.136564] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-16T17:39:49.534822] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-16T17:39:49.534899] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-16T17:39:49.535251] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-16T17:39:49.535292] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-16T17:39:49.535858] [DEBUG] [LOCAL ] BKT: Trimmed 16339 records to 12606 (keeping 200 days of data) [2025-10-16T17:39:49.568140] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-16T17:39:49.613525] [DEBUG] [LOCAL ] BKT: Primary data saved (12606 records). [2025-10-16T17:39:49.613737] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-16T17:39:49.613824] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKT took 28.3s. Estimated remaining: 4h 42m 51s. Rate: 7.3 symbols/min [2025-10-16T17:39:49.784904] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:39:49.804321] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T17:39:49.839542] [DEBUG] [LOCAL ] BLCO: Loaded 35230 existing records from primary storage. [2025-10-16T17:39:49.839838] [INFO ] [MAIN ] BLCO: Loaded 35230 existing records. [2025-10-16T17:39:50.011766] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:39:50.012036] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-16T17:39:50.012117] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-16T17:39:50.012370] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-16T17:39:50.012426] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-16T17:39:50.358586] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-16T17:39:50.365035] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:39:50.563976] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:39:51.142822] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-16T17:39:51.790721] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T17:39:51.942825] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-16T17:39:52.695031] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T17:39:52.742856] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-16T17:39:53.356508] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T17:39:53.542885] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-16T17:39:53.988757] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T17:39:54.342902] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-16T17:39:54.941341] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T17:39:55.142860] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-16T17:39:55.942860] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-16T17:39:56.324889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T17:39:56.390398] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:39:56.742906] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-16T17:39:57.041118] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:39:57.542826] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-16T17:39:58.342842] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-16T17:39:58.635012] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:39:58.722828] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:39:59.142909] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-16T17:39:59.603970] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T17:39:59.942825] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-16T17:40:00.502121] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T17:40:00.742835] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-16T17:40:01.546763] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-16T17:40:01.553149] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:40:02.251370] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T17:40:02.342881] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-16T17:40:02.786679] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:40:03.142889] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-16T17:40:03.948194] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-16T17:40:03.964919] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T17:40:04.742864] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-16T17:40:05.197803] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:40:05.202636] [INFO ] [REMOTE ] BKV: Full fetch complete (44861 records). [2025-10-16T17:40:05.202787] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-16T17:40:05.551847] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-16T17:40:05.621297] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-16T17:40:05.621523] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-16T17:40:05.622237] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-16T17:40:05.622316] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-16T17:40:05.641038] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T17:40:05.648039] [DEBUG] [LOCAL ] BKV: Trimmed 44861 records to 29852 (keeping 200 days of data) [2025-10-16T17:40:05.648626] [INFO ] [REMOTE ] BKSY: Full fetch complete (70402 records). [2025-10-16T17:40:05.648944] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-16T17:40:06.170165] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-16T17:40:06.176497] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-16T17:40:06.177560] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-16T17:40:06.200186] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-16T17:40:06.236226] [DEBUG] [LOCAL ] BKV: Primary data saved (29852 records). [2025-10-16T17:40:06.236763] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-16T17:40:06.236945] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKV took 26.0s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-16T17:40:06.248608] [DEBUG] [LOCAL ] BKSY: Trimmed 70402 records to 49090 (keeping 200 days of data) [2025-10-16T17:40:06.460870] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T17:40:06.613451] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-16T17:40:06.612815] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:06.738810] [DEBUG] [LOCAL ] BKSY: Primary data saved (49090 records). [2025-10-16T17:40:06.747356] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-16T17:40:06.747830] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKSY took 57.4s. Estimated remaining: 4h 42m 40s. Rate: 7.3 symbols/min [2025-10-16T17:40:06.898456] [DEBUG] [LOCAL ] BLD: Loaded 27482 existing records from primary storage. [2025-10-16T17:40:06.927788] [INFO ] [MAIN ] BLD: Loaded 27482 existing records. [2025-10-16T17:40:06.931413] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:07.122982] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:07.123835] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-16T17:40:07.124109] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-16T17:40:07.124513] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-16T17:40:07.124628] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-16T17:40:07.346509] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:40:07.325533] [DEBUG] [LOCAL ] BLDR: Loaded 51906 existing records from primary storage. [2025-10-16T17:40:07.379099] [INFO ] [MAIN ] BLDR: Loaded 51906 existing records. [2025-10-16T17:40:07.491057] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-16T17:40:07.777393] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:07.805625] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:07.806028] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-16T17:40:07.806147] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-16T17:40:07.806377] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-16T17:40:07.806432] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-16T17:40:07.961717] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-16T17:40:08.184175] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:08.205462] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:40:08.742877] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-16T17:40:09.015759] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T17:40:09.424768] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T17:40:09.542807] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-16T17:40:10.342866] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-16T17:40:10.760116] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T17:40:11.142819] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-16T17:40:11.762254] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T17:40:11.942822] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-16T17:40:12.026284] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:40:12.442002] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (3.70 seconds). [2025-10-16T17:40:12.742812] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-16T17:40:13.349094] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:40:13.542852] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-16T17:40:14.081414] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:40:14.342823] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-16T17:40:14.461974] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:40:15.142859] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-16T17:40:15.290043] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:40:15.942834] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-16T17:40:16.742777] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-16T17:40:16.872010] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:40:16.922251] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T17:40:17.542817] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-16T17:40:18.342905] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-16T17:40:18.555384] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:40:18.596507] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:40:19.142895] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-16T17:40:19.596320] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T17:40:19.602380] [INFO ] [REMOTE ] BKU: Full fetch complete (60782 records). [2025-10-16T17:40:19.602519] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-16T17:40:19.947235] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-16T17:40:19.986260] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-16T17:40:19.986374] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-16T17:40:19.987112] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-16T17:40:19.987176] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-16T17:40:19.988357] [DEBUG] [LOCAL ] BKU: Trimmed 60782 records to 42528 (keeping 200 days of data) [2025-10-16T17:40:20.240999] [DEBUG] [LOCAL ] BKU: Primary data saved (42528 records). [2025-10-16T17:40:20.241119] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-16T17:40:20.241862] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKU took 42.4s. Estimated remaining: 4h 43m 10s. Rate: 7.3 symbols/min [2025-10-16T17:40:20.412347] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:20.427715] [DEBUG] [LOCAL ] BLE: Loaded 13810 existing records from primary storage. [2025-10-16T17:40:20.427969] [INFO ] [MAIN ] BLE: Loaded 13810 existing records. [2025-10-16T17:40:20.602168] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:20.602344] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-16T17:40:20.602390] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-16T17:40:20.602555] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-16T17:40:20.602610] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-16T17:40:20.743981] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-16T17:40:20.961573] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:20.999444] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T17:40:21.019875] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:40:21.024059] [INFO ] [REMOTE ] BLCO: Full fetch complete (52331 records). [2025-10-16T17:40:21.024148] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-16T17:40:21.402060] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-16T17:40:21.402134] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-16T17:40:21.402783] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-16T17:40:21.402844] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-16T17:40:21.403865] [DEBUG] [LOCAL ] BLCO: Trimmed 52331 records to 35460 (keeping 200 days of data) [2025-10-16T17:40:21.551309] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-16T17:40:21.603523] [DEBUG] [LOCAL ] BLCO: Primary data saved (35460 records). [2025-10-16T17:40:21.603635] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-16T17:40:21.603782] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 32.0s. Estimated remaining: 4h 42m 14s. Rate: 7.3 symbols/min [2025-10-16T17:40:21.771788] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:21.803868] [DEBUG] [LOCAL ] BLK: Loaded 34301 existing records from primary storage. [2025-10-16T17:40:21.804139] [INFO ] [MAIN ] BLK: Loaded 34301 existing records. [2025-10-16T17:40:21.985718] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:21.985958] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-16T17:40:21.986015] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-16T17:40:21.986264] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-16T17:40:21.986338] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-16T17:40:22.345609] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-16T17:40:22.349483] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:22.379073] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:40:22.774892] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-16T17:40:23.142895] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-16T17:40:23.696213] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T17:40:23.710743] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T17:40:23.942886] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-16T17:40:24.742789] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-16T17:40:24.831000] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:40:25.542811] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-16T17:40:26.276750] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:40:26.342836] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-16T17:40:26.532463] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:40:27.142789] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-16T17:40:27.307067] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T17:40:27.942869] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-16T17:40:28.742864] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-16T17:40:28.935571] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:40:29.034913] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T17:40:29.542872] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-16T17:40:29.934530] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:40:29.937878] [INFO ] [REMOTE ] BLD: Full fetch complete (39928 records). [2025-10-16T17:40:29.937977] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-16T17:40:30.306677] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-16T17:40:30.306773] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-16T17:40:30.307301] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-16T17:40:30.307342] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-16T17:40:30.308308] [DEBUG] [LOCAL ] BLD: Trimmed 39928 records to 27593 (keeping 200 days of data) [2025-10-16T17:40:30.361395] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-16T17:40:30.480513] [DEBUG] [LOCAL ] BLD: Primary data saved (27593 records). [2025-10-16T17:40:30.480689] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-16T17:40:30.480787] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 24.2s. Estimated remaining: 4h 42m 10s. Rate: 7.3 symbols/min [2025-10-16T17:40:30.651064] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:30.695097] [DEBUG] [LOCAL ] BLND: Loaded 49281 existing records from primary storage. [2025-10-16T17:40:30.695420] [INFO ] [MAIN ] BLND: Loaded 49281 existing records. [2025-10-16T17:40:30.874439] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:30.874712] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-16T17:40:30.874778] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-16T17:40:30.875243] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-16T17:40:30.875301] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-16T17:40:31.152757] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-16T17:40:31.250729] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:31.364720] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:40:31.805452] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T17:40:31.859636] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:40:31.942809] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-16T17:40:32.742858] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-16T17:40:33.453981] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T17:40:33.542815] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-16T17:40:33.798639] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:40:34.342851] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-16T17:40:35.099530] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T17:40:35.142775] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-16T17:40:35.942798] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-16T17:40:36.189346] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T17:40:36.742868] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-16T17:40:36.808888] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T17:40:36.981497] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:40:37.542863] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-16T17:40:38.342842] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-16T17:40:38.759219] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T17:40:39.142862] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-16T17:40:39.304084] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:40:39.809203] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T17:40:39.942837] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-16T17:40:40.742872] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-16T17:40:40.899255] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:40:41.131849] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T17:40:41.542834] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-16T17:40:42.342832] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-16T17:40:42.390164] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:40:43.142786] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-16T17:40:43.168733] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:40:43.851995] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:40:43.942831] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-16T17:40:44.330475] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T17:40:44.742797] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-16T17:40:45.542896] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-16T17:40:45.937061] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:40:45.947520] [INFO ] [REMOTE ] BLDR: Full fetch complete (74728 records). [2025-10-16T17:40:45.947818] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-16T17:40:46.350944] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-16T17:40:46.409507] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T17:40:46.505929] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-16T17:40:46.506043] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-16T17:40:46.506952] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-16T17:40:46.507070] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-16T17:40:46.509076] [DEBUG] [LOCAL ] BLDR: Trimmed 74728 records to 52281 (keeping 200 days of data) [2025-10-16T17:40:46.533916] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:40:46.855956] [DEBUG] [LOCAL ] BLDR: Primary data saved (52281 records). [2025-10-16T17:40:46.856094] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-16T17:40:46.856516] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLDR took 40.1s. Estimated remaining: 4h 42m 59s. Rate: 7.3 symbols/min [2025-10-16T17:40:47.047329] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:47.047547] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-16T17:40:47.047593] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-16T17:40:47.047730] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-16T17:40:47.047775] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-16T17:40:47.047819] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-16T17:40:47.047851] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-16T17:40:47.147921] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-16T17:40:47.406740] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:47.738801] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T17:40:47.942836] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-16T17:40:48.036993] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:40:48.742865] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-16T17:40:48.918203] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:40:48.918502] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-16T17:40:48.918596] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:40:48.918668] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-16T17:40:48.918724] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:40:48.918790] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-16T17:40:48.918852] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-16T17:40:48.918888] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-16T17:40:48.918927] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-16T17:40:48.918998] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLSH took 2.1s. Estimated remaining: 4h 42m 9s. Rate: 7.3 symbols/min [2025-10-16T17:40:49.101118] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:49.120599] [DEBUG] [LOCAL ] BLW: Loaded 13190 existing records from primary storage. [2025-10-16T17:40:49.120962] [INFO ] [MAIN ] BLW: Loaded 13190 existing records. [2025-10-16T17:40:49.318594] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:49.319298] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-16T17:40:49.319480] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-16T17:40:49.326114] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-16T17:40:49.336461] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-16T17:40:49.374564] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:40:49.549248] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-16T17:40:49.773393] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:50.342862] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-16T17:40:51.027365] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:40:51.142835] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-16T17:40:51.265923] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:40:51.942885] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-16T17:40:52.742825] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-16T17:40:52.806285] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:40:52.905755] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:40:53.542806] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-16T17:40:54.304740] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:40:54.342793] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-16T17:40:54.392318] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T17:40:54.394293] [INFO ] [REMOTE ] BLE: Full fetch complete (19796 records). [2025-10-16T17:40:54.394369] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-16T17:40:54.748291] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-16T17:40:54.748369] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-16T17:40:54.748762] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-16T17:40:54.748823] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-16T17:40:54.749387] [DEBUG] [LOCAL ] BLE: Trimmed 19796 records to 13880 (keeping 200 days of data) [2025-10-16T17:40:54.829099] [DEBUG] [LOCAL ] BLE: Primary data saved (13880 records). [2025-10-16T17:40:54.829265] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-16T17:40:54.829351] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLE took 34.6s. Estimated remaining: 4h 41m 45s. Rate: 7.3 symbols/min [2025-10-16T17:40:54.992455] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:55.008249] [DEBUG] [LOCAL ] BLX: Loaded 15583 existing records from primary storage. [2025-10-16T17:40:55.008472] [INFO ] [MAIN ] BLX: Loaded 15583 existing records. [2025-10-16T17:40:55.147069] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-16T17:40:55.182022] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:55.182178] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-16T17:40:55.182224] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-16T17:40:55.182425] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-16T17:40:55.182482] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-16T17:40:55.580040] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:55.942832] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-16T17:40:55.990365] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T17:40:56.034405] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:40:56.039497] [INFO ] [REMOTE ] BLK: Full fetch complete (52996 records). [2025-10-16T17:40:56.039588] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-16T17:40:56.418196] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-16T17:40:56.418292] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-16T17:40:56.419071] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-16T17:40:56.419132] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-16T17:40:56.420161] [DEBUG] [LOCAL ] BLK: Trimmed 52996 records to 34632 (keeping 200 days of data) [2025-10-16T17:40:56.643068] [DEBUG] [LOCAL ] BLK: Primary data saved (34632 records). [2025-10-16T17:40:56.643185] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-16T17:40:56.643256] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLK took 35.0s. Estimated remaining: 4h 40m 53s. Rate: 7.4 symbols/min [2025-10-16T17:40:56.745481] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-16T17:40:56.822527] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:40:56.836588] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T17:40:56.870366] [DEBUG] [LOCAL ] BMA: Loaded 36165 existing records from primary storage. [2025-10-16T17:40:56.870683] [INFO ] [MAIN ] BMA: Loaded 36165 existing records. [2025-10-16T17:40:57.042981] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:40:57.043168] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-16T17:40:57.043214] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-16T17:40:57.043386] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-16T17:40:57.043424] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-16T17:40:57.388451] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:40:57.542777] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-16T17:40:57.777928] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:40:58.342852] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-16T17:40:58.989437] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:40:59.142831] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-16T17:40:59.942834] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-16T17:40:59.990358] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T17:41:00.668513] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T17:41:00.742776] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-16T17:41:00.818598] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T17:41:01.542849] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-16T17:41:02.259597] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:41:02.342774] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-16T17:41:02.519252] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:41:03.142832] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-16T17:41:03.942782] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-16T17:41:04.421769] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-16T17:41:04.537597] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T17:41:04.742799] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-16T17:41:04.945679] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:41:05.542804] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-16T17:41:06.215790] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T17:41:06.342786] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-16T17:41:06.423262] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T17:41:07.142827] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-16T17:41:07.853993] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:41:07.942796] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-16T17:41:08.742826] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-16T17:41:08.789889] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:41:09.473796] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T17:41:09.542803] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-16T17:41:09.565459] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T17:41:10.342984] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-16T17:41:10.693351] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:41:11.142814] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-16T17:41:11.942815] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-16T17:41:11.964512] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T17:41:12.222637] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:41:12.229251] [INFO ] [REMOTE ] BLND: Full fetch complete (72304 records). [2025-10-16T17:41:12.229388] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-16T17:41:12.608007] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-16T17:41:12.608129] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-16T17:41:12.608944] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-16T17:41:12.609026] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-16T17:41:12.610387] [DEBUG] [LOCAL ] BLND: Trimmed 72304 records to 49649 (keeping 200 days of data) [2025-10-16T17:41:12.762828] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-16T17:41:12.832059] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T17:41:12.902140] [DEBUG] [LOCAL ] BLND: Primary data saved (49649 records). [2025-10-16T17:41:12.902283] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-16T17:41:12.902880] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLND took 42.4s. Estimated remaining: 4h 41m 40s. Rate: 7.3 symbols/min [2025-10-16T17:41:13.066782] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:13.080425] [DEBUG] [LOCAL ] BME: Loaded 11286 existing records from primary storage. [2025-10-16T17:41:13.080674] [INFO ] [MAIN ] BME: Loaded 11286 existing records. [2025-10-16T17:41:13.253147] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:13.253406] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-16T17:41:13.253472] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-16T17:41:13.253738] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-16T17:41:13.253796] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-16T17:41:13.547916] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-16T17:41:13.641176] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:14.167606] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T17:41:14.342838] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-16T17:41:14.491212] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T17:41:15.142818] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-16T17:41:15.871913] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T17:41:15.889707] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:41:15.942773] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-16T17:41:16.742786] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-16T17:41:16.811700] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:41:17.542791] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-16T17:41:17.658437] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T17:41:18.342815] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-16T17:41:18.394239] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:41:19.142807] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-16T17:41:19.753236] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:41:19.771531] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T17:41:19.942800] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-16T17:41:20.742876] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-16T17:41:20.754832] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T17:41:20.757882] [INFO ] [REMOTE ] BLW: Full fetch complete (19227 records). [2025-10-16T17:41:20.758003] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-16T17:41:21.134785] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-16T17:41:21.134872] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-16T17:41:21.135234] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-16T17:41:21.135275] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-16T17:41:21.135951] [DEBUG] [LOCAL ] BLW: Trimmed 19227 records to 13261 (keeping 200 days of data) [2025-10-16T17:41:21.219280] [DEBUG] [LOCAL ] BLW: Primary data saved (13261 records). [2025-10-16T17:41:21.219429] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-16T17:41:21.219508] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 32.3s. Estimated remaining: 4h 41m 33s. Rate: 7.3 symbols/min [2025-10-16T17:41:21.395969] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:21.396956] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T17:41:21.424062] [DEBUG] [LOCAL ] BMEZ: Loaded 25911 existing records from primary storage. [2025-10-16T17:41:21.424357] [INFO ] [MAIN ] BMEZ: Loaded 25911 existing records. [2025-10-16T17:41:21.547934] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-16T17:41:21.599677] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:21.599952] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-16T17:41:21.600022] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-16T17:41:21.600203] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-16T17:41:21.600241] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-16T17:41:21.951956] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:22.342816] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-16T17:41:22.505359] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:41:22.896223] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T17:41:23.142787] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-16T17:41:23.936536] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:41:23.942761] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-16T17:41:24.738271] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T17:41:24.742768] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-16T17:41:25.395315] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T17:41:25.542798] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-16T17:41:26.342822] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-16T17:41:26.551850] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T17:41:27.010217] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T17:41:27.142806] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-16T17:41:27.942827] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-16T17:41:27.993511] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T17:41:28.742813] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-16T17:41:28.974221] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T17:41:29.542812] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-16T17:41:29.584390] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T17:41:30.342789] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-16T17:41:30.382263] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T17:41:31.142830] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-16T17:41:31.942819] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-16T17:41:32.060681] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T17:41:32.067037] [INFO ] [REMOTE ] BMA: Full fetch complete (51993 records). [2025-10-16T17:41:32.067173] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-16T17:41:32.484904] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T17:41:32.549735] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-16T17:41:32.549844] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-16T17:41:32.550702] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-16T17:41:32.550772] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-16T17:41:32.551968] [DEBUG] [LOCAL ] BMA: Trimmed 51993 records to 36440 (keeping 200 days of data) [2025-10-16T17:41:32.747735] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-16T17:41:32.807322] [DEBUG] [LOCAL ] BMA: Primary data saved (36440 records). [2025-10-16T17:41:32.807504] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-16T17:41:32.807616] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BMA took 36.2s. Estimated remaining: 4h 41m 48s. Rate: 7.3 symbols/min [2025-10-16T17:41:32.945532] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:41:32.969862] [INFO ] [REMOTE ] BLX: Full fetch complete (22473 records). [2025-10-16T17:41:32.983321] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-16T17:41:33.099737] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:33.348604] [DEBUG] [LOCAL ] BMI: Loaded 24500 existing records from primary storage. [2025-10-16T17:41:33.364744] [INFO ] [MAIN ] BMI: Loaded 24500 existing records. [2025-10-16T17:41:33.544282] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-16T17:41:33.552033] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-16T17:41:33.557313] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-16T17:41:33.568688] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-16T17:41:33.586716] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-16T17:41:33.609329] [DEBUG] [LOCAL ] BLX: Trimmed 22473 records to 15678 (keeping 200 days of data) [2025-10-16T17:41:33.631497] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:33.632085] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-16T17:41:33.632137] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-16T17:41:33.632326] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-16T17:41:33.632364] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-16T17:41:34.021798] [DEBUG] [LOCAL ] BLX: Primary data saved (15678 records). [2025-10-16T17:41:34.041924] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-16T17:41:34.042148] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BLX took 39.2s. Estimated remaining: 4h 40m 53s. Rate: 7.3 symbols/min [2025-10-16T17:41:34.225002] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:34.332157] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:34.333708] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T17:41:34.343037] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-16T17:41:34.346308] [DEBUG] [LOCAL ] BMN: Loaded 2596 existing records from primary storage. [2025-10-16T17:41:34.346597] [INFO ] [MAIN ] BMN: Loaded 2596 existing records. [2025-10-16T17:41:34.464421] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T17:41:34.517073] [INFO ] [REMOTE ] BME: Full fetch complete (15959 records). [2025-10-16T17:41:34.533419] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-16T17:41:34.537038] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:34.537568] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-16T17:41:34.569462] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-16T17:41:34.608029] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-16T17:41:34.630634] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-16T17:41:35.146905] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-16T17:41:35.272187] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:35.302921] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-16T17:41:35.303098] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-16T17:41:35.303461] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-16T17:41:35.303504] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-16T17:41:35.304044] [DEBUG] [LOCAL ] BME: Trimmed 15959 records to 11376 (keeping 200 days of data) [2025-10-16T17:41:35.371008] [DEBUG] [LOCAL ] BME: Primary data saved (11376 records). [2025-10-16T17:41:35.371142] [INFO ] [MAIN ] BME: Full history saved. [2025-10-16T17:41:35.371225] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BME took 22.5s. Estimated remaining: 4h 39m 59s. Rate: 7.4 symbols/min [2025-10-16T17:41:35.558478] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:41:35.560272] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T17:41:35.609441] [DEBUG] [LOCAL ] BMO: Loaded 41237 existing records from primary storage. [2025-10-16T17:41:35.609803] [INFO ] [MAIN ] BMO: Loaded 41237 existing records. [2025-10-16T17:41:35.806491] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:41:35.806770] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-16T17:41:35.806825] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-16T17:41:35.807232] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-16T17:41:35.807271] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-16T17:41:35.948045] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-16T17:41:36.162152] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:41:36.387403] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:41:36.453005] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:41:36.742831] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-16T17:41:37.326827] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T17:41:37.542786] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-16T17:41:38.342873] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-16T17:41:38.401758] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:41:38.775698] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:41:39.142798] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-16T17:41:39.577184] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T17:41:39.942810] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-16T17:41:40.488777] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T17:41:40.742839] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-16T17:41:41.542895] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-16T17:41:41.911967] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:41:42.006287] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T17:41:42.342899] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-16T17:41:42.676392] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T17:41:43.142830] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-16T17:41:43.604410] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:41:43.942891] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-16T17:41:44.742848] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-16T17:41:45.542860] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-16T17:41:45.544401] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T17:41:45.850111] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T17:41:46.342891] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-16T17:41:46.981279] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T17:41:47.142847] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-16T17:41:47.409303] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T17:41:47.942851] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-16T17:41:48.062500] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T17:41:48.742847] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-16T17:41:49.339817] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T17:41:49.542841] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-16T17:41:49.777441] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:41:50.342847] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-16T17:41:50.828525] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T17:41:50.887386] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:41:51.142827] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-16T17:41:51.736699] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T17:41:51.942863] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-16T17:41:52.742867] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-16T17:41:53.315819] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T17:41:53.542874] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-16T17:41:54.342800] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-16T17:41:54.419567] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:41:54.665167] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:41:55.142857] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-16T17:41:55.443734] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T17:41:55.942855] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-16T17:41:56.553415] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:41:56.742881] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-16T17:41:57.299188] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:41:57.503101] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:41:57.542829] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-16T17:41:58.342886] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-16T17:41:58.864408] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T17:41:59.142836] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-16T17:41:59.542748] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T17:41:59.543589] [INFO ] [REMOTE ] BMN: Full fetch complete (3728 records). [2025-10-16T17:41:59.543681] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-16T17:41:59.848303] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:41:59.932579] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-16T17:41:59.932680] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-16T17:41:59.932805] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-16T17:41:59.932898] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-16T17:41:59.933270] [DEBUG] [LOCAL ] BMN: Trimmed 3728 records to 2621 (keeping 200 days of data) [2025-10-16T17:41:59.945136] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-16T17:41:59.950581] [DEBUG] [LOCAL ] BMN: Primary data saved (2621 records). [2025-10-16T17:41:59.950670] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-16T17:41:59.950760] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMN took 25.9s. Estimated remaining: 4h 41m 41s. Rate: 7.3 symbols/min [2025-10-16T17:42:00.121639] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:00.170624] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-16T17:42:00.170947] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-16T17:42:00.346297] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:00.346487] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-16T17:42:00.346532] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-16T17:42:00.346788] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-16T17:42:00.346843] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-16T17:42:00.698003] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:00.742767] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-16T17:42:01.542831] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-16T17:42:01.738918] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:42:02.342803] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-16T17:42:02.448385] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:42:02.623535] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T17:42:03.142841] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-16T17:42:03.411082] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T17:42:03.942887] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-16T17:42:04.572284] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T17:42:04.742861] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-16T17:42:05.466216] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:42:05.542838] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-16T17:42:06.110143] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T17:42:06.114007] [INFO ] [REMOTE ] BMI: Full fetch complete (33526 records). [2025-10-16T17:42:06.114140] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-16T17:42:06.348012] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-16T17:42:06.505274] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-16T17:42:06.505383] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-16T17:42:06.505993] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-16T17:42:06.506082] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-16T17:42:06.523598] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:42:06.529679] [DEBUG] [LOCAL ] BMI: Trimmed 33526 records to 24756 (keeping 200 days of data) [2025-10-16T17:42:06.687483] [DEBUG] [LOCAL ] BMI: Primary data saved (24756 records). [2025-10-16T17:42:06.687623] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-16T17:42:06.687738] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 33.9s. Estimated remaining: 4h 41m 23s. Rate: 7.3 symbols/min [2025-10-16T17:42:06.872209] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:06.923024] [DEBUG] [LOCAL ] BN: Loaded 52988 existing records from primary storage. [2025-10-16T17:42:06.923396] [INFO ] [MAIN ] BN: Loaded 52988 existing records. [2025-10-16T17:42:07.107141] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:07.107351] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-16T17:42:07.107398] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-16T17:42:07.107691] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-16T17:42:07.107746] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-16T17:42:07.149431] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-16T17:42:07.460861] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:07.942835] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-16T17:42:08.059256] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T17:42:08.557504] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T17:42:08.561434] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40188 records). [2025-10-16T17:42:08.561565] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-16T17:42:08.755275] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-16T17:42:08.958238] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-16T17:42:08.958352] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-16T17:42:08.958959] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-16T17:42:08.959334] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-16T17:42:08.960497] [DEBUG] [LOCAL ] BMEZ: Trimmed 40188 records to 26080 (keeping 200 days of data) [2025-10-16T17:42:09.136425] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26080 records). [2025-10-16T17:42:09.136581] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-16T17:42:09.136712] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMEZ took 47.9s. Estimated remaining: 4h 40m 36s. Rate: 7.3 symbols/min [2025-10-16T17:42:09.308569] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:09.338687] [DEBUG] [LOCAL ] BNED: Loaded 28621 existing records from primary storage. [2025-10-16T17:42:09.339050] [INFO ] [MAIN ] BNED: Loaded 28621 existing records. [2025-10-16T17:42:09.527729] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:09.528076] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-16T17:42:09.528261] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-16T17:42:09.528689] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-16T17:42:09.528771] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-16T17:42:09.550161] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-16T17:42:09.932343] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:09.926227] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T17:42:10.342828] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-16T17:42:10.735893] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T17:42:10.820960] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T17:42:10.826340] [INFO ] [REMOTE ] BMO: Full fetch complete (59963 records). [2025-10-16T17:42:10.826475] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-16T17:42:11.151363] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-16T17:42:11.207926] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-16T17:42:11.208009] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-16T17:42:11.208802] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-16T17:42:11.208867] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-16T17:42:11.210133] [DEBUG] [LOCAL ] BMO: Trimmed 59963 records to 41606 (keeping 200 days of data) [2025-10-16T17:42:11.483959] [DEBUG] [LOCAL ] BMO: Primary data saved (41606 records). [2025-10-16T17:42:11.484213] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-16T17:42:11.484344] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 36.1s. Estimated remaining: 4h 39m 49s. Rate: 7.4 symbols/min [2025-10-16T17:42:11.677926] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:11.678225] [DEBUG] [LOCAL ] BNH: No existing data file found in primary storage. [2025-10-16T17:42:11.678336] [WARN ] [MAIN ] BNH: No existing data found, performing full refresh instead. [2025-10-16T17:42:11.678478] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-16T17:42:11.678611] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-16T17:42:11.678714] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-10-16T17:42:11.678760] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-16T17:42:11.809032] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:42:11.951803] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-16T17:42:12.068895] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:12.742868] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-16T17:42:13.273307] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T17:42:13.365588] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:42:13.522795] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:42:13.542763] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-16T17:42:14.084820] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T17:42:14.342829] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-16T17:42:14.799877] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T17:42:15.142829] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-16T17:42:15.942851] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-16T17:42:16.529318] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:42:16.742822] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-16T17:42:16.882147] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T17:42:17.542817] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-16T17:42:18.342799] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-16T17:42:18.658895] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T17:42:18.909083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:42:19.018585] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T17:42:19.142777] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-16T17:42:19.942830] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-16T17:42:20.742837] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-16T17:42:20.816165] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T17:42:21.299401] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T17:42:21.542878] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-16T17:42:22.342837] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-16T17:42:22.506795] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T17:42:22.531467] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T17:42:23.142875] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-16T17:42:23.942790] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-16T17:42:23.990302] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:42:24.742869] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-16T17:42:25.285992] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:42:25.318859] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:42:25.542852] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-16T17:42:26.351993] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-16T17:42:26.371366] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:42:26.432918] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:42:27.142812] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-16T17:42:27.942856] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-16T17:42:28.232217] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T17:42:28.288432] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:42:28.509989] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T17:42:28.742881] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-16T17:42:29.276996] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:42:29.542897] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-16T17:42:30.150624] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T17:42:30.342875] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-16T17:42:31.142813] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-16T17:42:31.535184] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:42:31.942857] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-16T17:42:32.510708] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T17:42:32.742847] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-16T17:42:33.156138] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T17:42:33.542818] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-16T17:42:34.342888] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-16T17:42:34.960447] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T17:42:35.023344] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:42:35.142843] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-16T17:42:35.942885] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-16T17:42:36.081217] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T17:42:36.682251] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:42:36.742814] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-16T17:42:37.542924] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-16T17:42:37.997862] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:42:38.150293] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-16T17:42:38.206007] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:42:38.342834] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-16T17:42:39.142929] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-16T17:42:39.942804] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-16T17:42:40.078139] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:42:40.081431] [INFO ] [REMOTE ] BNED: Full fetch complete (42514 records). [2025-10-16T17:42:40.081555] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-16T17:42:40.485720] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T17:42:40.512724] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-16T17:42:40.513142] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-16T17:42:40.514004] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-16T17:42:40.514089] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-16T17:42:40.515550] [DEBUG] [LOCAL ] BNED: Trimmed 42514 records to 28780 (keeping 200 days of data) [2025-10-16T17:42:40.673295] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T17:42:40.679369] [INFO ] [REMOTE ] BNH: Full fetch complete (6888 records). [2025-10-16T17:42:40.684527] [DEBUG] [LOCAL ] BNED: Primary data saved (28780 records). [2025-10-16T17:42:40.684638] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-16T17:42:40.684980] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-16T17:42:40.685168] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BNED took 31.5s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-16T17:42:40.748152] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-16T17:42:41.067986] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:41.187768] [DEBUG] [LOCAL ] BNJ: Loaded 2607 existing records from primary storage. [2025-10-16T17:42:41.198752] [INFO ] [MAIN ] BNJ: Loaded 2607 existing records. [2025-10-16T17:42:41.401035] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-16T17:42:41.406285] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-16T17:42:41.406561] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-16T17:42:41.411766] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-16T17:42:41.463700] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:41.464795] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-16T17:42:41.465027] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-16T17:42:41.464931] [DEBUG] [LOCAL ] BNH: Trimmed 6888 records to 5044 (keeping 200 days of data) [2025-10-16T17:42:41.465480] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-16T17:42:41.465811] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-16T17:42:41.546484] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-16T17:42:41.599886] [DEBUG] [LOCAL ] BNH: Primary data saved (5044 records). [2025-10-16T17:42:41.603734] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-16T17:42:41.604144] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNH took 30.1s. Estimated remaining: 4h 41m 4s. Rate: 7.3 symbols/min [2025-10-16T17:42:41.980591] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:42.044446] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:42.085974] [DEBUG] [LOCAL ] BNL: Loaded 47279 existing records from primary storage. [2025-10-16T17:42:42.086280] [INFO ] [MAIN ] BNL: Loaded 47279 existing records. [2025-10-16T17:42:42.265880] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:42.266096] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-16T17:42:42.266143] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-16T17:42:42.266573] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-16T17:42:42.266629] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-16T17:42:42.354073] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-16T17:42:42.653392] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:42.718481] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T17:42:42.725251] [INFO ] [REMOTE ] BN: Full fetch complete (76560 records). [2025-10-16T17:42:42.725434] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-16T17:42:42.726249] [FATAL] [VALIDATOR ] BN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:42:42.726372] [FATAL] [MAIN ] BN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:42:42.726415] [WARN ] [MAIN ] BN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:42:42.726454] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-16T17:42:42.726513] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-16T17:42:42.726548] [INFO ] [LOCAL ] BN: Starting deletion of derivative data. [2025-10-16T17:42:42.726752] [DEBUG] [LOCAL ] BN: Deleted derivative data file. [2025-10-16T17:42:42.726853] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 36.0s. Estimated remaining: 4h 40m 10s. Rate: 7.3 symbols/min [2025-10-16T17:42:42.907352] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:42.961733] [DEBUG] [LOCAL ] BNS: Loaded 51484 existing records from primary storage. [2025-10-16T17:42:42.962115] [INFO ] [MAIN ] BNS: Loaded 51484 existing records. [2025-10-16T17:42:43.097471] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T17:42:43.147962] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-16T17:42:43.182356] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:43.182781] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-16T17:42:43.182839] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-16T17:42:43.183299] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-16T17:42:43.183378] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-16T17:42:43.607508] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:43.655510] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T17:42:43.942801] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-16T17:42:44.636971] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:42:44.643779] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-16T17:42:44.643906] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-16T17:42:44.744635] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-16T17:42:45.002305] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:42:45.080630] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-16T17:42:45.080736] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-16T17:42:45.081624] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-16T17:42:45.081697] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-16T17:42:45.083173] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54147 (keeping 200 days of data) [2025-10-16T17:42:45.412549] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-16T17:42:45.412716] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-16T17:42:45.413791] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BMY took 45.5s. Estimated remaining: 4h 39m 25s. Rate: 7.4 symbols/min [2025-10-16T17:42:45.547985] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-16T17:42:45.606415] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:42:45.613485] [DEBUG] [LOCAL ] BNT: Loaded 3485 existing records from primary storage. [2025-10-16T17:42:45.613772] [INFO ] [MAIN ] BNT: Loaded 3485 existing records. [2025-10-16T17:42:45.806670] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:42:45.806924] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-16T17:42:45.806974] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-16T17:42:45.807483] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-16T17:42:45.807550] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-16T17:42:46.162930] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T17:42:46.280974] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:42:46.342824] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-16T17:42:46.500669] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:42:46.757478] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T17:42:47.142872] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-16T17:42:47.604700] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T17:42:47.942835] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-16T17:42:48.387499] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T17:42:48.742809] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-16T17:42:49.313586] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T17:42:49.542876] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-16T17:42:50.166704] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T17:42:50.342801] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-16T17:42:50.886433] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:42:51.142812] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-16T17:42:51.590528] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T17:42:51.942815] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-16T17:42:52.388129] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:42:52.742860] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-16T17:42:53.542870] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-16T17:42:53.928155] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T17:42:54.100132] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T17:42:54.342834] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-16T17:42:54.735709] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T17:42:55.142811] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-16T17:42:55.485499] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-16T17:42:55.942831] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-16T17:42:56.742871] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-16T17:42:57.446334] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T17:42:57.542873] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-16T17:42:57.820873] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T17:42:58.145947] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T17:42:58.342802] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-16T17:42:59.142843] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-16T17:42:59.710349] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:42:59.942825] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-16T17:42:59.971263] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:43:00.402990] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:43:00.742805] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-16T17:43:01.542909] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-16T17:43:01.995350] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T17:43:02.301234] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T17:43:02.342839] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-16T17:43:03.142816] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-16T17:43:03.582471] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-16T17:43:03.940403] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:43:03.950567] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-16T17:43:04.556968] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:43:04.742868] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-16T17:43:05.380637] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T17:43:05.542817] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-16T17:43:06.342873] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-16T17:43:06.991046] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T17:43:06.992222] [INFO ] [REMOTE ] BNT: Full fetch complete (4725 records). [2025-10-16T17:43:06.992290] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-16T17:43:07.163981] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-16T17:43:07.407324] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-16T17:43:07.407417] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-16T17:43:07.407557] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-16T17:43:07.407627] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-16T17:43:07.408268] [DEBUG] [LOCAL ] BNT: Trimmed 4725 records to 3543 (keeping 200 days of data) [2025-10-16T17:43:07.410043] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T17:43:07.440519] [DEBUG] [LOCAL ] BNT: Primary data saved (3543 records). [2025-10-16T17:43:07.440600] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-16T17:43:07.440689] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNT took 22.0s. Estimated remaining: 4h 40m 48s. Rate: 7.3 symbols/min [2025-10-16T17:43:07.621753] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:07.630739] [DEBUG] [LOCAL ] BNY: Loaded 7182 existing records from primary storage. [2025-10-16T17:43:07.630923] [INFO ] [MAIN ] BNY: Loaded 7182 existing records. [2025-10-16T17:43:07.825095] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:07.825324] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-16T17:43:07.825372] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-16T17:43:07.825515] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-16T17:43:07.825555] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-16T17:43:07.947944] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-16T17:43:08.178085] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:08.742793] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-16T17:43:08.826041] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:43:09.357323] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T17:43:09.358632] [INFO ] [REMOTE ] BNJ: Full fetch complete (4100 records). [2025-10-16T17:43:09.358753] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-16T17:43:09.553844] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-16T17:43:09.729706] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-16T17:43:09.729879] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-16T17:43:09.730075] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-16T17:43:09.730184] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-16T17:43:09.730837] [DEBUG] [LOCAL ] BNJ: Trimmed 4100 records to 2620 (keeping 200 days of data) [2025-10-16T17:43:09.772735] [DEBUG] [LOCAL ] BNJ: Primary data saved (2620 records). [2025-10-16T17:43:09.772966] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-16T17:43:09.773076] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNJ took 29.1s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-16T17:43:09.781854] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T17:43:09.953239] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:09.972420] [DEBUG] [LOCAL ] BOC: Loaded 18587 existing records from primary storage. [2025-10-16T17:43:09.972622] [INFO ] [MAIN ] BOC: Loaded 18587 existing records. [2025-10-16T17:43:10.147111] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:10.147278] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-16T17:43:10.147325] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-16T17:43:10.147485] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-16T17:43:10.147524] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-16T17:43:10.274423] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T17:43:10.350354] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-16T17:43:10.506873] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:11.026901] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T17:43:11.142804] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-16T17:43:11.942911] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-16T17:43:12.387880] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T17:43:12.742810] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-16T17:43:13.348339] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T17:43:13.542843] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-16T17:43:14.342875] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-16T17:43:14.407802] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T17:43:14.437153] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:43:15.142825] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-16T17:43:15.523787] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:43:15.719566] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T17:43:15.942857] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-16T17:43:16.555141] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T17:43:16.742862] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-16T17:43:17.185202] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:43:17.542875] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-16T17:43:18.342812] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-16T17:43:19.114579] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:43:19.142777] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-16T17:43:19.168573] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T17:43:19.942805] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-16T17:43:20.742821] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-16T17:43:20.788749] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:43:20.856363] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:43:21.542834] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-16T17:43:22.342795] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-16T17:43:22.444956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T17:43:22.480241] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T17:43:22.897747] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T17:43:23.142848] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-16T17:43:23.942835] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-16T17:43:24.742824] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-16T17:43:24.813444] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T17:43:24.868774] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T17:43:25.289208] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T17:43:25.542879] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-16T17:43:26.342852] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-16T17:43:27.142787] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-16T17:43:27.330282] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T17:43:27.661516] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T17:43:27.667847] [INFO ] [REMOTE ] BNL: Full fetch complete (67284 records). [2025-10-16T17:43:27.667953] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-16T17:43:27.948777] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-16T17:43:27.977231] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T17:43:28.099516] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-16T17:43:28.099603] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-16T17:43:28.100515] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-16T17:43:28.100579] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-16T17:43:28.101899] [DEBUG] [LOCAL ] BNL: Trimmed 67284 records to 47629 (keeping 200 days of data) [2025-10-16T17:43:28.382531] [DEBUG] [LOCAL ] BNL: Primary data saved (47629 records). [2025-10-16T17:43:28.382680] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-16T17:43:28.382772] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNL took 46.8s. Estimated remaining: 4h 41m 1s. Rate: 7.3 symbols/min [2025-10-16T17:43:28.742878] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-16T17:43:29.542832] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-16T17:43:29.652393] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T17:43:29.772248] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:43:30.019239] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T17:43:30.342907] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-16T17:43:31.142814] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-16T17:43:31.942859] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-16T17:43:32.106316] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T17:43:32.127361] [INFO ] [REMOTE ] BNS: Full fetch complete (74644 records). [2025-10-16T17:43:32.128429] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T17:43:32.128011] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-16T17:43:32.551640] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-16T17:43:32.551893] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-16T17:43:32.558494] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T17:43:32.558253] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-16T17:43:32.561030] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-16T17:43:32.562688] [DEBUG] [LOCAL ] BNS: Trimmed 74644 records to 51872 (keeping 200 days of data) [2025-10-16T17:43:32.743712] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-16T17:43:32.878629] [DEBUG] [LOCAL ] BNS: Primary data saved (51872 records). [2025-10-16T17:43:32.878799] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-16T17:43:32.878893] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNS took 50.2s. Estimated remaining: 4h 40m 28s. Rate: 7.3 symbols/min [2025-10-16T17:43:33.542842] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-16T17:43:33.819678] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T17:43:34.129084] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T17:43:34.131258] [INFO ] [REMOTE ] BNY: Full fetch complete (10326 records). [2025-10-16T17:43:34.131765] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-16T17:43:34.132915] [FATAL] [VALIDATOR ] BNY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:43:34.133009] [FATAL] [MAIN ] BNY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:43:34.133054] [WARN ] [MAIN ] BNY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:43:34.133096] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-16T17:43:34.133155] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-16T17:43:34.133193] [INFO ] [LOCAL ] BNY: Starting deletion of derivative data. [2025-10-16T17:43:34.133342] [DEBUG] [LOCAL ] BNY: Deleted derivative data file. [2025-10-16T17:43:34.133445] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 26.7s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-16T17:43:34.342885] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-16T17:43:35.362064] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:43:35.366440] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-16T17:43:36.365186] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T17:43:36.368005] [INFO ] [REMOTE ] BOC: Full fetch complete (25921 records). [2025-10-16T17:43:36.368081] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-16T17:43:36.730092] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-16T17:43:36.730208] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-16T17:43:36.730708] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-16T17:43:36.730770] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-16T17:43:36.731494] [DEBUG] [LOCAL ] BOC: Trimmed 25921 records to 18699 (keeping 200 days of data) [2025-10-16T17:43:36.849276] [DEBUG] [LOCAL ] BOC: Primary data saved (18699 records). [2025-10-16T17:43:36.849605] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-16T17:43:36.849706] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 27.1s. Estimated remaining: 4h 38m 52s. Rate: 7.3 symbols/min [2025-10-16T17:43:37.556625] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.566771] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.588155] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.611438] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:43:37.659146] [DEBUG] [LOCAL ] BOE: Loaded 18229 existing records from primary storage. [2025-10-16T17:43:37.660114] [INFO ] [MAIN ] BOE: Loaded 18229 existing records. [2025-10-16T17:43:37.746268] [DEBUG] [LOCAL ] BOH: Loaded 30544 existing records from primary storage. [2025-10-16T17:43:37.777284] [INFO ] [MAIN ] BOH: Loaded 30544 existing records. [2025-10-16T17:43:37.756258] [DEBUG] [LOCAL ] BOND: Loaded 32426 existing records from primary storage. [2025-10-16T17:43:37.771635] [DEBUG] [LOCAL ] BOOT: Loaded 39827 existing records from primary storage. [2025-10-16T17:43:37.788502] [INFO ] [MAIN ] BOND: Loaded 32426 existing records. [2025-10-16T17:43:37.793852] [INFO ] [MAIN ] BOOT: Loaded 39827 existing records. [2025-10-16T17:43:38.226618] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.313069] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.313220] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-16T17:43:38.318516] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-16T17:43:38.362707] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-16T17:43:38.452267] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.501627] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.540496] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.563902] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.551245] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-16T17:43:38.641627] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:43:38.641959] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-16T17:43:38.642032] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-16T17:43:38.642108] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-16T17:43:38.642270] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-16T17:43:38.630918] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-16T17:43:38.653471] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-16T17:43:38.675037] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-16T17:43:38.680994] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-16T17:43:38.741915] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-16T17:43:39.952926] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:39.987475] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-16T17:43:40.237155] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.298702] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.299139] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-16T17:43:40.326247] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-16T17:43:40.330125] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:43:40.332580] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-16T17:43:41.041363] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T17:43:41.046536] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-16T17:43:41.304124] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T17:43:41.315104] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-16T17:43:41.695943] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:43:41.702867] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-16T17:43:41.848673] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:43:41.856881] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-16T17:43:41.869859] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:43:42.284986] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:43:42.342858] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-16T17:43:42.693977] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T17:43:43.142866] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-16T17:43:43.471213] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T17:43:43.573161] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:43:43.942878] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-16T17:43:44.406179] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T17:43:44.742836] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-16T17:43:44.987356] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:43:45.542877] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-16T17:43:46.158426] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T17:43:46.342872] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-16T17:43:46.917436] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T17:43:47.142824] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-16T17:43:47.668539] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:43:47.942819] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-16T17:43:48.433594] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:43:48.742865] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-16T17:43:49.248421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:43:49.339578] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:43:49.542937] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-16T17:43:50.342834] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-16T17:43:51.142843] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-16T17:43:51.285145] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:43:51.423807] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:43:51.942853] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-16T17:43:52.328283] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T17:43:52.742847] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-16T17:43:53.394114] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:43:53.496606] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T17:43:53.542765] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-16T17:43:54.203612] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:43:54.342948] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-16T17:43:55.142818] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-16T17:43:55.349595] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:43:55.942813] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-16T17:43:56.629184] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:43:56.742833] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-16T17:43:56.976898] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T17:43:57.313325] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T17:43:57.542882] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-16T17:43:58.342853] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-16T17:43:59.014547] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:43:59.142863] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-16T17:43:59.207517] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T17:43:59.942875] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-16T17:44:00.495343] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T17:44:00.742820] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-16T17:44:01.368451] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T17:44:01.542784] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-16T17:44:02.278463] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:44:02.342796] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-16T17:44:02.846939] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T17:44:03.142820] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-16T17:44:03.422988] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T17:44:03.942788] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-16T17:44:04.076955] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:44:04.744636] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-16T17:44:04.746597] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T17:44:05.542790] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-16T17:44:06.241527] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:44:06.246052] [INFO ] [REMOTE ] BOH: Full fetch complete (45324 records). [2025-10-16T17:44:06.246212] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-16T17:44:06.350462] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-16T17:44:06.666921] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-16T17:44:06.667028] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-16T17:44:06.667620] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-16T17:44:06.667704] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-16T17:44:06.668699] [DEBUG] [LOCAL ] BOH: Trimmed 45324 records to 30879 (keeping 200 days of data) [2025-10-16T17:44:06.856702] [DEBUG] [LOCAL ] BOH: Primary data saved (30879 records). [2025-10-16T17:44:06.856949] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-16T17:44:06.857069] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOH took 30.0s. Estimated remaining: 4h 41m 4s. Rate: 7.3 symbols/min [2025-10-16T17:44:06.992141] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T17:44:07.072390] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:07.072566] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-10-16T17:44:07.072604] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-10-16T17:44:07.072739] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-16T17:44:07.072784] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-16T17:44:07.072830] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-16T17:44:07.072863] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-16T17:44:07.147997] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-16T17:44:07.438208] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:07.929988] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T17:44:07.942765] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-16T17:44:08.307334] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:44:08.742863] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-16T17:44:09.352245] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:44:09.542871] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-16T17:44:10.342806] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-16T17:44:10.599902] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:44:10.603013] [INFO ] [REMOTE ] BOE: Full fetch complete (26771 records). [2025-10-16T17:44:10.603084] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-16T17:44:10.926697] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T17:44:11.025198] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-16T17:44:11.025288] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-16T17:44:11.025840] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-16T17:44:11.025903] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-16T17:44:11.026698] [DEBUG] [LOCAL ] BOE: Trimmed 26771 records to 18339 (keeping 200 days of data) [2025-10-16T17:44:11.135402] [DEBUG] [LOCAL ] BOE: Primary data saved (18339 records). [2025-10-16T17:44:11.135535] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-16T17:44:11.135612] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOE took 34.3s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-16T17:44:11.147933] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-16T17:44:11.325509] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:11.346330] [DEBUG] [LOCAL ] BOW: Loaded 23268 existing records from primary storage. [2025-10-16T17:44:11.346611] [INFO ] [MAIN ] BOW: Loaded 23268 existing records. [2025-10-16T17:44:11.548947] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:11.549175] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-16T17:44:11.549229] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-16T17:44:11.549700] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-16T17:44:11.549758] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-16T17:44:11.927607] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T17:44:11.954330] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:11.950303] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-16T17:44:11.954547] [INFO ] [REMOTE ] BOND: Full fetch complete (46639 records). [2025-10-16T17:44:11.956020] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-16T17:44:12.345945] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-16T17:44:12.346031] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-16T17:44:12.346668] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-16T17:44:12.346731] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-16T17:44:12.347814] [DEBUG] [LOCAL ] BOND: Trimmed 46639 records to 32683 (keeping 200 days of data) [2025-10-16T17:44:12.554960] [DEBUG] [LOCAL ] BOND: Primary data saved (32683 records). [2025-10-16T17:44:12.555251] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-16T17:44:12.555354] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOND took 35.7s. Estimated remaining: 4h 39m 39s. Rate: 7.3 symbols/min [2025-10-16T17:44:12.731211] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:12.742811] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-16T17:44:12.784675] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T17:44:12.810323] [DEBUG] [LOCAL ] BOX: Loaded 50190 existing records from primary storage. [2025-10-16T17:44:12.810680] [INFO ] [MAIN ] BOX: Loaded 50190 existing records. [2025-10-16T17:44:12.985614] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:12.985934] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-16T17:44:12.985981] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-16T17:44:12.986814] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-16T17:44:12.986872] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-16T17:44:13.343699] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:13.456015] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T17:44:13.460734] [INFO ] [REMOTE ] BOOT: Full fetch complete (60071 records). [2025-10-16T17:44:13.460834] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-16T17:44:13.543323] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-16T17:44:13.710571] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T17:44:13.871851] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-16T17:44:13.871933] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-16T17:44:13.872663] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-16T17:44:13.872724] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-16T17:44:13.873900] [DEBUG] [LOCAL ] BOOT: Trimmed 60071 records to 40066 (keeping 200 days of data) [2025-10-16T17:44:14.103435] [DEBUG] [LOCAL ] BOOT: Primary data saved (40066 records). [2025-10-16T17:44:14.103556] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-16T17:44:14.103629] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOOT took 37.2s. Estimated remaining: 4h 38m 49s. Rate: 7.3 symbols/min [2025-10-16T17:44:14.268597] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:14.268810] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-10-16T17:44:14.268852] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-10-16T17:44:14.268954] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-16T17:44:14.269024] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-16T17:44:14.269078] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-16T17:44:14.269119] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-16T17:44:14.347963] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-16T17:44:14.634802] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:15.142788] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-16T17:44:15.342139] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T17:44:15.342966] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:44:15.942817] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-16T17:44:16.742810] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-16T17:44:17.290499] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-16T17:44:17.359863] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:44:17.383986] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T17:44:17.542772] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-16T17:44:18.342879] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-16T17:44:18.927400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:44:19.142825] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-16T17:44:19.577867] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T17:44:19.942854] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-16T17:44:20.742777] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-16T17:44:20.869946] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T17:44:21.542838] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-16T17:44:21.622810] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T17:44:22.259403] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:44:22.342841] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-16T17:44:23.142843] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-16T17:44:23.309636] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:44:23.942808] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-16T17:44:24.081146] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T17:44:24.742856] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-16T17:44:24.835675] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:44:24.972251] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T17:44:25.542813] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-16T17:44:26.348735] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-16T17:44:26.372156] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:44:27.142800] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-16T17:44:27.218239] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T17:44:27.942853] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-16T17:44:28.368415] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T17:44:28.742838] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-16T17:44:28.952984] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:44:29.132503] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T17:44:29.542814] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-16T17:44:30.342784] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-16T17:44:30.378139] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:44:30.875990] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T17:44:31.142876] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-16T17:44:31.942800] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-16T17:44:32.319245] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:44:32.651757] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:44:32.742810] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-16T17:44:33.542878] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-16T17:44:34.039460] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T17:44:34.342835] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-16T17:44:34.470690] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T17:44:34.898930] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T17:44:35.142794] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-16T17:44:35.196192] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:44:35.942883] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-16T17:44:36.745768] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-16T17:44:36.751684] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:44:37.542794] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-16T17:44:37.706839] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T17:44:38.074007] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T17:44:38.342828] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-16T17:44:38.877885] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:44:39.142823] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-16T17:44:39.942867] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-16T17:44:40.077673] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:44:40.270781] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T17:44:40.742884] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-16T17:44:41.542900] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-16T17:44:42.233329] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T17:44:42.342912] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-16T17:44:42.449870] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T17:44:42.457019] [INFO ] [REMOTE ] BORR: Full fetch complete (74628 records). [2025-10-16T17:44:42.457187] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-16T17:44:42.904001] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-16T17:44:42.904124] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-16T17:44:42.905288] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-16T17:44:42.905359] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-16T17:44:42.907388] [DEBUG] [LOCAL ] BORR: Trimmed 74628 records to 51498 (keeping 200 days of data) [2025-10-16T17:44:43.146614] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-16T17:44:43.235491] [DEBUG] [LOCAL ] BORR: Primary data saved (51498 records). [2025-10-16T17:44:43.235944] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-16T17:44:43.236136] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 36.4s. Estimated remaining: 4h 40m 52s. Rate: 7.3 symbols/min [2025-10-16T17:44:43.355011] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T17:44:43.375938] [INFO ] [REMOTE ] BOX: Full fetch complete (72322 records). [2025-10-16T17:44:43.386808] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-16T17:44:43.493068] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:43.665313] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T17:44:43.903868] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-16T17:44:43.926524] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-16T17:44:43.926737] [INFO ] [MAIN ] BR: Loaded 34787 existing records. [2025-10-16T17:44:43.948149] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-16T17:44:43.947990] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-16T17:44:43.971500] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-16T17:44:44.003841] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-16T17:44:44.079801] [DEBUG] [LOCAL ] BOX: Trimmed 72322 records to 50563 (keeping 200 days of data) [2025-10-16T17:44:44.118921] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:44.168145] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-16T17:44:44.177415] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-16T17:44:44.205309] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-16T17:44:44.205894] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-16T17:44:44.704816] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:44.764570] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-16T17:44:44.804274] [DEBUG] [LOCAL ] BOX: Primary data saved (50563 records). [2025-10-16T17:44:44.804531] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-16T17:44:44.805319] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOX took 32.2s. Estimated remaining: 4h 40m 2s. Rate: 7.3 symbols/min [2025-10-16T17:44:44.977115] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:45.027168] [DEBUG] [LOCAL ] BRBR: Loaded 51693 existing records from primary storage. [2025-10-16T17:44:45.027485] [INFO ] [MAIN ] BRBR: Loaded 51693 existing records. [2025-10-16T17:44:45.207252] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:45.207952] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-16T17:44:45.208036] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-16T17:44:45.219326] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-16T17:44:45.236464] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-16T17:44:45.299040] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T17:44:45.390866] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:44:45.430807] [INFO ] [REMOTE ] BOW: Full fetch complete (32129 records). [2025-10-16T17:44:45.463475] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-16T17:44:45.551809] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-16T17:44:45.820386] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:46.064491] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:44:46.084454] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-16T17:44:46.084533] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-16T17:44:46.085144] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-16T17:44:46.085246] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-16T17:44:46.086103] [DEBUG] [LOCAL ] BOW: Trimmed 32129 records to 23436 (keeping 200 days of data) [2025-10-16T17:44:46.217838] [DEBUG] [LOCAL ] BOW: Primary data saved (23436 records). [2025-10-16T17:44:46.217975] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-16T17:44:46.218075] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOW took 35.1s. Estimated remaining: 4h 39m 11s. Rate: 7.3 symbols/min [2025-10-16T17:44:46.347991] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-16T17:44:46.392267] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:46.410389] [DEBUG] [LOCAL ] BRC: Loaded 18601 existing records from primary storage. [2025-10-16T17:44:46.410630] [INFO ] [MAIN ] BRC: Loaded 18601 existing records. [2025-10-16T17:44:46.587788] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:46.588031] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-16T17:44:46.588080] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-16T17:44:46.588483] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-16T17:44:46.588551] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-16T17:44:46.949901] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:47.142820] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-16T17:44:47.706991] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T17:44:47.942777] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-16T17:44:48.076748] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:44:48.297516] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:44:48.742865] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-16T17:44:49.542875] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-16T17:44:49.947948] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T17:44:49.954605] [INFO ] [REMOTE ] BP: Full fetch complete (77882 records). [2025-10-16T17:44:49.954741] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-16T17:44:50.355775] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-16T17:44:50.359712] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-16T17:44:50.359826] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-16T17:44:50.361507] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-16T17:44:50.361707] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-16T17:44:50.387053] [DEBUG] [LOCAL ] BP: Trimmed 77882 records to 54098 (keeping 200 days of data) [2025-10-16T17:44:50.388832] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:44:50.625094] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T17:44:50.737278] [DEBUG] [LOCAL ] BP: Primary data saved (54098 records). [2025-10-16T17:44:50.737433] [INFO ] [MAIN ] BP: Full history saved. [2025-10-16T17:44:50.737511] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BP took 36.6s. Estimated remaining: 4h 38m 40s. Rate: 7.3 symbols/min [2025-10-16T17:44:50.906723] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:44:50.941301] [DEBUG] [LOCAL ] BRCC: Loaded 40208 existing records from primary storage. [2025-10-16T17:44:50.941579] [INFO ] [MAIN ] BRCC: Loaded 40208 existing records. [2025-10-16T17:44:51.113961] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:44:51.114138] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-16T17:44:51.114184] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-16T17:44:51.114878] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-16T17:44:51.114934] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-16T17:44:51.148015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-16T17:44:51.460945] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:44:51.942839] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-16T17:44:52.015719] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:44:52.034502] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:44:52.742842] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-16T17:44:53.212052] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T17:44:53.542830] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-16T17:44:53.865784] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T17:44:54.342871] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-16T17:44:54.542817] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:44:55.142864] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-16T17:44:55.420344] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T17:44:55.942815] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-16T17:44:56.739758] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:44:56.748035] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-16T17:44:57.072599] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:44:57.542826] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-16T17:44:58.266285] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T17:44:58.342822] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-16T17:44:59.142843] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-16T17:44:59.276522] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T17:44:59.844665] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T17:44:59.942769] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-16T17:45:00.320443] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:45:00.742811] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-16T17:45:01.542884] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-16T17:45:01.638408] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T17:45:02.062703] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:45:02.342812] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-16T17:45:03.142783] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-16T17:45:03.246056] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T17:45:03.656871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:45:03.942816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-16T17:45:04.742896] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-16T17:45:04.821937] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T17:45:05.542798] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-16T17:45:05.734308] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:45:05.811741] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T17:45:06.342835] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-16T17:45:06.873382] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T17:45:07.142813] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-16T17:45:07.942846] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-16T17:45:08.097687] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:45:08.353231] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T17:45:08.742801] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-16T17:45:09.045812] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T17:45:09.542869] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-16T17:45:10.215981] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:45:10.342789] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-16T17:45:10.622815] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:45:11.142821] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-16T17:45:11.942801] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-16T17:45:12.318023] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T17:45:12.383949] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-16T17:45:12.742797] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-16T17:45:13.436628] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T17:45:13.478000] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:45:13.542828] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-16T17:45:14.342868] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-16T17:45:15.142825] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-16T17:45:15.258119] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:45:15.442586] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T17:45:15.942827] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-16T17:45:16.166003] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T17:45:16.742834] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-16T17:45:17.468764] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T17:45:17.542798] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-16T17:45:17.776205] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T17:45:17.782978] [INFO ] [REMOTE ] BRBR: Full fetch complete (72917 records). [2025-10-16T17:45:17.783089] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-16T17:45:18.166450] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-16T17:45:18.166530] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-16T17:45:18.167346] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-16T17:45:18.167408] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-16T17:45:18.168742] [DEBUG] [LOCAL ] BRBR: Trimmed 72917 records to 52076 (keeping 200 days of data) [2025-10-16T17:45:18.363430] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-16T17:45:18.466771] [DEBUG] [LOCAL ] BRBR: Primary data saved (52076 records). [2025-10-16T17:45:18.466891] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-16T17:45:18.467565] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BRBR took 33.7s. Estimated remaining: 4h 40m 33s. Rate: 7.3 symbols/min [2025-10-16T17:45:18.637125] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:18.686698] [DEBUG] [LOCAL ] BRO: Loaded 52061 existing records from primary storage. [2025-10-16T17:45:18.687014] [INFO ] [MAIN ] BRO: Loaded 52061 existing records. [2025-10-16T17:45:18.863388] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:18.863636] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-16T17:45:18.863744] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-16T17:45:18.864924] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-16T17:45:18.864983] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-16T17:45:19.154666] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-16T17:45:19.160096] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T17:45:19.171932] [INFO ] [REMOTE ] BR: Full fetch complete (50042 records). [2025-10-16T17:45:19.182435] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-16T17:45:19.258083] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:19.446007] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:45:19.657711] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-16T17:45:19.657793] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-16T17:45:19.658435] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-16T17:45:19.658475] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-16T17:45:19.659573] [DEBUG] [LOCAL ] BR: Trimmed 50042 records to 35110 (keeping 200 days of data) [2025-10-16T17:45:19.879819] [DEBUG] [LOCAL ] BR: Primary data saved (35110 records). [2025-10-16T17:45:19.879962] [INFO ] [MAIN ] BR: Full history saved. [2025-10-16T17:45:19.880042] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BR took 36.6s. Estimated remaining: 4h 39m 43s. Rate: 7.3 symbols/min [2025-10-16T17:45:19.948038] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-16T17:45:20.049274] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:20.098167] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-16T17:45:20.098550] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-16T17:45:20.274542] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:20.274788] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-16T17:45:20.274837] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-16T17:45:20.275637] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-16T17:45:20.275735] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-16T17:45:20.680917] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:20.742781] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-16T17:45:20.786537] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:45:20.998089] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:45:21.000986] [INFO ] [REMOTE ] BRC: Full fetch complete (28529 records). [2025-10-16T17:45:21.001087] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-16T17:45:21.360063] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-16T17:45:21.360139] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-16T17:45:21.360587] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-16T17:45:21.360628] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-16T17:45:21.361324] [DEBUG] [LOCAL ] BRC: Trimmed 28529 records to 18774 (keeping 200 days of data) [2025-10-16T17:45:21.473339] [DEBUG] [LOCAL ] BRC: Primary data saved (18774 records). [2025-10-16T17:45:21.473495] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-16T17:45:21.473580] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 35.3s. Estimated remaining: 4h 38m 54s. Rate: 7.3 symbols/min [2025-10-16T17:45:21.547883] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-16T17:45:21.640024] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:21.640243] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-16T17:45:21.640287] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-16T17:45:21.640396] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-16T17:45:21.640436] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-16T17:45:21.640477] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-16T17:45:21.640509] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-16T17:45:21.989028] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:22.342833] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-16T17:45:22.504359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T17:45:22.539527] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:45:22.539865] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-16T17:45:22.539955] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:45:22.540001] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-16T17:45:22.540069] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:45:22.540141] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-16T17:45:22.540202] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-16T17:45:22.540237] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-16T17:45:22.540276] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-16T17:45:22.540320] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 38m 2s. Rate: 7.3 symbols/min [2025-10-16T17:45:22.704723] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:22.736567] [DEBUG] [LOCAL ] BRSP: Loaded 36808 existing records from primary storage. [2025-10-16T17:45:22.736859] [INFO ] [MAIN ] BRSP: Loaded 36808 existing records. [2025-10-16T17:45:22.913232] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:22.913418] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-16T17:45:22.913464] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-16T17:45:22.914111] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-16T17:45:22.914169] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-16T17:45:23.148227] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-16T17:45:23.364720] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:23.402067] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T17:45:23.942848] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-16T17:45:24.701578] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T17:45:24.707233] [INFO ] [REMOTE ] BRCC: Full fetch complete (57193 records). [2025-10-16T17:45:24.707413] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-16T17:45:24.708702] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:45:24.708836] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:45:24.709132] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:45:24.709226] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-16T17:45:24.709324] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-16T17:45:24.709391] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-16T17:45:24.709589] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-16T17:45:24.710188] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRCC took 34.0s. Estimated remaining: 4h 37m 17s. Rate: 7.3 symbols/min [2025-10-16T17:45:24.752348] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-16T17:45:24.915942] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:24.924102] [DEBUG] [LOCAL ] BRT: Loaded 5222 existing records from primary storage. [2025-10-16T17:45:24.924323] [INFO ] [MAIN ] BRT: Loaded 5222 existing records. [2025-10-16T17:45:25.096846] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:25.097124] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-16T17:45:25.097181] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-16T17:45:25.097429] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-16T17:45:25.097485] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-16T17:45:25.447861] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:25.490047] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:45:25.542807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-16T17:45:26.196806] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T17:45:26.342818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-16T17:45:26.490774] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:45:27.142807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-16T17:45:27.588941] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T17:45:27.772175] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:45:27.942943] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-16T17:45:28.429716] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T17:45:28.742856] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-16T17:45:29.542874] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-16T17:45:29.862637] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T17:45:30.342859] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-16T17:45:31.142849] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-16T17:45:31.433481] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T17:45:31.562269] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:45:31.942817] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-16T17:45:32.252501] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T17:45:32.353684] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T17:45:32.742859] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-16T17:45:33.351694] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T17:45:33.542843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-16T17:45:34.121059] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T17:45:34.342818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-16T17:45:35.142851] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-16T17:45:35.609130] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:45:35.685840] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:45:35.942809] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-16T17:45:36.707669] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T17:45:36.742813] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-16T17:45:37.435911] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T17:45:37.542838] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-16T17:45:38.342797] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-16T17:45:38.413885] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:45:38.415350] [INFO ] [REMOTE ] BRT: Full fetch complete (6997 records). [2025-10-16T17:45:38.415428] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-16T17:45:38.415860] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:45:38.415945] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:45:38.415992] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:45:38.416061] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-16T17:45:38.416124] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-16T17:45:38.416159] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-16T17:45:38.416301] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-16T17:45:38.416383] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRT took 13.7s. Estimated remaining: 4h 37m 42s. Rate: 7.3 symbols/min [2025-10-16T17:45:38.587865] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:38.608399] [DEBUG] [LOCAL ] BRW: Loaded 20981 existing records from primary storage. [2025-10-16T17:45:38.608692] [INFO ] [MAIN ] BRW: Loaded 20981 existing records. [2025-10-16T17:45:38.787564] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:38.787790] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-16T17:45:38.787849] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-16T17:45:38.788331] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-16T17:45:38.788385] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-16T17:45:39.161756] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:45:39.156321] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-16T17:45:39.942789] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-16T17:45:39.984902] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T17:45:40.742826] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-16T17:45:40.980314] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:45:41.059855] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T17:45:41.542836] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-16T17:45:41.941634] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-16T17:45:42.342824] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-16T17:45:43.142812] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-16T17:45:43.563942] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T17:45:43.619100] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T17:45:43.942839] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-16T17:45:44.316235] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T17:45:44.742835] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-16T17:45:44.905152] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:45:45.542850] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-16T17:45:45.699470] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:45:46.342816] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-16T17:45:47.142850] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-16T17:45:47.327124] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T17:45:47.765164] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T17:45:47.867748] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:45:47.942832] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-16T17:45:48.708912] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T17:45:48.742816] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-16T17:45:49.379424] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:45:49.542820] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-16T17:45:50.342845] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-16T17:45:51.142841] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-16T17:45:51.903752] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-16T17:45:51.935115] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T17:45:51.952233] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-16T17:45:51.965781] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T17:45:52.742880] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-16T17:45:53.542799] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-16T17:45:53.750457] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:45:54.233876] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T17:45:54.342802] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-16T17:45:55.142803] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-16T17:45:55.265028] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:45:55.319445] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T17:45:55.942823] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-16T17:45:56.286427] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T17:45:56.742831] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-16T17:45:57.456800] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:45:57.542772] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-16T17:45:57.860164] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:45:58.342875] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-16T17:45:58.709304] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T17:45:58.714304] [INFO ] [REMOTE ] BRSP: Full fetch complete (54315 records). [2025-10-16T17:45:58.714396] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-16T17:45:59.103348] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-16T17:45:59.103454] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-16T17:45:59.104333] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-16T17:45:59.104397] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-16T17:45:59.105846] [DEBUG] [LOCAL ] BRSP: Trimmed 54315 records to 37050 (keeping 200 days of data) [2025-10-16T17:45:59.158629] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-16T17:45:59.324536] [DEBUG] [LOCAL ] BRSP: Primary data saved (37050 records). [2025-10-16T17:45:59.324695] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-16T17:45:59.324786] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BRSP took 36.8s. Estimated remaining: 4h 38m 51s. Rate: 7.3 symbols/min [2025-10-16T17:45:59.508817] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:45:59.556691] [DEBUG] [LOCAL ] BRX: Loaded 51797 existing records from primary storage. [2025-10-16T17:45:59.557017] [INFO ] [MAIN ] BRX: Loaded 51797 existing records. [2025-10-16T17:45:59.734720] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:45:59.735592] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-16T17:45:59.735671] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-16T17:45:59.736526] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-16T17:45:59.736586] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-16T17:45:59.947917] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-16T17:46:00.108935] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:00.151676] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T17:46:00.462179] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T17:46:00.742813] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-16T17:46:01.542805] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-16T17:46:01.809401] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T17:46:01.813229] [INFO ] [REMOTE ] BRW: Full fetch complete (30323 records). [2025-10-16T17:46:01.813331] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-16T17:46:01.814120] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:01.814220] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:01.814263] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:01.814330] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-16T17:46:01.814416] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-16T17:46:01.814488] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-16T17:46:01.814601] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-16T17:46:01.814697] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRW took 23.4s. Estimated remaining: 4h 38m 8s. Rate: 7.3 symbols/min [2025-10-16T17:46:01.987429] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:01.987673] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-16T17:46:01.987782] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-16T17:46:01.987939] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-16T17:46:01.988006] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-16T17:46:01.988063] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-16T17:46:01.988233] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-16T17:46:02.270980] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-16T17:46:02.354078] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-16T17:46:02.395109] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:02.928488] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:46:03.142815] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-16T17:46:03.942843] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-16T17:46:04.477065] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T17:46:04.742851] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-16T17:46:04.897397] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T17:46:05.123414] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:46:05.542804] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-16T17:46:06.342904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-16T17:46:07.021172] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-16T17:46:07.077707] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:46:07.095406] [INFO ] [REMOTE ] BRO: Full fetch complete (74501 records). [2025-10-16T17:46:07.095565] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-16T17:46:07.096510] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T17:46:07.101710] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:07.101802] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:07.101865] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:07.101937] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-16T17:46:07.101998] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-16T17:46:07.102033] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-16T17:46:07.102151] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-16T17:46:07.102708] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRO took 48.6s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-16T17:46:07.147904] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-16T17:46:07.276005] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:07.308838] [DEBUG] [LOCAL ] BSBR: Loaded 35665 existing records from primary storage. [2025-10-16T17:46:07.309256] [INFO ] [MAIN ] BSBR: Loaded 35665 existing records. [2025-10-16T17:46:07.488680] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:07.488882] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-16T17:46:07.488928] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-16T17:46:07.489569] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-16T17:46:07.489639] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-16T17:46:07.843401] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:07.942796] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-16T17:46:08.461826] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:46:08.742797] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-16T17:46:08.951596] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T17:46:09.542848] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-16T17:46:09.911673] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T17:46:10.342819] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-16T17:46:11.142766] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-16T17:46:11.344777] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T17:46:11.351625] [INFO ] [REMOTE ] BROS: Full fetch complete (77245 records). [2025-10-16T17:46:11.351774] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-16T17:46:11.730152] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T17:46:11.783858] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-16T17:46:11.783945] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-16T17:46:11.784898] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-16T17:46:11.784962] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-16T17:46:11.786425] [DEBUG] [LOCAL ] BROS: Trimmed 77245 records to 53690 (keeping 200 days of data) [2025-10-16T17:46:11.950402] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-16T17:46:12.100987] [DEBUG] [LOCAL ] BROS: Primary data saved (53690 records). [2025-10-16T17:46:12.101119] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-16T17:46:12.101194] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BROS took 52.2s. Estimated remaining: 4h 37m 15s. Rate: 7.3 symbols/min [2025-10-16T17:46:12.274854] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:12.283890] [DEBUG] [LOCAL ] BSL: Loaded 8231 existing records from primary storage. [2025-10-16T17:46:12.284077] [INFO ] [MAIN ] BSL: Loaded 8231 existing records. [2025-10-16T17:46:12.470130] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:12.470432] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-16T17:46:12.470491] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-16T17:46:12.477950] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-16T17:46:12.489614] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-16T17:46:12.560152] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:46:12.747933] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-16T17:46:12.863002] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:12.953385] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:46:13.542833] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-16T17:46:14.038956] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T17:46:14.348213] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-16T17:46:14.366525] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:46:15.142807] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-16T17:46:15.716348] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:46:15.942854] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-16T17:46:16.319628] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T17:46:16.438707] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-16T17:46:16.742873] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-16T17:46:17.542800] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-16T17:46:17.955896] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:46:18.342830] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-16T17:46:18.352528] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T17:46:19.142826] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-16T17:46:19.878488] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:46:19.942883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-16T17:46:20.437796] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:46:20.742859] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-16T17:46:21.475794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:46:21.542795] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-16T17:46:21.723700] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:46:22.342865] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-16T17:46:22.916779] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T17:46:23.107577] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:46:23.142817] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-16T17:46:23.942824] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-16T17:46:24.246243] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T17:46:24.742834] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-16T17:46:25.542802] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-16T17:46:25.667135] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T17:46:25.739943] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T17:46:26.342787] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-16T17:46:26.397097] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T17:46:27.142813] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-16T17:46:27.942863] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-16T17:46:28.044733] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T17:46:28.221478] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:46:28.729795] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T17:46:28.742772] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-16T17:46:29.269246] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T17:46:29.542811] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-16T17:46:30.342807] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-16T17:46:30.963790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T17:46:30.968263] [INFO ] [REMOTE ] BSBR: Full fetch complete (50684 records). [2025-10-16T17:46:30.968410] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-16T17:46:30.969200] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:30.969289] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:30.969333] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:30.969402] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-16T17:46:30.969469] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-16T17:46:30.969508] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-10-16T17:46:30.969623] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-10-16T17:46:30.969731] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BSBR took 23.9s. Estimated remaining: 4h 38m 11s. Rate: 7.3 symbols/min [2025-10-16T17:46:31.147954] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-16T17:46:31.213072] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:31.213303] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-16T17:46:31.213348] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-16T17:46:31.213460] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-16T17:46:31.213501] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-16T17:46:31.213541] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-16T17:46:31.213574] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-16T17:46:31.733994] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:31.861546] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:46:31.888727] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T17:46:31.942878] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-16T17:46:32.742825] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-16T17:46:33.469687] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T17:46:33.542797] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-16T17:46:33.911505] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:46:34.342867] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-16T17:46:34.891514] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T17:46:35.142821] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-16T17:46:35.622978] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T17:46:35.942795] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-16T17:46:36.031583] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T17:46:36.743588] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-16T17:46:36.746312] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T17:46:37.542853] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-16T17:46:38.123208] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T17:46:38.135902] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T17:46:38.342805] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-16T17:46:38.941996] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T17:46:39.142828] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-16T17:46:39.942883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-16T17:46:40.742771] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-16T17:46:40.783689] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:46:40.790714] [INFO ] [REMOTE ] BRX: Full fetch complete (74754 records). [2025-10-16T17:46:40.790906] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-16T17:46:40.792024] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:46:40.792121] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:46:40.792165] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:46:40.792238] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-16T17:46:40.792315] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-16T17:46:40.792352] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-10-16T17:46:40.792539] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-10-16T17:46:40.793450] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRX took 41.5s. Estimated remaining: 4h 38m 12s. Rate: 7.3 symbols/min [2025-10-16T17:46:40.977930] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:41.004450] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:46:41.033073] [DEBUG] [LOCAL ] BST: Loaded 18867 existing records from primary storage. [2025-10-16T17:46:41.033437] [INFO ] [MAIN ] BST: Loaded 18867 existing records. [2025-10-16T17:46:41.227084] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:41.227545] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-16T17:46:41.227611] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-16T17:46:41.228697] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-16T17:46:41.228764] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-16T17:46:41.544844] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-16T17:46:41.581302] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:46:41.608725] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:41.610141] [INFO ] [REMOTE ] BSL: Full fetch complete (12938 records). [2025-10-16T17:46:41.610260] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-16T17:46:41.962790] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-16T17:46:41.962868] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-16T17:46:41.963154] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-16T17:46:41.963193] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-16T17:46:41.963630] [DEBUG] [LOCAL ] BSL: Trimmed 12938 records to 8327 (keeping 200 days of data) [2025-10-16T17:46:42.013298] [DEBUG] [LOCAL ] BSL: Primary data saved (8327 records). [2025-10-16T17:46:42.013442] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-16T17:46:42.013527] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSL took 29.9s. Estimated remaining: 4h 37m 22s. Rate: 7.3 symbols/min [2025-10-16T17:46:42.176924] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:42.198799] [DEBUG] [LOCAL ] BSTZ: Loaded 24906 existing records from primary storage. [2025-10-16T17:46:42.199056] [INFO ] [MAIN ] BSTZ: Loaded 24906 existing records. [2025-10-16T17:46:42.345377] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-16T17:46:42.376293] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:42.376714] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-16T17:46:42.376778] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-16T17:46:42.377213] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-16T17:46:42.377272] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-16T17:46:42.681295] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T17:46:42.763841] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:43.142820] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-16T17:46:43.583406] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T17:46:43.942809] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-16T17:46:44.251719] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T17:46:44.653431] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T17:46:44.742824] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-16T17:46:45.542831] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-16T17:46:45.839699] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T17:46:46.342869] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-16T17:46:46.560238] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T17:46:47.126258] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T17:46:47.142775] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-16T17:46:47.942807] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-16T17:46:48.299831] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T17:46:48.742792] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-16T17:46:48.809087] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T17:46:49.542845] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-16T17:46:49.781129] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T17:46:49.785608] [INFO ] [REMOTE ] BSAC: Full fetch complete (44891 records). [2025-10-16T17:46:49.785771] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-16T17:46:50.160931] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-16T17:46:50.161012] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-16T17:46:50.161614] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-16T17:46:50.161690] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-16T17:46:50.162716] [DEBUG] [LOCAL ] BSAC: Trimmed 44891 records to 33148 (keeping 200 days of data) [2025-10-16T17:46:50.348456] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-16T17:46:50.348754] [DEBUG] [LOCAL ] BSAC: Primary data saved (33148 records). [2025-10-16T17:46:50.349906] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-16T17:46:50.350144] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSAC took 48.5s. Estimated remaining: 4h 37m 15s. Rate: 7.3 symbols/min [2025-10-16T17:46:50.546366] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:46:50.595535] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-16T17:46:50.596114] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-16T17:46:50.701715] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:46:50.793612] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:46:50.793859] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-16T17:46:50.793907] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-16T17:46:50.794887] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-16T17:46:50.794945] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-16T17:46:51.140392] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:46:51.142771] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-16T17:46:51.799727] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:46:51.942879] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-16T17:46:52.687720] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:46:52.742794] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-16T17:46:52.950758] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T17:46:53.542867] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-16T17:46:54.089307] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:46:54.342847] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-16T17:46:54.545233] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:46:55.142815] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-16T17:46:55.942798] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-16T17:46:56.223058] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T17:46:56.577541] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T17:46:56.742808] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-16T17:46:57.155248] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T17:46:57.542853] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-16T17:46:58.158782] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T17:46:58.342843] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-16T17:46:59.142842] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-16T17:46:59.377983] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T17:46:59.379066] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T17:46:59.942839] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-16T17:47:00.258871] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:47:00.742859] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-16T17:47:01.542871] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-16T17:47:01.748512] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T17:47:01.959011] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:47:02.342872] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-16T17:47:02.574074] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:47:03.142893] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-16T17:47:03.284050] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T17:47:03.288241] [INFO ] [REMOTE ] BSM: Full fetch complete (47000 records). [2025-10-16T17:47:03.288355] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-16T17:47:03.664745] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-16T17:47:03.664823] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-16T17:47:03.665418] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-16T17:47:03.665460] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-16T17:47:03.666371] [DEBUG] [LOCAL ] BSM: Trimmed 47000 records to 32574 (keeping 200 days of data) [2025-10-16T17:47:03.855041] [DEBUG] [LOCAL ] BSM: Primary data saved (32574 records). [2025-10-16T17:47:03.855175] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-16T17:47:03.855243] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSM took 32.9s. Estimated remaining: 4h 37m 38s. Rate: 7.3 symbols/min [2025-10-16T17:47:03.952890] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-16T17:47:04.026369] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:04.032923] [DEBUG] [LOCAL ] BTA: Loaded 5669 existing records from primary storage. [2025-10-16T17:47:04.033106] [INFO ] [MAIN ] BTA: Loaded 5669 existing records. [2025-10-16T17:47:04.225820] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:04.226630] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-16T17:47:04.227239] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-16T17:47:04.227154] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T17:47:04.231960] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-16T17:47:04.232050] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-16T17:47:04.589209] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:04.742836] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-16T17:47:05.542850] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-16T17:47:05.872702] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:47:06.035677] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-16T17:47:06.069045] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T17:47:06.342820] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-16T17:47:07.142788] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-16T17:47:07.596272] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T17:47:07.942785] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-16T17:47:08.220701] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:47:08.742810] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-16T17:47:09.303231] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T17:47:09.542803] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-16T17:47:09.636888] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:47:10.290788] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:47:10.342793] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-16T17:47:11.142806] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-16T17:47:11.889434] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T17:47:11.942770] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-16T17:47:12.217728] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T17:47:12.742842] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-16T17:47:12.762396] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T17:47:13.542823] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-16T17:47:14.342785] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-16T17:47:14.586035] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:47:14.735583] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T17:47:15.142835] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-16T17:47:15.524860] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T17:47:15.942871] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-16T17:47:16.742791] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-16T17:47:16.862861] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:47:17.129996] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:47:17.133245] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36512 records). [2025-10-16T17:47:17.133317] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-16T17:47:17.133935] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:47:17.134015] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:47:17.134057] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:47:17.134096] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-16T17:47:17.134150] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-16T17:47:17.134194] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-16T17:47:17.134346] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-16T17:47:17.134431] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSTZ took 35.1s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-16T17:47:17.300408] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:17.316110] [DEBUG] [LOCAL ] BTCM: Loaded 16911 existing records from primary storage. [2025-10-16T17:47:17.316322] [INFO ] [MAIN ] BTCM: Loaded 16911 existing records. [2025-10-16T17:47:17.418339] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T17:47:17.494406] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:17.494568] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-16T17:47:17.494613] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-16T17:47:17.494971] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-16T17:47:17.495027] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-16T17:47:17.547903] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-16T17:47:17.843894] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:18.342807] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-16T17:47:18.510014] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:47:18.512534] [INFO ] [REMOTE ] BST: Full fetch complete (28400 records). [2025-10-16T17:47:18.512612] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-16T17:47:18.513084] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:47:18.513172] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:47:18.513240] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:47:18.513310] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-16T17:47:18.513372] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-16T17:47:18.513407] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-16T17:47:18.513535] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-10-16T17:47:18.513632] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BST took 37.7s. Estimated remaining: 4h 37m 11s. Rate: 7.3 symbols/min [2025-10-16T17:47:18.681456] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:18.728906] [DEBUG] [LOCAL ] BTE: Loaded 52736 existing records from primary storage. [2025-10-16T17:47:18.729221] [INFO ] [MAIN ] BTE: Loaded 52736 existing records. [2025-10-16T17:47:18.902196] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:18.902356] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-16T17:47:18.902402] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-16T17:47:18.903300] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-16T17:47:18.903358] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-16T17:47:19.147957] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-16T17:47:19.257131] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:19.446378] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T17:47:19.942824] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-16T17:47:20.543277] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T17:47:20.742906] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-16T17:47:21.059891] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T17:47:21.423698] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T17:47:21.542820] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-16T17:47:22.342934] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-16T17:47:22.905363] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T17:47:23.011696] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T17:47:23.142768] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-16T17:47:23.942897] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-16T17:47:24.524465] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T17:47:24.550114] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T17:47:24.742809] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-16T17:47:25.539840] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T17:47:25.542758] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-16T17:47:25.981635] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T17:47:26.342815] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-16T17:47:27.002092] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T17:47:27.142876] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-16T17:47:27.779590] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T17:47:27.942784] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-16T17:47:28.742803] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-16T17:47:29.144371] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T17:47:29.183619] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T17:47:29.190462] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-16T17:47:29.190580] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-16T17:47:29.542820] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-16T17:47:29.586602] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-16T17:47:29.586721] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-16T17:47:29.587718] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-16T17:47:29.587906] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-16T17:47:29.589448] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 54078 (keeping 200 days of data) [2025-10-16T17:47:29.913751] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-16T17:47:29.913988] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-16T17:47:29.914583] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BSX took 39.6s. Estimated remaining: 4h 37m 21s. Rate: 7.3 symbols/min [2025-10-16T17:47:30.080984] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:30.129189] [DEBUG] [LOCAL ] BTI: Loaded 53596 existing records from primary storage. [2025-10-16T17:47:30.129496] [INFO ] [MAIN ] BTI: Loaded 53596 existing records. [2025-10-16T17:47:30.303229] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:30.303470] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-16T17:47:30.303517] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-16T17:47:30.304427] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-16T17:47:30.304498] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-16T17:47:30.346441] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-16T17:47:30.407160] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T17:47:30.665875] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:31.142811] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-16T17:47:31.942803] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-16T17:47:32.200106] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T17:47:32.399211] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T17:47:32.679073] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:47:32.742772] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-16T17:47:33.542889] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-16T17:47:34.255055] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T17:47:34.342810] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-16T17:47:34.381220] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T17:47:35.142817] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-16T17:47:35.942786] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-16T17:47:36.131866] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:47:36.495841] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T17:47:36.497297] [INFO ] [REMOTE ] BTA: Full fetch complete (9601 records). [2025-10-16T17:47:36.497364] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-16T17:47:36.745566] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-16T17:47:36.867033] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-16T17:47:36.867107] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-16T17:47:36.867330] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-16T17:47:36.867369] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-16T17:47:36.867834] [DEBUG] [LOCAL ] BTA: Trimmed 9601 records to 5735 (keeping 200 days of data) [2025-10-16T17:47:36.901974] [DEBUG] [LOCAL ] BTA: Primary data saved (5735 records). [2025-10-16T17:47:36.902080] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-16T17:47:36.902156] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BTA took 33.0s. Estimated remaining: 4h 37m 6s. Rate: 7.3 symbols/min [2025-10-16T17:47:37.072167] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:37.104669] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T17:47:37.119631] [DEBUG] [LOCAL ] BTO: Loaded 8850 existing records from primary storage. [2025-10-16T17:47:37.119843] [INFO ] [MAIN ] BTO: Loaded 8850 existing records. [2025-10-16T17:47:37.293668] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:37.293872] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-16T17:47:37.293919] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-16T17:47:37.294177] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-16T17:47:37.294234] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-16T17:47:37.547953] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-16T17:47:37.642729] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:38.342860] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-16T17:47:38.851102] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-16T17:47:38.903290] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T17:47:39.142829] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-16T17:47:39.461065] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T17:47:39.942821] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-16T17:47:40.567939] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T17:47:40.617407] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T17:47:40.742774] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-16T17:47:41.542830] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-16T17:47:42.342812] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-16T17:47:42.460621] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T17:47:42.499716] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T17:47:43.142801] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-16T17:47:43.942841] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-16T17:47:44.403958] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T17:47:44.674501] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:47:44.742778] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-16T17:47:44.856901] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:47:45.536342] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:47:45.542764] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-16T17:47:46.342794] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-16T17:47:46.440195] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T17:47:47.142827] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-16T17:47:47.942789] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-16T17:47:48.108098] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T17:47:48.133806] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T17:47:48.742811] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-16T17:47:49.542836] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-16T17:47:49.754744] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:47:49.896770] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T17:47:50.143235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:47:50.342830] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-16T17:47:51.142823] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-16T17:47:51.525815] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T17:47:51.529622] [INFO ] [REMOTE ] BTCM: Full fetch complete (20267 records). [2025-10-16T17:47:51.529813] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-16T17:47:51.903822] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-16T17:47:51.903901] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-16T17:47:51.904362] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-16T17:47:51.904404] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-16T17:47:51.905027] [DEBUG] [LOCAL ] BTCM: Trimmed 20267 records to 17122 (keeping 200 days of data) [2025-10-16T17:47:51.944230] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-16T17:47:52.003617] [DEBUG] [LOCAL ] BTCM: Primary data saved (17122 records). [2025-10-16T17:47:52.003787] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-16T17:47:52.003870] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTCM took 34.9s. Estimated remaining: 4h 37m 38s. Rate: 7.3 symbols/min [2025-10-16T17:47:52.172729] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:52.187364] [DEBUG] [LOCAL ] BTT: Loaded 15721 existing records from primary storage. [2025-10-16T17:47:52.187583] [INFO ] [MAIN ] BTT: Loaded 15721 existing records. [2025-10-16T17:47:52.368100] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:47:52.368310] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-16T17:47:52.368360] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-16T17:47:52.368842] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-16T17:47:52.368902] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-16T17:47:52.747140] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-16T17:47:52.747043] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:52.749632] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:47:53.162919] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-16T17:47:53.169814] [INFO ] [REMOTE ] BTE: Full fetch complete (76387 records). [2025-10-16T17:47:53.169929] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-16T17:47:53.553467] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-16T17:47:53.558519] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-16T17:47:53.558599] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-16T17:47:53.559483] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-16T17:47:53.559548] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-16T17:47:53.561295] [DEBUG] [LOCAL ] BTE: Trimmed 76387 records to 53118 (keeping 200 days of data) [2025-10-16T17:47:53.870910] [DEBUG] [LOCAL ] BTE: Primary data saved (53118 records). [2025-10-16T17:47:53.871049] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-16T17:47:53.871814] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTE took 35.4s. Estimated remaining: 4h 36m 53s. Rate: 7.3 symbols/min [2025-10-16T17:47:54.040592] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:47:54.040821] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-16T17:47:54.040868] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-16T17:47:54.040976] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-16T17:47:54.041017] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-16T17:47:54.041057] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-16T17:47:54.041088] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-16T17:47:54.353275] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-16T17:47:54.396153] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:47:54.733325] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:47:54.889444] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:47:54.910109] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T17:47:55.142796] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-16T17:47:55.857312] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:47:55.942840] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-16T17:47:56.584000] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:47:56.742856] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-16T17:47:57.542818] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-16T17:47:57.713678] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:47:58.342836] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-16T17:47:58.354468] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:47:59.142819] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-16T17:47:59.840958] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T17:47:59.942794] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-16T17:48:00.276999] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T17:48:00.742821] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-16T17:48:01.021221] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T17:48:01.023236] [INFO ] [REMOTE ] BTO: Full fetch complete (13328 records). [2025-10-16T17:48:01.023334] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-16T17:48:01.425430] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-16T17:48:01.425529] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-16T17:48:01.425892] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-16T17:48:01.425957] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-16T17:48:01.426449] [DEBUG] [LOCAL ] BTO: Trimmed 13328 records to 8975 (keeping 200 days of data) [2025-10-16T17:48:01.480945] [DEBUG] [LOCAL ] BTO: Primary data saved (8975 records). [2025-10-16T17:48:01.481096] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-16T17:48:01.481202] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTO took 24.6s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-16T17:48:01.548098] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-16T17:48:01.657410] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:01.657602] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-16T17:48:01.657664] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-16T17:48:01.657789] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-16T17:48:01.657831] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-16T17:48:01.657871] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-16T17:48:01.657904] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-16T17:48:02.024139] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:02.342879] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-16T17:48:02.890287] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T17:48:03.151875] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-16T17:48:03.153102] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T17:48:03.322543] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:48:03.322829] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-16T17:48:03.322916] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:48:03.322988] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-16T17:48:03.323053] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:48:03.323122] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-16T17:48:03.323184] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-16T17:48:03.323220] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-16T17:48:03.323258] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-16T17:48:03.323303] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTX took 1.8s. Estimated remaining: 4h 35m 56s. Rate: 7.3 symbols/min [2025-10-16T17:48:03.498194] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:03.528266] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T17:48:03.553787] [DEBUG] [LOCAL ] BTZ: Loaded 22588 existing records from primary storage. [2025-10-16T17:48:03.554013] [INFO ] [MAIN ] BTZ: Loaded 22588 existing records. [2025-10-16T17:48:03.728159] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:03.728345] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-16T17:48:03.728396] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-16T17:48:03.728887] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-16T17:48:03.728944] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-16T17:48:03.948082] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-16T17:48:04.093544] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:04.742825] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-16T17:48:05.101705] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T17:48:05.542818] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-16T17:48:06.342844] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-16T17:48:06.477591] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:48:07.032417] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-16T17:48:07.142805] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-16T17:48:07.794815] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T17:48:07.942833] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-16T17:48:08.467894] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:48:08.742813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-16T17:48:09.551773] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-16T17:48:09.574459] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T17:48:10.265428] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T17:48:10.342780] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-16T17:48:10.412988] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:48:11.142842] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-16T17:48:11.942790] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-16T17:48:12.167302] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T17:48:12.405522] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T17:48:12.412394] [INFO ] [REMOTE ] BTI: Full fetch complete (77636 records). [2025-10-16T17:48:12.412516] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-16T17:48:12.748694] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-16T17:48:12.797539] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-16T17:48:12.797632] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-16T17:48:12.798545] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-16T17:48:12.798743] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-16T17:48:12.800324] [DEBUG] [LOCAL ] BTI: Trimmed 77636 records to 53986 (keeping 200 days of data) [2025-10-16T17:48:13.129370] [DEBUG] [LOCAL ] BTI: Primary data saved (53986 records). [2025-10-16T17:48:13.129530] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-16T17:48:13.130037] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTI took 43.2s. Estimated remaining: 4h 35m 57s. Rate: 7.3 symbols/min [2025-10-16T17:48:13.294574] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:13.345160] [DEBUG] [LOCAL ] BUD: Loaded 52596 existing records from primary storage. [2025-10-16T17:48:13.345464] [INFO ] [MAIN ] BUD: Loaded 52596 existing records. [2025-10-16T17:48:13.521481] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:13.521902] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-16T17:48:13.522050] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-16T17:48:13.523059] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-16T17:48:13.523118] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-16T17:48:13.553334] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-16T17:48:13.843077] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T17:48:13.929187] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:13.968399] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-16T17:48:14.342825] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-16T17:48:14.770475] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T17:48:15.142808] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-16T17:48:15.942813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-16T17:48:15.978793] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:48:16.194055] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-16T17:48:16.742893] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-16T17:48:17.542815] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-16T17:48:18.010524] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T17:48:18.342860] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-16T17:48:18.717481] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T17:48:18.902715] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T17:48:19.142876] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-16T17:48:19.948406] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-16T17:48:19.954304] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:48:20.075401] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:48:20.742872] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-16T17:48:21.542813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-16T17:48:21.865392] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T17:48:21.899906] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-16T17:48:22.342777] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-16T17:48:22.930840] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T17:48:23.142832] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-16T17:48:23.353948] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T17:48:23.942902] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-16T17:48:24.580106] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T17:48:24.582012] [INFO ] [REMOTE ] BTT: Full fetch complete (22723 records). [2025-10-16T17:48:24.582129] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-16T17:48:24.582567] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:48:24.582630] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:48:24.582704] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:48:24.582751] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-16T17:48:24.582820] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-16T17:48:24.582877] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-16T17:48:24.583003] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-10-16T17:48:24.583085] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTT took 32.6s. Estimated remaining: 4h 36m 7s. Rate: 7.3 symbols/min [2025-10-16T17:48:24.755340] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-16T17:48:24.756971] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:24.769054] [DEBUG] [LOCAL ] BUI: Loaded 11893 existing records from primary storage. [2025-10-16T17:48:24.769278] [INFO ] [MAIN ] BUI: Loaded 11893 existing records. [2025-10-16T17:48:24.944666] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:24.944859] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-16T17:48:24.944906] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-16T17:48:24.945209] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-16T17:48:24.945265] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-16T17:48:25.298891] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:25.329134] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T17:48:25.542813] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-16T17:48:26.342891] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-16T17:48:26.544968] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:48:27.034889] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T17:48:27.142800] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-16T17:48:27.340872] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:48:27.942841] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-16T17:48:28.184490] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T17:48:28.742854] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-16T17:48:29.450202] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T17:48:29.542796] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-16T17:48:30.318264] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T17:48:30.342776] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-16T17:48:31.142786] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-16T17:48:31.331450] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T17:48:31.338369] [INFO ] [REMOTE ] BTU: Full fetch complete (77264 records). [2025-10-16T17:48:31.338510] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-16T17:48:31.699767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T17:48:31.731405] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-16T17:48:31.731493] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-16T17:48:31.732431] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-16T17:48:31.732496] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-16T17:48:31.733914] [DEBUG] [LOCAL ] BTU: Trimmed 77264 records to 53714 (keeping 200 days of data) [2025-10-16T17:48:31.960690] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-16T17:48:32.055155] [DEBUG] [LOCAL ] BTU: Primary data saved (53714 records). [2025-10-16T17:48:32.055296] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-16T17:48:32.055367] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTU took 38.2s. Estimated remaining: 4h 35m 55s. Rate: 7.3 symbols/min [2025-10-16T17:48:32.226139] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:32.266368] [DEBUG] [LOCAL ] BUR: Loaded 45344 existing records from primary storage. [2025-10-16T17:48:32.266751] [INFO ] [MAIN ] BUR: Loaded 45344 existing records. [2025-10-16T17:48:32.445057] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:32.445427] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-16T17:48:32.445598] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-16T17:48:32.457940] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-16T17:48:32.475101] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-16T17:48:32.532277] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-16T17:48:32.626364] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:48:32.747938] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-16T17:48:32.859554] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:33.542815] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-16T17:48:34.277267] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T17:48:34.342792] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-16T17:48:34.502610] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:48:34.882562] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T17:48:35.142822] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-16T17:48:35.942832] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-16T17:48:36.657149] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T17:48:36.742793] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-16T17:48:37.149232] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T17:48:37.542814] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-16T17:48:38.236297] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:48:38.252374] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T17:48:38.342809] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-16T17:48:39.142794] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-16T17:48:39.392008] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:48:39.395385] [INFO ] [REMOTE ] BTZ: Full fetch complete (33397 records). [2025-10-16T17:48:39.395485] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-16T17:48:39.782025] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:48:39.797429] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-16T17:48:39.799985] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-16T17:48:39.801383] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-16T17:48:39.801447] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-16T17:48:39.802257] [DEBUG] [LOCAL ] BTZ: Trimmed 33397 records to 22717 (keeping 200 days of data) [2025-10-16T17:48:39.936092] [DEBUG] [LOCAL ] BTZ: Primary data saved (22717 records). [2025-10-16T17:48:39.936223] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-16T17:48:39.936328] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTZ took 36.6s. Estimated remaining: 4h 35m 45s. Rate: 7.3 symbols/min [2025-10-16T17:48:39.948166] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-16T17:48:40.114116] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:40.154368] [DEBUG] [LOCAL ] BURL: Loaded 45707 existing records from primary storage. [2025-10-16T17:48:40.154689] [INFO ] [MAIN ] BURL: Loaded 45707 existing records. [2025-10-16T17:48:40.331260] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:48:40.331481] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-16T17:48:40.331529] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-16T17:48:40.332355] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-16T17:48:40.332414] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-16T17:48:40.682736] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:40.742787] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-16T17:48:41.542798] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-16T17:48:41.966417] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T17:48:42.342797] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-16T17:48:42.415403] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:48:42.479751] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T17:48:43.142895] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-16T17:48:43.914903] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T17:48:43.942781] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-16T17:48:44.037837] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T17:48:44.742886] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-16T17:48:45.542832] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-16T17:48:45.643594] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T17:48:45.828755] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T17:48:46.342869] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-16T17:48:46.704872] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T17:48:47.142814] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-16T17:48:47.547455] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:48:47.942852] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-16T17:48:48.733610] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T17:48:48.742775] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-16T17:48:49.542817] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-16T17:48:49.615997] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T17:48:50.342923] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-16T17:48:50.440561] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T17:48:51.142855] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-16T17:48:51.178030] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T17:48:51.184701] [INFO ] [REMOTE ] BUD: Full fetch complete (76495 records). [2025-10-16T17:48:51.184823] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-16T17:48:51.576568] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-16T17:48:51.576720] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-16T17:48:51.577561] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-16T17:48:51.577606] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-16T17:48:51.579022] [DEBUG] [LOCAL ] BUD: Trimmed 76495 records to 52981 (keeping 200 days of data) [2025-10-16T17:48:51.711494] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T17:48:51.849864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T17:48:51.939659] [DEBUG] [LOCAL ] BUD: Primary data saved (52981 records). [2025-10-16T17:48:51.939798] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-16T17:48:51.940422] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BUD took 38.8s. Estimated remaining: 4h 35m 58s. Rate: 7.3 symbols/min [2025-10-16T17:48:51.950638] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-16T17:48:52.107344] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:48:52.107494] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-16T17:48:52.107530] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-16T17:48:52.107661] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-16T17:48:52.107718] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-16T17:48:52.107763] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-16T17:48:52.107794] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-16T17:48:52.452147] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:48:52.742812] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-16T17:48:53.503362] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T17:48:53.542744] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-16T17:48:53.750702] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T17:48:54.342783] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-16T17:48:54.558759] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:48:55.088044] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T17:48:55.142818] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-16T17:48:55.942858] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-16T17:48:56.696938] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T17:48:56.742829] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-16T17:48:57.298540] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:48:57.542869] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-16T17:48:58.044100] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T17:48:58.342841] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-16T17:48:58.696872] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T17:48:59.093944] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T17:48:59.142816] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-16T17:48:59.732438] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T17:48:59.942823] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-16T17:49:00.742826] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-16T17:49:01.542788] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-16T17:49:01.654163] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:49:02.241810] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T17:49:02.244087] [INFO ] [REMOTE ] BUI: Full fetch complete (16648 records). [2025-10-16T17:49:02.244180] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-16T17:49:02.343525] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-16T17:49:02.630105] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-16T17:49:02.630268] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-16T17:49:02.631187] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-16T17:49:02.631348] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-16T17:49:02.632455] [DEBUG] [LOCAL ] BUI: Trimmed 16648 records to 12010 (keeping 200 days of data) [2025-10-16T17:49:02.714744] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T17:49:02.747487] [DEBUG] [LOCAL ] BUI: Primary data saved (12010 records). [2025-10-16T17:49:02.747725] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-16T17:49:02.747855] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 38.2s. Estimated remaining: 4h 36m 4s. Rate: 7.3 symbols/min [2025-10-16T17:49:03.142810] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-16T17:49:03.397112] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:49:03.942859] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-16T17:49:04.702835] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T17:49:04.742866] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-16T17:49:05.237739] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:49:05.542802] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-16T17:49:06.034860] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T17:49:06.342781] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-16T17:49:07.142813] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-16T17:49:07.208061] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:49:07.558363] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:49:07.563925] [INFO ] [REMOTE ] BURL: Full fetch complete (65887 records). [2025-10-16T17:49:07.564035] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-16T17:49:07.954049] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-16T17:49:07.950578] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-16T17:49:07.954182] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-16T17:49:07.955807] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-16T17:49:07.955947] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-16T17:49:07.957228] [DEBUG] [LOCAL ] BURL: Trimmed 65887 records to 46016 (keeping 200 days of data) [2025-10-16T17:49:08.146537] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T17:49:08.263766] [DEBUG] [LOCAL ] BURL: Primary data saved (46016 records). [2025-10-16T17:49:08.263945] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-16T17:49:08.264629] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BURL took 28.3s. Estimated remaining: 4h 35m 41s. Rate: 7.3 symbols/min [2025-10-16T17:49:08.742878] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-16T17:49:09.509521] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:49:09.515432] [INFO ] [REMOTE ] BUR: Full fetch complete (64226 records). [2025-10-16T17:49:09.515558] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-16T17:49:09.820952] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T17:49:09.876874] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-16T17:49:09.922903] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-16T17:49:09.922983] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-16T17:49:09.923792] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-16T17:49:09.923854] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-16T17:49:09.925172] [DEBUG] [LOCAL ] BUR: Trimmed 64226 records to 45717 (keeping 200 days of data) [2025-10-16T17:49:10.187862] [DEBUG] [LOCAL ] BUR: Primary data saved (45717 records). [2025-10-16T17:49:10.187994] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-16T17:49:10.188497] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUR took 38.1s. Estimated remaining: 4h 34m 57s. Rate: 7.3 symbols/min [2025-10-16T17:49:10.758487] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:49:10.761859] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-16T17:49:11.613540] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T17:49:11.617365] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-16T17:49:12.575783] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T17:49:12.578022] [INFO ] [REMOTE ] BUXX: Full fetch complete (20598 records). [2025-10-16T17:49:12.578127] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-16T17:49:12.943178] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-16T17:49:12.943261] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-16T17:49:12.943676] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-16T17:49:12.943736] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-16T17:49:12.944615] [DEBUG] [LOCAL ] BUXX: Trimmed 20598 records to 15455 (keeping 200 days of data) [2025-10-16T17:49:13.034822] [DEBUG] [LOCAL ] BUXX: Primary data saved (15455 records). [2025-10-16T17:49:13.034959] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-16T17:49:13.035026] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BUXX took 21.1s. Estimated remaining: 4h 34m 19s. Rate: 7.3 symbols/min [2025-10-16T17:49:13.709787] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.717697] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.723924] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.722708] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-16T17:49:13.741133] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-16T17:49:13.744082] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-16T17:49:13.745477] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-16T17:49:13.745306] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:13.745762] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-16T17:49:13.746141] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-16T17:49:14.085412] [DEBUG] [LOCAL ] BW: Loaded 40513 existing records from primary storage. [2025-10-16T17:49:14.089276] [DEBUG] [LOCAL ] BWA: Loaded 52138 existing records from primary storage. [2025-10-16T17:49:14.101991] [INFO ] [MAIN ] BW: Loaded 40513 existing records. [2025-10-16T17:49:14.102170] [INFO ] [MAIN ] BWA: Loaded 52138 existing records. [2025-10-16T17:49:14.103009] [DEBUG] [LOCAL ] BVN: Loaded 44301 existing records from primary storage. [2025-10-16T17:49:14.131120] [INFO ] [MAIN ] BVN: Loaded 44301 existing records. [2025-10-16T17:49:14.423938] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:14.484392] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-16T17:49:14.676108] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.719886] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.747197] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-16T17:49:14.763460] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.787863] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.793477] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:14.793784] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-16T17:49:14.793987] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-16T17:49:14.793891] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-16T17:49:14.794372] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-16T17:49:14.794436] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-16T17:49:14.799735] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-16T17:49:14.799953] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-16T17:49:14.838514] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-16T17:49:14.877862] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-16T17:49:15.848459] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.872751] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-16T17:49:15.944992] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.954557] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-16T17:49:15.975571] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:15.976634] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-16T17:49:16.035976] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:49:16.043160] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-16T17:49:17.281248] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:49:17.290549] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-16T17:49:17.310250] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:49:17.316312] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-16T17:49:17.367596] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:49:17.542829] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-16T17:49:17.602407] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:49:18.284987] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:49:18.342802] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-16T17:49:18.671297] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:49:18.837317] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:49:19.142820] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-16T17:49:19.947989] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-16T17:49:19.965748] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:49:20.470159] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T17:49:20.742832] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-16T17:49:20.922587] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T17:49:21.542862] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-16T17:49:22.342777] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-16T17:49:22.371843] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T17:49:22.751920] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T17:49:23.142861] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-16T17:49:23.417994] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T17:49:23.942835] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-16T17:49:24.738632] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:49:24.747218] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-16T17:49:25.542797] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-16T17:49:25.628045] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:49:26.342841] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-16T17:49:26.375414] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T17:49:27.081436] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:49:27.142887] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-16T17:49:27.872621] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T17:49:27.942822] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-16T17:49:28.310312] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:49:28.742872] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-16T17:49:29.229638] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T17:49:29.542828] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-16T17:49:30.212750] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:49:30.342863] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-16T17:49:30.997706] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T17:49:31.142843] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-16T17:49:31.662735] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T17:49:31.942838] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-16T17:49:32.498726] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:49:32.742831] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-16T17:49:33.443134] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T17:49:33.542789] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-16T17:49:34.284227] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:49:34.342774] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-16T17:49:34.873847] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T17:49:35.142841] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-16T17:49:35.942787] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-16T17:49:36.019631] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T17:49:36.744821] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-16T17:49:36.753591] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:49:37.325442] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:49:37.542808] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-16T17:49:38.005415] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T17:49:38.342819] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-16T17:49:39.142817] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-16T17:49:39.229372] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:49:39.944345] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:49:39.943176] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-16T17:49:40.449851] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T17:49:40.742840] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-16T17:49:41.243468] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T17:49:41.542879] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-16T17:49:42.057767] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:49:42.342805] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-16T17:49:43.142840] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-16T17:49:43.398382] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T17:49:43.404709] [INFO ] [REMOTE ] BW: Full fetch complete (59447 records). [2025-10-16T17:49:43.404817] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-16T17:49:43.783912] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-16T17:49:43.784016] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-16T17:49:43.784782] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-16T17:49:43.784926] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-16T17:49:43.798863] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T17:49:43.803802] [DEBUG] [LOCAL ] BW: Trimmed 59447 records to 40868 (keeping 200 days of data) [2025-10-16T17:49:43.804694] [INFO ] [REMOTE ] BV: Full fetch complete (54833 records). [2025-10-16T17:49:43.804948] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-16T17:49:43.967410] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-16T17:49:44.305249] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-16T17:49:44.305822] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-16T17:49:44.306986] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-16T17:49:44.307778] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-16T17:49:44.313813] [DEBUG] [LOCAL ] BV: Trimmed 54833 records to 38827 (keeping 200 days of data) [2025-10-16T17:49:44.584384] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T17:49:44.597233] [DEBUG] [LOCAL ] BW: Primary data saved (40868 records). [2025-10-16T17:49:44.605181] [INFO ] [MAIN ] BW: Full history saved. [2025-10-16T17:49:44.605289] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BW took 31.6s. Estimated remaining: 4h 36m 21s. Rate: 7.3 symbols/min [2025-10-16T17:49:44.765854] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-16T17:49:44.862012] [DEBUG] [LOCAL ] BV: Primary data saved (38827 records). [2025-10-16T17:49:44.886971] [INFO ] [MAIN ] BV: Full history saved. [2025-10-16T17:49:44.887098] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BV took 31.9s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-16T17:49:44.886872] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:45.025145] [DEBUG] [LOCAL ] BWG: Loaded 12586 existing records from primary storage. [2025-10-16T17:49:45.043073] [INFO ] [MAIN ] BWG: Loaded 12586 existing records. [2025-10-16T17:49:45.144214] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:45.252563] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:45.253737] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-16T17:49:45.253835] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-16T17:49:45.254329] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-16T17:49:45.254402] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-16T17:49:45.397935] [DEBUG] [LOCAL ] BWLP: Loaded 32251 existing records from primary storage. [2025-10-16T17:49:45.434822] [INFO ] [MAIN ] BWLP: Loaded 32251 existing records. [2025-10-16T17:49:45.836709] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:45.845418] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-16T17:49:45.843060] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:45.847044] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T17:49:45.846346] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-16T17:49:45.853989] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-16T17:49:45.854955] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-16T17:49:45.855062] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-16T17:49:45.854912] [INFO ] [REMOTE ] BVN: Full fetch complete (63303 records). [2025-10-16T17:49:45.886052] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-16T17:49:46.536140] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:46.563256] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-16T17:49:46.636819] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-16T17:49:46.636921] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-16T17:49:46.637726] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-16T17:49:46.637805] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-16T17:49:46.639264] [DEBUG] [LOCAL ] BVN: Trimmed 63303 records to 44679 (keeping 200 days of data) [2025-10-16T17:49:46.765973] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:49:46.766239] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T17:49:46.951831] [DEBUG] [LOCAL ] BVN: Primary data saved (44679 records). [2025-10-16T17:49:46.951962] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-16T17:49:46.952064] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BVN took 33.9s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-16T17:49:47.118135] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:47.127786] [DEBUG] [LOCAL ] BWMX: Loaded 7781 existing records from primary storage. [2025-10-16T17:49:47.127994] [INFO ] [MAIN ] BWMX: Loaded 7781 existing records. [2025-10-16T17:49:47.148119] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-16T17:49:47.309329] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:47.309548] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-16T17:49:47.309594] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-16T17:49:47.309794] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-16T17:49:47.309853] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-16T17:49:47.659716] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:47.942830] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-16T17:49:48.203176] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:49:48.742878] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-16T17:49:48.939545] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:49:49.124179] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T17:49:49.256314] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-16T17:49:49.542835] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-16T17:49:50.025771] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:49:50.342814] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-16T17:49:51.142842] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-16T17:49:51.744961] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T17:49:51.764854] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T17:49:51.942807] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-16T17:49:52.742862] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-16T17:49:52.769395] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T17:49:53.132030] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T17:49:53.542842] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-16T17:49:54.342839] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-16T17:49:55.060348] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T17:49:55.142792] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-16T17:49:55.231532] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T17:49:55.238468] [INFO ] [REMOTE ] BWA: Full fetch complete (75906 records). [2025-10-16T17:49:55.238601] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-16T17:49:55.621273] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-16T17:49:55.621349] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-16T17:49:55.622205] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-16T17:49:55.622267] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-16T17:49:55.623620] [DEBUG] [LOCAL ] BWA: Trimmed 75906 records to 52519 (keeping 200 days of data) [2025-10-16T17:49:55.845860] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T17:49:55.943148] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-16T17:49:55.960724] [DEBUG] [LOCAL ] BWA: Primary data saved (52519 records). [2025-10-16T17:49:55.960864] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-16T17:49:55.961242] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BWA took 42.9s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-16T17:49:56.131290] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:49:56.139171] [DEBUG] [LOCAL ] BWNB: Loaded 4206 existing records from primary storage. [2025-10-16T17:49:56.139389] [INFO ] [MAIN ] BWNB: Loaded 4206 existing records. [2025-10-16T17:49:56.316175] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:49:56.316411] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-16T17:49:56.316457] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-16T17:49:56.316613] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-16T17:49:56.316705] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-16T17:49:56.664572] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:49:56.742774] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-16T17:49:57.315061] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:49:57.353325] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T17:49:57.542803] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-16T17:49:58.342827] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-16T17:49:59.147055] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-16T17:49:59.148636] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T17:49:59.158067] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T17:49:59.942796] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-16T17:50:00.043130] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T17:50:00.382059] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T17:50:00.742806] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-16T17:50:01.542813] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-16T17:50:01.684476] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T17:50:02.342902] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-16T17:50:02.996406] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T17:50:03.142832] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-16T17:50:03.211345] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T17:50:03.942815] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-16T17:50:04.742842] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-16T17:50:04.751962] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T17:50:04.881087] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T17:50:05.200071] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T17:50:05.542823] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-16T17:50:06.342794] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-16T17:50:06.423412] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T17:50:07.142837] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-16T17:50:07.185013] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T17:50:07.896796] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T17:50:07.942804] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-16T17:50:08.555700] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T17:50:08.742827] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-16T17:50:09.542830] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-16T17:50:10.034172] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T17:50:10.233631] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T17:50:10.342820] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-16T17:50:10.902579] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T17:50:11.142821] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-16T17:50:11.881080] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T17:50:11.942814] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-16T17:50:12.481215] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T17:50:12.742890] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-16T17:50:13.542832] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-16T17:50:13.572368] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:50:13.573716] [INFO ] [REMOTE ] BWMX: Full fetch complete (10045 records). [2025-10-16T17:50:13.573785] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-16T17:50:13.927801] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-16T17:50:13.927879] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-16T17:50:13.928080] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-16T17:50:13.928118] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-16T17:50:13.928528] [DEBUG] [LOCAL ] BWMX: Trimmed 10045 records to 7843 (keeping 200 days of data) [2025-10-16T17:50:13.974058] [DEBUG] [LOCAL ] BWMX: Primary data saved (7843 records). [2025-10-16T17:50:13.974165] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-16T17:50:13.974240] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWMX took 27.0s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-16T17:50:14.045073] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T17:50:14.155331] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:14.162927] [DEBUG] [LOCAL ] BWSN: Loaded 5154 existing records from primary storage. [2025-10-16T17:50:14.163124] [INFO ] [MAIN ] BWSN: Loaded 5154 existing records. [2025-10-16T17:50:14.336053] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:14.336280] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-16T17:50:14.336330] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-16T17:50:14.336477] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-16T17:50:14.336516] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-16T17:50:14.347895] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-16T17:50:14.692716] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:14.883407] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:50:15.142812] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-16T17:50:15.942818] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-16T17:50:16.623437] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T17:50:16.656102] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:50:16.742883] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-16T17:50:17.542849] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-16T17:50:17.581721] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:50:18.114696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:50:18.342858] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-16T17:50:18.902335] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T17:50:18.903816] [INFO ] [REMOTE ] BWNB: Full fetch complete (5614 records). [2025-10-16T17:50:18.903907] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-16T17:50:19.152351] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-16T17:50:19.281344] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-16T17:50:19.281449] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-16T17:50:19.281697] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-16T17:50:19.281759] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-16T17:50:19.282191] [DEBUG] [LOCAL ] BWNB: Trimmed 5614 records to 4220 (keeping 200 days of data) [2025-10-16T17:50:19.310573] [DEBUG] [LOCAL ] BWNB: Primary data saved (4220 records). [2025-10-16T17:50:19.310754] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-16T17:50:19.310847] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWNB took 23.3s. Estimated remaining: 4h 35m 4s. Rate: 7.3 symbols/min [2025-10-16T17:50:19.508903] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:19.552962] [DEBUG] [LOCAL ] BWXT: Loaded 47121 existing records from primary storage. [2025-10-16T17:50:19.553276] [INFO ] [MAIN ] BWXT: Loaded 47121 existing records. [2025-10-16T17:50:19.735572] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:19.735807] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-16T17:50:19.735856] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-16T17:50:19.736179] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-16T17:50:19.736218] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-16T17:50:19.947897] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-16T17:50:20.132312] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:20.633877] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:50:20.741047] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T17:50:20.743558] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-16T17:50:21.177185] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T17:50:21.542820] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-16T17:50:22.342832] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-16T17:50:22.868804] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T17:50:23.142816] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-16T17:50:23.942806] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-16T17:50:24.066286] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T17:50:24.161241] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:50:24.271077] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T17:50:24.742818] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-16T17:50:25.434353] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T17:50:25.435971] [INFO ] [REMOTE ] BWG: Full fetch complete (17772 records). [2025-10-16T17:50:25.436040] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-16T17:50:25.547874] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-16T17:50:25.815965] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-16T17:50:25.816046] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-16T17:50:25.816461] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-16T17:50:25.816502] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-16T17:50:25.817039] [DEBUG] [LOCAL ] BWG: Trimmed 17772 records to 12662 (keeping 200 days of data) [2025-10-16T17:50:25.892897] [DEBUG] [LOCAL ] BWG: Primary data saved (12662 records). [2025-10-16T17:50:25.893033] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-16T17:50:25.893109] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWG took 41.3s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-16T17:50:26.064758] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:26.124715] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-16T17:50:26.125041] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-16T17:50:26.313389] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:26.313691] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-16T17:50:26.313750] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-16T17:50:26.314107] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-16T17:50:26.314147] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-16T17:50:26.347893] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-16T17:50:26.694613] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:27.109555] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T17:50:27.114267] [INFO ] [REMOTE ] BWLP: Full fetch complete (48043 records). [2025-10-16T17:50:27.114356] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-16T17:50:27.147393] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-16T17:50:27.207815] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T17:50:27.510802] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-16T17:50:27.510902] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-16T17:50:27.511613] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-16T17:50:27.511703] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-16T17:50:27.512817] [DEBUG] [LOCAL ] BWLP: Trimmed 48043 records to 32486 (keeping 200 days of data) [2025-10-16T17:50:27.703510] [DEBUG] [LOCAL ] BWLP: Primary data saved (32486 records). [2025-10-16T17:50:27.703668] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-16T17:50:27.703771] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWLP took 42.8s. Estimated remaining: 4h 34m 3s. Rate: 7.3 symbols/min [2025-10-16T17:50:27.868608] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:27.883129] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-10-16T17:50:27.883354] [INFO ] [MAIN ] BXC: Loaded 13669 existing records. [2025-10-16T17:50:27.947894] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-16T17:50:28.059765] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:28.059994] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-16T17:50:28.060041] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-16T17:50:28.060214] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-16T17:50:28.060252] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-16T17:50:28.410434] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:28.742852] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-16T17:50:29.100308] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:50:29.184083] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T17:50:29.542791] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-16T17:50:29.797798] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T17:50:30.342830] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-16T17:50:31.142808] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-16T17:50:31.369216] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T17:50:31.414130] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:50:31.942857] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-16T17:50:32.742813] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-16T17:50:32.836372] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T17:50:33.312457] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T17:50:33.525685] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:50:33.542768] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-16T17:50:33.847888] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T17:50:34.342818] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-16T17:50:35.142832] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-16T17:50:35.942883] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-16T17:50:36.003243] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T17:50:36.393603] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-16T17:50:36.742848] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-16T17:50:37.429303] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-16T17:50:37.542794] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-16T17:50:37.737862] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T17:50:38.155588] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T17:50:38.342802] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-16T17:50:38.869335] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T17:50:39.142815] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-16T17:50:39.942814] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-16T17:50:40.742826] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-16T17:50:40.831824] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T17:50:41.193986] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:50:41.542825] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-16T17:50:41.901245] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:50:42.342876] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-16T17:50:42.923186] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:50:42.924389] [INFO ] [REMOTE ] BWSN: Full fetch complete (6368 records). [2025-10-16T17:50:42.924476] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-16T17:50:43.148438] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-16T17:50:43.295405] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-16T17:50:43.310130] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-16T17:50:43.319829] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-16T17:50:43.319915] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-16T17:50:43.322228] [DEBUG] [LOCAL ] BWSN: Trimmed 6368 records to 5203 (keeping 200 days of data) [2025-10-16T17:50:43.322100] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T17:50:43.363991] [DEBUG] [LOCAL ] BWSN: Primary data saved (5203 records). [2025-10-16T17:50:43.364082] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-16T17:50:43.364159] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 29.4s. Estimated remaining: 4h 34m 35s. Rate: 7.3 symbols/min [2025-10-16T17:50:43.530306] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:43.575158] [DEBUG] [LOCAL ] BXMT: Loaded 47317 existing records from primary storage. [2025-10-16T17:50:43.575484] [INFO ] [MAIN ] BXMT: Loaded 47317 existing records. [2025-10-16T17:50:43.749189] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:43.749398] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-16T17:50:43.749444] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-16T17:50:43.749749] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-16T17:50:43.749807] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-16T17:50:43.948895] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-16T17:50:44.106215] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:50:44.742847] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-16T17:50:44.933435] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:50:45.170974] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T17:50:45.542820] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-16T17:50:46.207138] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:50:46.240471] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T17:50:46.342775] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-16T17:50:47.142813] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-16T17:50:47.942831] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-16T17:50:47.994917] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T17:50:48.627667] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:50:48.742836] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-16T17:50:49.542795] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-16T17:50:49.775518] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T17:50:50.343232] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-16T17:50:50.347543] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-16T17:50:50.589892] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T17:50:51.142819] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-16T17:50:51.919322] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T17:50:51.942786] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-16T17:50:52.742798] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-16T17:50:53.015787] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T17:50:53.542777] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-16T17:50:53.574144] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T17:50:53.711682] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T17:50:54.342808] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-16T17:50:55.142797] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-16T17:50:55.352374] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T17:50:55.738484] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:50:55.942811] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-16T17:50:56.742805] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-16T17:50:56.835823] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T17:50:57.003810] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T17:50:57.542869] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-16T17:50:58.344995] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-16T17:50:58.348030] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T17:50:58.890224] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:50:58.896718] [INFO ] [REMOTE ] BWXT: Full fetch complete (67926 records). [2025-10-16T17:50:58.896867] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-16T17:50:59.148141] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-16T17:50:59.286266] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-16T17:50:59.286350] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-16T17:50:59.287156] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-16T17:50:59.287219] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-16T17:50:59.288547] [DEBUG] [LOCAL ] BWXT: Trimmed 67926 records to 47497 (keeping 200 days of data) [2025-10-16T17:50:59.577286] [DEBUG] [LOCAL ] BWXT: Primary data saved (47497 records). [2025-10-16T17:50:59.577425] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-16T17:50:59.577913] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWXT took 40.3s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-16T17:50:59.744355] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:50:59.766059] [DEBUG] [LOCAL ] BXMX: Loaded 19492 existing records from primary storage. [2025-10-16T17:50:59.766375] [INFO ] [MAIN ] BXMX: Loaded 19492 existing records. [2025-10-16T17:50:59.945916] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:50:59.946008] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-16T17:50:59.946459] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-16T17:50:59.947292] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-16T17:50:59.947578] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-16T17:50:59.947636] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-16T17:51:00.299137] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:00.335699] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T17:51:00.340371] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T17:51:00.349333] [INFO ] [REMOTE ] BXC: Full fetch complete (18227 records). [2025-10-16T17:51:00.349601] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-16T17:51:00.714956] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-16T17:51:00.715042] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-16T17:51:00.715419] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-16T17:51:00.715458] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-16T17:51:00.716081] [DEBUG] [LOCAL ] BXC: Trimmed 18227 records to 13714 (keeping 200 days of data) [2025-10-16T17:51:00.748587] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-16T17:51:00.795196] [DEBUG] [LOCAL ] BXC: Primary data saved (13714 records). [2025-10-16T17:51:00.795303] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-16T17:51:00.795376] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 33.1s. Estimated remaining: 4h 34m 24s. Rate: 7.3 symbols/min [2025-10-16T17:51:00.965055] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:01.010801] [DEBUG] [LOCAL ] BXP: Loaded 49889 existing records from primary storage. [2025-10-16T17:51:01.011154] [INFO ] [MAIN ] BXP: Loaded 49889 existing records. [2025-10-16T17:51:01.195817] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:01.195980] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-16T17:51:01.196028] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-16T17:51:01.196708] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-16T17:51:01.196766] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-16T17:51:01.547125] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-16T17:51:01.553347] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:01.963829] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T17:51:02.342827] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-16T17:51:02.820060] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T17:51:02.873939] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:51:03.142796] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-16T17:51:03.945442] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-16T17:51:03.948466] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T17:51:04.742805] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-16T17:51:04.864016] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T17:51:04.912528] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T17:51:05.542808] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-16T17:51:06.342819] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-16T17:51:06.645458] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T17:51:06.652370] [INFO ] [REMOTE ] BX: Full fetch complete (77579 records). [2025-10-16T17:51:06.652512] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-16T17:51:07.046152] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-16T17:51:07.046286] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-16T17:51:07.047593] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-16T17:51:07.047880] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-16T17:51:07.050095] [DEBUG] [LOCAL ] BX: Trimmed 77579 records to 53873 (keeping 200 days of data) [2025-10-16T17:51:07.159106] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-16T17:51:07.205859] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T17:51:07.432847] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T17:51:07.453851] [DEBUG] [LOCAL ] BX: Primary data saved (53873 records). [2025-10-16T17:51:07.453951] [INFO ] [MAIN ] BX: Full history saved. [2025-10-16T17:51:07.454829] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 41.6s. Estimated remaining: 4h 34m 7s. Rate: 7.3 symbols/min [2025-10-16T17:51:07.619908] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:07.712606] [DEBUG] [LOCAL ] BXSL: Loaded 48119 existing records from primary storage. [2025-10-16T17:51:07.713047] [INFO ] [MAIN ] BXSL: Loaded 48119 existing records. [2025-10-16T17:51:07.886231] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:07.886439] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-16T17:51:07.886494] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-16T17:51:07.886835] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-16T17:51:07.886891] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-16T17:51:07.949709] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-16T17:51:08.244386] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:08.742945] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-16T17:51:08.747149] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T17:51:09.544928] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:51:09.545084] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-16T17:51:10.342804] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-16T17:51:10.552367] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T17:51:10.696095] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:51:11.142836] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-16T17:51:11.948259] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-16T17:51:11.962687] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T17:51:12.261021] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:51:12.742816] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-16T17:51:13.542813] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-16T17:51:13.605437] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:51:13.868807] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:51:14.342834] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-16T17:51:14.714092] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T17:51:15.142823] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-16T17:51:15.942803] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-16T17:51:16.166073] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T17:51:16.742771] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-16T17:51:16.908220] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T17:51:16.948334] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T17:51:17.542789] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-16T17:51:18.342772] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-16T17:51:18.577978] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:51:18.584540] [INFO ] [REMOTE ] BXMT: Full fetch complete (69958 records). [2025-10-16T17:51:18.584702] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-16T17:51:18.990919] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-16T17:51:18.991037] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-16T17:51:18.991952] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-16T17:51:18.992167] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-16T17:51:18.994118] [DEBUG] [LOCAL ] BXMT: Trimmed 69958 records to 47685 (keeping 200 days of data) [2025-10-16T17:51:19.020526] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T17:51:19.149680] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-16T17:51:19.314741] [DEBUG] [LOCAL ] BXMT: Primary data saved (47685 records). [2025-10-16T17:51:19.314892] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-16T17:51:19.315491] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXMT took 36.0s. Estimated remaining: 4h 34m 18s. Rate: 7.3 symbols/min [2025-10-16T17:51:19.485124] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:19.498742] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:51:19.524404] [DEBUG] [LOCAL ] BY: Loaded 21823 existing records from primary storage. [2025-10-16T17:51:19.524735] [INFO ] [MAIN ] BY: Loaded 21823 existing records. [2025-10-16T17:51:19.697461] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:19.697708] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-16T17:51:19.697764] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-16T17:51:19.697975] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-16T17:51:19.698013] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-16T17:51:19.947953] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-16T17:51:20.045351] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:20.742812] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-16T17:51:20.871002] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T17:51:21.542867] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-16T17:51:21.636451] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T17:51:21.869947] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T17:51:22.150299] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T17:51:22.342809] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-16T17:51:23.142802] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-16T17:51:23.255505] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T17:51:23.942848] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-16T17:51:24.147571] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T17:51:24.742773] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-16T17:51:24.816602] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T17:51:24.819463] [INFO ] [REMOTE ] BXMX: Full fetch complete (28804 records). [2025-10-16T17:51:24.819540] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-16T17:51:25.182351] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-16T17:51:25.182429] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-16T17:51:25.182909] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-16T17:51:25.182970] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-16T17:51:25.183718] [DEBUG] [LOCAL ] BXMX: Trimmed 28804 records to 19610 (keeping 200 days of data) [2025-10-16T17:51:25.297902] [DEBUG] [LOCAL ] BXMX: Primary data saved (19610 records). [2025-10-16T17:51:25.298037] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-16T17:51:25.298112] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 25.7s. Estimated remaining: 4h 33m 58s. Rate: 7.3 symbols/min [2025-10-16T17:51:25.475773] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:25.515257] [DEBUG] [LOCAL ] BYD: Loaded 44894 existing records from primary storage. [2025-10-16T17:51:25.515533] [INFO ] [MAIN ] BYD: Loaded 44894 existing records. [2025-10-16T17:51:25.548037] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-16T17:51:25.693449] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:25.693727] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-16T17:51:25.693783] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-16T17:51:25.694116] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-16T17:51:25.694172] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-16T17:51:26.068517] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:26.284198] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:51:26.342769] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-16T17:51:26.421186] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:51:27.142847] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-16T17:51:27.781087] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:51:27.942826] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-16T17:51:28.721587] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T17:51:28.742772] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-16T17:51:29.542789] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-16T17:51:29.691820] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T17:51:30.152371] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T17:51:30.342833] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-16T17:51:31.018262] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T17:51:31.142830] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-16T17:51:31.651076] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:51:31.942814] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-16T17:51:32.510561] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T17:51:32.742788] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-16T17:51:33.030634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T17:51:33.542831] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-16T17:51:34.230531] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T17:51:34.342794] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-16T17:51:34.646462] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:51:35.142821] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-16T17:51:35.947994] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-16T17:51:35.951866] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T17:51:36.449231] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:51:36.742854] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-16T17:51:37.485491] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T17:51:37.542775] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-16T17:51:37.715718] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T17:51:38.342880] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-16T17:51:39.130368] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T17:51:39.142771] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-16T17:51:39.843678] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T17:51:39.942787] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-16T17:51:40.742795] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-16T17:51:41.052618] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:51:41.059548] [INFO ] [REMOTE ] BXSL: Full fetch complete (69958 records). [2025-10-16T17:51:41.059710] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-16T17:51:41.255497] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:51:41.474529] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-16T17:51:41.474613] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-16T17:51:41.475494] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-16T17:51:41.475561] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-16T17:51:41.476913] [DEBUG] [LOCAL ] BXSL: Trimmed 69958 records to 48504 (keeping 200 days of data) [2025-10-16T17:51:41.567007] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-16T17:51:41.770951] [DEBUG] [LOCAL ] BXSL: Primary data saved (48504 records). [2025-10-16T17:51:41.771089] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-16T17:51:41.771681] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXSL took 34.3s. Estimated remaining: 4h 34m 34s. Rate: 7.3 symbols/min [2025-10-16T17:51:41.935585] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:41.950410] [DEBUG] [LOCAL ] BYM: Loaded 11722 existing records from primary storage. [2025-10-16T17:51:41.950676] [INFO ] [MAIN ] BYM: Loaded 11722 existing records. [2025-10-16T17:51:42.127279] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:42.127548] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-16T17:51:42.127599] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-16T17:51:42.127795] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-16T17:51:42.127861] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-16T17:51:42.351299] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-16T17:51:42.507525] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:42.520002] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:51:42.726805] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T17:51:43.142826] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-16T17:51:43.942869] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-16T17:51:43.979543] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:51:44.037774] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T17:51:44.742820] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-16T17:51:45.542870] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-16T17:51:45.668427] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:51:45.733328] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T17:51:46.342866] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-16T17:51:46.899357] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T17:51:47.142831] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-16T17:51:47.942784] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-16T17:51:48.179472] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T17:51:48.186043] [INFO ] [REMOTE ] BXP: Full fetch complete (72200 records). [2025-10-16T17:51:48.186151] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-16T17:51:48.585293] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-16T17:51:48.585414] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-16T17:51:48.586308] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-16T17:51:48.586371] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-16T17:51:48.587671] [DEBUG] [LOCAL ] BXP: Trimmed 72200 records to 50256 (keeping 200 days of data) [2025-10-16T17:51:48.721846] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T17:51:48.753691] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T17:51:48.750443] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-16T17:51:48.960587] [DEBUG] [LOCAL ] BXP: Primary data saved (50256 records). [2025-10-16T17:51:48.960776] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-16T17:51:48.960896] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXP took 48.2s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-16T17:51:49.129415] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:49.161757] [DEBUG] [LOCAL ] BZH: Loaded 32426 existing records from primary storage. [2025-10-16T17:51:49.162071] [INFO ] [MAIN ] BZH: Loaded 32426 existing records. [2025-10-16T17:51:49.335206] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:49.335445] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-16T17:51:49.335492] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-16T17:51:49.335754] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-16T17:51:49.335811] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-16T17:51:49.546489] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-16T17:51:49.733248] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:49.741206] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T17:51:49.744376] [INFO ] [REMOTE ] BY: Full fetch complete (29734 records). [2025-10-16T17:51:49.744449] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-16T17:51:50.102579] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-16T17:51:50.102679] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-16T17:51:50.103121] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-16T17:51:50.103161] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-16T17:51:50.103854] [DEBUG] [LOCAL ] BY: Trimmed 29734 records to 21987 (keeping 200 days of data) [2025-10-16T17:51:50.233969] [DEBUG] [LOCAL ] BY: Primary data saved (21987 records). [2025-10-16T17:51:50.234093] [INFO ] [MAIN ] BY: Full history saved. [2025-10-16T17:51:50.234166] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 30.9s. Estimated remaining: 4h 33m 34s. Rate: 7.3 symbols/min [2025-10-16T17:51:50.348017] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-16T17:51:50.410183] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:50.432791] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:51:50.473530] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-16T17:51:50.473879] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-16T17:51:50.654300] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:50.654617] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-16T17:51:50.654732] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-16T17:51:50.655342] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-16T17:51:50.655423] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-16T17:51:51.012034] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:51.142777] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-16T17:51:51.776234] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T17:51:51.942825] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-16T17:51:52.742836] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-16T17:51:53.162832] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T17:51:53.508604] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T17:51:53.542775] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-16T17:51:53.630067] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T17:51:54.342809] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-16T17:51:55.082418] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T17:51:55.088144] [INFO ] [REMOTE ] BYD: Full fetch complete (65338 records). [2025-10-16T17:51:55.088268] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-16T17:51:55.150142] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-16T17:51:55.494467] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-16T17:51:55.494773] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-16T17:51:55.502720] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-16T17:51:55.515361] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-16T17:51:55.517434] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:51:55.526513] [DEBUG] [LOCAL ] BYD: Trimmed 65338 records to 45233 (keeping 200 days of data) [2025-10-16T17:51:55.801924] [DEBUG] [LOCAL ] BYD: Primary data saved (45233 records). [2025-10-16T17:51:55.802048] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-16T17:51:55.802544] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BYD took 30.5s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-16T17:51:55.947829] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-16T17:51:55.979435] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:51:56.002910] [DEBUG] [LOCAL ] CAAP: Loaded 19831 existing records from primary storage. [2025-10-16T17:51:56.003159] [INFO ] [MAIN ] CAAP: Loaded 19831 existing records. [2025-10-16T17:51:56.116000] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T17:51:56.197342] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:51:56.197556] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-16T17:51:56.197604] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-16T17:51:56.197841] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-16T17:51:56.197896] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-16T17:51:56.548902] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:51:56.742799] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-16T17:51:57.288249] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:51:57.542823] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-16T17:51:57.896382] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T17:51:58.055980] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T17:51:58.342818] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-16T17:51:59.142786] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-16T17:51:59.361167] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T17:51:59.942787] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-16T17:51:59.955205] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T17:52:00.467403] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T17:52:00.742827] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-16T17:52:01.542850] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-16T17:52:01.700897] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T17:52:02.342910] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-16T17:52:02.410601] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T17:52:03.142946] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-16T17:52:03.801606] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:52:03.819145] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T17:52:03.942818] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-16T17:52:04.742810] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-16T17:52:05.389967] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T17:52:05.542813] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-16T17:52:06.342777] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-16T17:52:06.557805] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T17:52:06.859170] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-16T17:52:07.142790] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-16T17:52:07.185907] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T17:52:07.942784] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-16T17:52:08.094837] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T17:52:08.477510] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T17:52:08.742821] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-16T17:52:09.542816] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-16T17:52:09.738172] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T17:52:10.342873] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-16T17:52:11.142869] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-16T17:52:11.408173] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T17:52:11.466944] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T17:52:11.942784] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-16T17:52:11.982585] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:52:11.984399] [INFO ] [REMOTE ] BYM: Full fetch complete (17475 records). [2025-10-16T17:52:11.984468] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-16T17:52:12.340529] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-16T17:52:12.340611] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-16T17:52:12.341062] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-16T17:52:12.341126] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-16T17:52:12.341634] [DEBUG] [LOCAL ] BYM: Trimmed 17475 records to 11798 (keeping 200 days of data) [2025-10-16T17:52:12.411359] [DEBUG] [LOCAL ] BYM: Primary data saved (11798 records). [2025-10-16T17:52:12.411511] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-16T17:52:12.411603] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 30.6s. Estimated remaining: 4h 33m 48s. Rate: 7.3 symbols/min [2025-10-16T17:52:12.582679] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:12.582884] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-10-16T17:52:12.582926] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-10-16T17:52:12.583065] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-16T17:52:12.583113] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-16T17:52:12.583157] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-10-16T17:52:12.583189] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-16T17:52:12.745884] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-16T17:52:12.935707] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:13.542813] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-16T17:52:14.066472] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T17:52:14.098537] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T17:52:14.112073] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T17:52:14.342828] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-16T17:52:15.142817] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-16T17:52:15.885860] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T17:52:15.942802] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-16T17:52:16.742793] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-16T17:52:16.851166] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-16T17:52:17.061054] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T17:52:17.542786] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-16T17:52:17.645021] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T17:52:18.342834] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-16T17:52:18.811406] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T17:52:19.091374] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T17:52:19.142778] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-16T17:52:19.942819] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-16T17:52:20.428550] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T17:52:20.432798] [INFO ] [REMOTE ] BZH: Full fetch complete (47238 records). [2025-10-16T17:52:20.432893] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-16T17:52:20.748018] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-16T17:52:20.812007] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-16T17:52:20.812101] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-16T17:52:20.812740] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-16T17:52:20.812803] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-16T17:52:20.813957] [DEBUG] [LOCAL ] BZH: Trimmed 47238 records to 32633 (keeping 200 days of data) [2025-10-16T17:52:21.009673] [DEBUG] [LOCAL ] BZH: Primary data saved (32633 records). [2025-10-16T17:52:21.009810] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-16T17:52:21.009890] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BZH took 32.0s. Estimated remaining: 4h 33m 41s. Rate: 7.3 symbols/min [2025-10-16T17:52:21.174213] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:21.196260] [DEBUG] [LOCAL ] CACI: Loaded 23152 existing records from primary storage. [2025-10-16T17:52:21.196524] [INFO ] [MAIN ] CACI: Loaded 23152 existing records. [2025-10-16T17:52:21.367619] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:21.367824] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-16T17:52:21.367873] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-16T17:52:21.368059] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-16T17:52:21.368100] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-16T17:52:21.546156] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-16T17:52:21.735233] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:21.836487] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T17:52:21.838043] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T17:52:22.342794] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-16T17:52:22.685377] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T17:52:23.142814] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-16T17:52:23.942802] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-16T17:52:24.367948] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T17:52:24.395779] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T17:52:24.742809] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-16T17:52:25.085200] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T17:52:25.542882] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-16T17:52:25.829409] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T17:52:26.342840] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-16T17:52:26.526509] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T17:52:26.529764] [INFO ] [REMOTE ] CAAP: Full fetch complete (27912 records). [2025-10-16T17:52:26.529838] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-16T17:52:26.909728] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-16T17:52:26.909805] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-16T17:52:26.910302] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-16T17:52:26.910342] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-16T17:52:26.911085] [DEBUG] [LOCAL ] CAAP: Trimmed 27912 records to 20020 (keeping 200 days of data) [2025-10-16T17:52:27.027615] [DEBUG] [LOCAL ] CAAP: Primary data saved (20020 records). [2025-10-16T17:52:27.027759] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-16T17:52:27.027838] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 31.2s. Estimated remaining: 4h 33m 21s. Rate: 7.3 symbols/min [2025-10-16T17:52:27.147888] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-16T17:52:27.198946] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:27.241867] [DEBUG] [LOCAL ] CADE: Loaded 49483 existing records from primary storage. [2025-10-16T17:52:27.242196] [INFO ] [MAIN ] CADE: Loaded 49483 existing records. [2025-10-16T17:52:27.420604] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:27.420856] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-16T17:52:27.420914] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-16T17:52:27.421114] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-16T17:52:27.421151] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-16T17:52:27.766925] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:27.942779] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-16T17:52:28.317113] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T17:52:28.742785] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-16T17:52:28.883574] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-16T17:52:29.287236] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T17:52:29.310670] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T17:52:29.542838] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-16T17:52:30.342807] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-16T17:52:31.094972] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T17:52:31.142808] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-16T17:52:31.942798] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-16T17:52:32.293099] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T17:52:32.428999] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T17:52:32.742823] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-16T17:52:33.093602] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T17:52:33.542882] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-16T17:52:34.342813] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-16T17:52:34.875082] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T17:52:34.997981] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:52:35.142829] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-16T17:52:35.792721] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T17:52:35.942773] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-16T17:52:36.742890] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-16T17:52:37.282809] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T17:52:37.313064] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T17:52:37.319880] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-16T17:52:37.320009] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-16T17:52:37.547990] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-16T17:52:37.720431] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-16T17:52:37.720610] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-16T17:52:37.721584] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-16T17:52:37.721748] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-16T17:52:37.728524] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 54130 (keeping 200 days of data) [2025-10-16T17:52:37.736916] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:52:38.072313] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-16T17:52:38.072482] [INFO ] [MAIN ] C: Full history saved. [2025-10-16T17:52:38.072570] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 47.8s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-16T17:52:38.238566] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:38.274865] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-16T17:52:38.275139] [INFO ] [MAIN ] CAE: Loaded 39206 existing records. [2025-10-16T17:52:38.352050] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-16T17:52:38.459236] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:38.459467] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-16T17:52:38.459549] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-16T17:52:38.459856] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-16T17:52:38.459922] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-16T17:52:38.817361] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:39.142813] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-16T17:52:39.272050] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T17:52:39.335615] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T17:52:39.942865] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-16T17:52:40.632021] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T17:52:40.742784] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-16T17:52:40.973368] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T17:52:41.542820] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-16T17:52:42.209608] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T17:52:42.342789] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-16T17:52:42.664289] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T17:52:43.142820] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-16T17:52:43.571408] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T17:52:43.942779] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-16T17:52:44.250634] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:52:44.742864] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-16T17:52:45.471584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T17:52:45.495845] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T17:52:45.542765] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-16T17:52:46.342792] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-16T17:52:46.565571] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T17:52:47.142826] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-16T17:52:47.470984] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:52:47.942846] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-16T17:52:48.696060] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T17:52:48.742774] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-16T17:52:48.848919] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T17:52:49.542837] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-16T17:52:49.584357] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T17:52:49.586172] [INFO ] [REMOTE ] CABO: Full fetch complete (23180 records). [2025-10-16T17:52:49.586240] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-16T17:52:49.949808] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-16T17:52:49.949888] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-16T17:52:49.950345] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-16T17:52:49.950407] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-16T17:52:49.951259] [DEBUG] [LOCAL ] CABO: Trimmed 23180 records to 16869 (keeping 200 days of data) [2025-10-16T17:52:50.047915] [DEBUG] [LOCAL ] CABO: Primary data saved (16869 records). [2025-10-16T17:52:50.048063] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-16T17:52:50.048146] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. CABO took 37.6s. Estimated remaining: 4h 33m 39s. Rate: 7.3 symbols/min [2025-10-16T17:52:50.213930] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:50.219877] [DEBUG] [LOCAL ] CAF: Loaded 3465 existing records from primary storage. [2025-10-16T17:52:50.220065] [INFO ] [MAIN ] CAF: Loaded 3465 existing records. [2025-10-16T17:52:50.357445] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-16T17:52:50.397915] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:50.398103] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-16T17:52:50.398156] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-16T17:52:50.398295] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-16T17:52:50.398332] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-16T17:52:50.763579] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:50.776057] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:52:51.142835] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-16T17:52:51.942795] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-16T17:52:51.977675] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T17:52:52.006924] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T17:52:52.662899] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T17:52:52.742821] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-16T17:52:53.542823] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-16T17:52:53.800671] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:52:53.803024] [INFO ] [REMOTE ] CACI: Full fetch complete (38136 records). [2025-10-16T17:52:53.803105] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-16T17:52:53.803578] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:52:53.803689] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:52:53.803740] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:52:53.803806] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-16T17:52:53.803870] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-16T17:52:53.803910] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-10-16T17:52:53.804098] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-10-16T17:52:53.804188] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CACI took 32.8s. Estimated remaining: 4h 33m 7s. Rate: 7.3 symbols/min [2025-10-16T17:52:53.991070] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:54.058205] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-16T17:52:54.058721] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-16T17:52:54.327110] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:54.327409] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-16T17:52:54.327484] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-16T17:52:54.328128] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-16T17:52:54.328198] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-16T17:52:54.348046] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-16T17:52:54.869105] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:55.131301] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T17:52:55.138315] [INFO ] [REMOTE ] CADE: Full fetch complete (70539 records). [2025-10-16T17:52:55.138490] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-16T17:52:55.151133] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-16T17:52:55.556361] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-16T17:52:55.556441] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-16T17:52:55.557261] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-16T17:52:55.557323] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-16T17:52:55.558613] [DEBUG] [LOCAL ] CADE: Trimmed 70539 records to 49873 (keeping 200 days of data) [2025-10-16T17:52:55.628322] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T17:52:55.880052] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:52:55.900594] [DEBUG] [LOCAL ] CADE: Primary data saved (49873 records). [2025-10-16T17:52:55.900763] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-16T17:52:55.901232] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CADE took 28.9s. Estimated remaining: 4h 32m 27s. Rate: 7.3 symbols/min [2025-10-16T17:52:55.948014] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-16T17:52:56.073554] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:52:56.127907] [DEBUG] [LOCAL ] CAH: Loaded 51461 existing records from primary storage. [2025-10-16T17:52:56.128205] [INFO ] [MAIN ] CAH: Loaded 51461 existing records. [2025-10-16T17:52:56.301709] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:52:56.301942] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-16T17:52:56.301989] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-16T17:52:56.302349] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-16T17:52:56.302388] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-16T17:52:56.417451] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T17:52:56.661965] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:52:56.742792] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-16T17:52:57.542865] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-16T17:52:58.342805] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-16T17:52:58.416612] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:52:59.142797] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-16T17:52:59.234206] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T17:52:59.524927] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T17:52:59.548441] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T17:52:59.942816] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-16T17:53:00.742798] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-16T17:53:01.065391] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T17:53:01.542825] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-16T17:53:02.342848] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-16T17:53:02.514466] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T17:53:03.012384] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-16T17:53:03.141258] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T17:53:03.150670] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-16T17:53:03.942810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-16T17:53:04.512498] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T17:53:04.740476] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T17:53:04.748465] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-16T17:53:05.232606] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T17:53:05.542810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-16T17:53:06.002229] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T17:53:06.342787] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-16T17:53:06.731553] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-16T17:53:07.142810] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-16T17:53:07.942848] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-16T17:53:08.512885] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T17:53:08.742817] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-16T17:53:08.801431] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T17:53:09.542804] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-16T17:53:10.342846] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-16T17:53:10.458781] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T17:53:11.112772] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T17:53:11.142796] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-16T17:53:11.524030] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T17:53:11.942814] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-16T17:53:12.742820] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-16T17:53:12.908486] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T17:53:13.320522] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T17:53:13.322089] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T17:53:13.323760] [INFO ] [REMOTE ] CAF: Full fetch complete (5547 records). [2025-10-16T17:53:13.332709] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-16T17:53:13.547951] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-16T17:53:13.734339] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-16T17:53:13.734426] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-16T17:53:13.734600] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-16T17:53:13.734661] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-16T17:53:13.735036] [DEBUG] [LOCAL ] CAF: Trimmed 5547 records to 3501 (keeping 200 days of data) [2025-10-16T17:53:13.757206] [DEBUG] [LOCAL ] CAF: Primary data saved (3501 records). [2025-10-16T17:53:13.757359] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-16T17:53:13.757447] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAF took 23.7s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-16T17:53:13.922703] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:13.922842] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-10-16T17:53:13.922899] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-10-16T17:53:13.923003] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-16T17:53:13.923046] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-16T17:53:13.923087] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-16T17:53:13.923120] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-16T17:53:14.268066] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:14.342781] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-16T17:53:15.142798] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-16T17:53:15.256093] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T17:53:15.794006] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:53:15.942825] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-16T17:53:16.466843] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T17:53:16.742835] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-16T17:53:17.283162] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:53:17.543170] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-16T17:53:18.245474] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T17:53:18.342779] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-16T17:53:19.148748] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-16T17:53:19.154286] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T17:53:19.877835] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T17:53:19.942827] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-16T17:53:20.559142] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T17:53:20.742887] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-16T17:53:21.256007] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T17:53:21.542812] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-16T17:53:22.208390] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:53:22.342856] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-16T17:53:22.977788] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T17:53:22.983076] [INFO ] [REMOTE ] CAE: Full fetch complete (56475 records). [2025-10-16T17:53:22.983176] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-16T17:53:23.151564] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-16T17:53:23.370206] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-16T17:53:23.370280] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-16T17:53:23.370983] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-16T17:53:23.371045] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-16T17:53:23.372147] [DEBUG] [LOCAL ] CAE: Trimmed 56475 records to 39534 (keeping 200 days of data) [2025-10-16T17:53:23.591235] [DEBUG] [LOCAL ] CAE: Primary data saved (39534 records). [2025-10-16T17:53:23.591362] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-16T17:53:23.592154] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAE took 45.5s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-16T17:53:23.764450] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:23.796536] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T17:53:23.836745] [DEBUG] [LOCAL ] CALX: Loaded 37642 existing records from primary storage. [2025-10-16T17:53:23.837018] [INFO ] [MAIN ] CALX: Loaded 37642 existing records. [2025-10-16T17:53:23.947876] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-16T17:53:24.013406] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:24.013614] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-16T17:53:24.013696] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-16T17:53:24.013957] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-16T17:53:24.013996] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-16T17:53:24.363513] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:24.742779] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-16T17:53:24.811622] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T17:53:25.542842] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-16T17:53:25.620849] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T17:53:26.342869] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-16T17:53:26.470049] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T17:53:27.142854] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-16T17:53:27.180639] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T17:53:27.942823] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-16T17:53:28.140004] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T17:53:28.380802] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T17:53:28.742824] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-16T17:53:29.260702] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T17:53:29.542875] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-16T17:53:30.342802] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-16T17:53:30.413735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T17:53:30.420371] [INFO ] [REMOTE ] CAH: Full fetch complete (74835 records). [2025-10-16T17:53:30.420489] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-16T17:53:30.827275] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-16T17:53:30.827354] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-16T17:53:30.828250] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-16T17:53:30.828311] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-16T17:53:30.829896] [DEBUG] [LOCAL ] CAH: Trimmed 74835 records to 51839 (keeping 200 days of data) [2025-10-16T17:53:31.150573] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-16T17:53:31.174426] [DEBUG] [LOCAL ] CAH: Primary data saved (51839 records). [2025-10-16T17:53:31.178008] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-16T17:53:31.178435] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAH took 35.3s. Estimated remaining: 4h 32m 56s. Rate: 7.3 symbols/min [2025-10-16T17:53:31.194085] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T17:53:31.356639] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:31.383184] [DEBUG] [LOCAL ] CANG: Loaded 26919 existing records from primary storage. [2025-10-16T17:53:31.383428] [INFO ] [MAIN ] CANG: Loaded 26919 existing records. [2025-10-16T17:53:31.553784] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:31.553966] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-16T17:53:31.554013] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-16T17:53:31.554198] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-16T17:53:31.554254] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-16T17:53:31.920291] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:31.942767] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-16T17:53:32.414864] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T17:53:32.517190] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T17:53:32.742825] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-16T17:53:33.270845] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T17:53:33.542848] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-16T17:53:34.089208] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:53:34.342833] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-16T17:53:35.084389] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T17:53:35.142771] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-16T17:53:35.476083] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T17:53:35.942841] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-16T17:53:36.742845] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-16T17:53:37.035012] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T17:53:37.102393] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T17:53:37.542816] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-16T17:53:38.284868] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T17:53:38.342776] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-16T17:53:39.142801] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-16T17:53:39.198114] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T17:53:39.707438] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T17:53:39.942840] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-16T17:53:40.376549] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:53:40.742784] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-16T17:53:41.140815] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T17:53:41.542865] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-16T17:53:42.342854] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-16T17:53:42.410534] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T17:53:42.604204] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T17:53:43.142824] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-16T17:53:43.942836] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-16T17:53:44.194341] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T17:53:44.361728] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T17:53:44.367252] [INFO ] [REMOTE ] CAL: Full fetch complete (61880 records). [2025-10-16T17:53:44.367344] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-16T17:53:44.741101] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-16T17:53:44.741188] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-16T17:53:44.741952] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-16T17:53:44.742021] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-16T17:53:44.742808] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-16T17:53:44.744481] [DEBUG] [LOCAL ] CAL: Trimmed 61880 records to 43267 (keeping 200 days of data) [2025-10-16T17:53:44.868820] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:53:45.029020] [DEBUG] [LOCAL ] CAL: Primary data saved (43267 records). [2025-10-16T17:53:45.029153] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-16T17:53:45.029223] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAL took 31.3s. Estimated remaining: 4h 33m 17s. Rate: 7.2 symbols/min [2025-10-16T17:53:45.198974] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:45.206833] [DEBUG] [LOCAL ] CAPL: Loaded 5642 existing records from primary storage. [2025-10-16T17:53:45.207040] [INFO ] [MAIN ] CAPL: Loaded 5642 existing records. [2025-10-16T17:53:45.379936] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:45.380136] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-16T17:53:45.380183] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-16T17:53:45.380324] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-16T17:53:45.380361] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-16T17:53:45.548102] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-16T17:53:45.727271] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:46.078089] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:53:46.342852] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-16T17:53:47.142782] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-16T17:53:47.300323] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T17:53:47.307236] [INFO ] [REMOTE ] CAG: Full fetch complete (77823 records). [2025-10-16T17:53:47.307354] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-16T17:53:47.474183] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:53:47.733831] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-16T17:53:47.734036] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-16T17:53:47.735035] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-16T17:53:47.735165] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-16T17:53:47.736729] [DEBUG] [LOCAL ] CAG: Trimmed 77823 records to 54055 (keeping 200 days of data) [2025-10-16T17:53:47.924110] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T17:53:47.951483] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-16T17:53:48.068203] [DEBUG] [LOCAL ] CAG: Primary data saved (54055 records). [2025-10-16T17:53:48.068342] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-16T17:53:48.069185] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 54.3s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-16T17:53:48.239720] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:48.291020] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-16T17:53:48.291352] [INFO ] [MAIN ] CARR: Loaded 53602 existing records. [2025-10-16T17:53:48.467937] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:48.468153] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-16T17:53:48.468199] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-16T17:53:48.468371] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-16T17:53:48.468409] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-16T17:53:48.728452] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T17:53:48.747364] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-16T17:53:48.832100] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:49.542862] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-16T17:53:50.204192] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T17:53:50.342795] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-16T17:53:50.907803] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T17:53:51.142786] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-16T17:53:51.170150] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T17:53:51.942821] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-16T17:53:52.742781] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-16T17:53:52.812085] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T17:53:53.161635] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-16T17:53:53.407260] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T17:53:53.542800] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-16T17:53:54.342838] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-16T17:53:55.142855] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-16T17:53:55.282947] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T17:53:55.682890] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T17:53:55.880939] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T17:53:55.942807] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-16T17:53:56.742813] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-16T17:53:57.441502] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:53:57.446963] [INFO ] [REMOTE ] CALX: Full fetch complete (54280 records). [2025-10-16T17:53:57.447108] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-16T17:53:57.546676] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-16T17:53:57.825126] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-16T17:53:57.825225] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-16T17:53:57.825971] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-16T17:53:57.826035] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-16T17:53:57.827116] [DEBUG] [LOCAL ] CALX: Trimmed 54280 records to 37885 (keeping 200 days of data) [2025-10-16T17:53:58.036810] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T17:53:58.074045] [DEBUG] [LOCAL ] CALX: Primary data saved (37885 records). [2025-10-16T17:53:58.074183] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-16T17:53:58.074945] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CALX took 34.5s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-16T17:53:58.248135] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:53:58.287576] [DEBUG] [LOCAL ] CARS: Loaded 39797 existing records from primary storage. [2025-10-16T17:53:58.287884] [INFO ] [MAIN ] CARS: Loaded 39797 existing records. [2025-10-16T17:53:58.349917] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-16T17:53:58.399184] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T17:53:58.482202] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:53:58.482453] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-16T17:53:58.482504] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-16T17:53:58.482790] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-16T17:53:58.482862] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-16T17:53:58.825217] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:53:59.142837] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-16T17:53:59.410886] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T17:53:59.781161] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T17:53:59.942824] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-16T17:54:00.742859] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-16T17:54:01.344159] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T17:54:01.347950] [INFO ] [REMOTE ] CANG: Full fetch complete (39693 records). [2025-10-16T17:54:01.348023] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-16T17:54:01.548723] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-16T17:54:01.714123] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-16T17:54:01.714203] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-16T17:54:01.714795] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-16T17:54:01.714870] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-16T17:54:01.715874] [DEBUG] [LOCAL ] CANG: Trimmed 39693 records to 27143 (keeping 200 days of data) [2025-10-16T17:54:01.882215] [DEBUG] [LOCAL ] CANG: Primary data saved (27143 records). [2025-10-16T17:54:01.882448] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-16T17:54:01.882577] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CANG took 30.7s. Estimated remaining: 4h 32m 11s. Rate: 7.3 symbols/min [2025-10-16T17:54:02.106292] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:02.183595] [DEBUG] [LOCAL ] CAT: Loaded 52958 existing records from primary storage. [2025-10-16T17:54:02.184105] [INFO ] [MAIN ] CAT: Loaded 52958 existing records. [2025-10-16T17:54:02.275184] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T17:54:02.345903] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-16T17:54:02.494142] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:02.495276] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-16T17:54:02.495335] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-16T17:54:02.495568] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-16T17:54:02.495683] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-16T17:54:02.751719] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T17:54:02.966806] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:03.142813] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-16T17:54:03.784933] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T17:54:03.942809] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-16T17:54:04.742841] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-16T17:54:04.947126] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-16T17:54:04.964477] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T17:54:05.542782] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-16T17:54:06.342790] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-16T17:54:06.713511] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:54:06.843627] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T17:54:06.968636] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T17:54:07.142807] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-16T17:54:07.942814] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-16T17:54:08.744018] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T17:54:08.743011] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-16T17:54:09.334123] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T17:54:09.542877] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-16T17:54:09.778383] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T17:54:10.342826] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-16T17:54:10.853209] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:54:11.142820] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-16T17:54:11.942814] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-16T17:54:12.140437] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T17:54:12.247558] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T17:54:12.659532] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T17:54:12.660859] [INFO ] [REMOTE ] CAPL: Full fetch complete (8753 records). [2025-10-16T17:54:12.660931] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-16T17:54:12.747935] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-16T17:54:13.017220] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-16T17:54:13.017356] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-16T17:54:13.017583] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-16T17:54:13.017624] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-16T17:54:13.018152] [DEBUG] [LOCAL ] CAPL: Trimmed 8753 records to 5684 (keeping 200 days of data) [2025-10-16T17:54:13.051754] [DEBUG] [LOCAL ] CAPL: Primary data saved (5684 records). [2025-10-16T17:54:13.051906] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-16T17:54:13.051998] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 28.0s. Estimated remaining: 4h 32m 18s. Rate: 7.3 symbols/min [2025-10-16T17:54:13.220215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:13.229598] [DEBUG] [LOCAL ] CATO: Loaded 6687 existing records from primary storage. [2025-10-16T17:54:13.229810] [INFO ] [MAIN ] CATO: Loaded 6687 existing records. [2025-10-16T17:54:13.400938] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:13.401132] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-16T17:54:13.401179] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-16T17:54:13.401409] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-16T17:54:13.401465] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-16T17:54:13.550598] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-16T17:54:13.754527] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:14.326091] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T17:54:14.342783] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-16T17:54:15.142891] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-16T17:54:15.374229] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T17:54:15.408296] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T17:54:15.942819] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-16T17:54:16.742859] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-16T17:54:17.386876] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-16T17:54:17.433375] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:54:17.542821] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-16T17:54:17.785466] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T17:54:18.259905] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T17:54:18.342843] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-16T17:54:19.142866] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-16T17:54:19.948124] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-16T17:54:19.963421] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T17:54:20.473804] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T17:54:20.742799] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-16T17:54:21.542779] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-16T17:54:21.731117] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T17:54:22.133491] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:54:22.342850] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-16T17:54:22.977154] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T17:54:23.043497] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T17:54:23.142853] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-16T17:54:23.942814] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-16T17:54:24.588569] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T17:54:24.742795] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-16T17:54:25.542876] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-16T17:54:26.090410] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-16T17:54:26.097232] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-16T17:54:26.097397] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-16T17:54:26.356849] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-16T17:54:26.481032] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T17:54:26.536456] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-16T17:54:26.537070] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T17:54:26.539340] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-16T17:54:26.538897] [INFO ] [REMOTE ] CARS: Full fetch complete (56340 records). [2025-10-16T17:54:26.539512] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-16T17:54:26.540822] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-16T17:54:26.541009] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-16T17:54:26.663805] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53992 (keeping 200 days of data) [2025-10-16T17:54:27.079293] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-16T17:54:27.079974] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-16T17:54:27.081259] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-16T17:54:27.081341] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-16T17:54:27.090050] [DEBUG] [LOCAL ] CARS: Trimmed 56340 records to 40101 (keeping 200 days of data) [2025-10-16T17:54:27.151355] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-16T17:54:27.454128] [DEBUG] [LOCAL ] CARS: Primary data saved (40101 records). [2025-10-16T17:54:27.459833] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-16T17:54:27.462482] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CARS took 29.4s. Estimated remaining: 4h 32m 40s. Rate: 7.2 symbols/min [2025-10-16T17:54:27.705092] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:27.717741] [DEBUG] [LOCAL ] CARR: Primary data saved (53992 records). [2025-10-16T17:54:27.717899] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-16T17:54:27.718700] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARR took 39.6s. Estimated remaining: 4h 31m 52s. Rate: 7.3 symbols/min [2025-10-16T17:54:27.816078] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:54:27.923516] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:27.939085] [DEBUG] [LOCAL ] CAVA: Loaded 53567 existing records from primary storage. [2025-10-16T17:54:27.939401] [INFO ] [MAIN ] CAVA: Loaded 53567 existing records. [2025-10-16T17:54:27.950469] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-16T17:54:28.125952] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:28.136614] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-16T17:54:28.136716] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-16T17:54:28.137022] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-16T17:54:28.137080] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-16T17:54:28.289990] [DEBUG] [LOCAL ] CB: Loaded 49940 existing records from primary storage. [2025-10-16T17:54:28.325067] [INFO ] [MAIN ] CB: Loaded 49940 existing records. [2025-10-16T17:54:28.553943] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T17:54:28.691771] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:28.699126] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:28.700179] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-16T17:54:28.700251] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-16T17:54:28.700474] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-16T17:54:28.700609] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-16T17:54:28.747324] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-16T17:54:29.122772] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-16T17:54:29.127296] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:29.542869] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-16T17:54:30.342883] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-16T17:54:30.873349] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T17:54:31.142804] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-16T17:54:31.324385] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:54:31.942847] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-16T17:54:32.086545] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T17:54:32.410291] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T17:54:32.742785] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-16T17:54:32.854684] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T17:54:33.542838] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-16T17:54:34.342787] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-16T17:54:34.381128] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T17:54:35.142886] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-16T17:54:35.447095] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T17:54:35.893254] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:54:35.942794] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-16T17:54:36.748002] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-16T17:54:36.771952] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T17:54:37.548290] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-16T17:54:37.565331] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:54:37.598154] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-16T17:54:38.342867] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-16T17:54:39.142829] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-16T17:54:39.671216] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T17:54:39.942815] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-16T17:54:40.179558] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T17:54:40.742849] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-16T17:54:41.104872] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-16T17:54:41.542872] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-16T17:54:41.939723] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T17:54:42.050898] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T17:54:42.342832] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-16T17:54:43.142846] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-16T17:54:43.696374] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T17:54:43.868321] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T17:54:43.948036] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-16T17:54:43.960350] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T17:54:44.742851] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-16T17:54:45.542834] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-16T17:54:46.119892] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T17:54:46.211366] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T17:54:46.342830] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-16T17:54:47.142803] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-16T17:54:47.407835] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T17:54:47.918033] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T17:54:47.919375] [INFO ] [REMOTE ] CATO: Full fetch complete (10922 records). [2025-10-16T17:54:47.919444] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-16T17:54:47.950212] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-16T17:54:48.280659] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-16T17:54:48.280762] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-16T17:54:48.281045] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-16T17:54:48.281086] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-16T17:54:48.281573] [DEBUG] [LOCAL ] CATO: Trimmed 10922 records to 6736 (keeping 200 days of data) [2025-10-16T17:54:48.320253] [DEBUG] [LOCAL ] CATO: Primary data saved (6736 records). [2025-10-16T17:54:48.320381] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-16T17:54:48.320462] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 35.3s. Estimated remaining: 4h 32m 45s. Rate: 7.2 symbols/min [2025-10-16T17:54:48.489985] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:54:48.521336] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T17:54:48.539914] [DEBUG] [LOCAL ] CBAN: Loaded 10503 existing records from primary storage. [2025-10-16T17:54:48.540129] [INFO ] [MAIN ] CBAN: Loaded 10503 existing records. [2025-10-16T17:54:48.714088] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:54:48.714295] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-16T17:54:48.714340] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-16T17:54:48.714484] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-16T17:54:48.714521] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-16T17:54:48.747981] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-16T17:54:49.069864] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:54:49.542836] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-16T17:54:49.659612] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T17:54:50.342872] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-16T17:54:51.142853] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-16T17:54:51.209762] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-16T17:54:51.216442] [INFO ] [REMOTE ] CAT: Full fetch complete (76877 records). [2025-10-16T17:54:51.216603] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-16T17:54:51.612174] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-16T17:54:51.612282] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-16T17:54:51.613230] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-16T17:54:51.613314] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-16T17:54:51.615054] [DEBUG] [LOCAL ] CAT: Trimmed 76877 records to 53348 (keeping 200 days of data) [2025-10-16T17:54:51.736638] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-16T17:54:51.944620] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-16T17:54:51.994736] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T17:54:52.004308] [DEBUG] [LOCAL ] CAT: Primary data saved (53348 records). [2025-10-16T17:54:52.004390] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-16T17:54:52.004788] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 50.1s. Estimated remaining: 4h 32m 14s. Rate: 7.2 symbols/min [2025-10-16T17:54:52.152518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T17:54:52.742823] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-16T17:54:53.542848] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-16T17:54:53.646053] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T17:54:53.899713] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T17:54:54.342822] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-16T17:54:55.106950] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T17:54:55.142822] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-16T17:54:55.266604] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T17:54:55.942827] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-16T17:54:56.742773] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-16T17:54:56.893772] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T17:54:57.083678] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T17:54:57.542814] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-16T17:54:58.233384] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:54:58.239863] [INFO ] [REMOTE ] CB: Full fetch complete (72808 records). [2025-10-16T17:54:58.240001] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-16T17:54:58.346309] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-16T17:54:58.635563] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-16T17:54:58.635678] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-16T17:54:58.636569] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-16T17:54:58.636635] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-16T17:54:58.638054] [DEBUG] [LOCAL ] CB: Trimmed 72808 records to 50327 (keeping 200 days of data) [2025-10-16T17:54:58.950622] [DEBUG] [LOCAL ] CB: Primary data saved (50327 records). [2025-10-16T17:54:58.950780] [INFO ] [MAIN ] CB: Full history saved. [2025-10-16T17:54:58.950862] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CB took 31.2s. Estimated remaining: 4h 31m 59s. Rate: 7.2 symbols/min [2025-10-16T17:54:59.232698] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T17:54:59.236186] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-16T17:54:59.520262] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T17:54:59.527518] [INFO ] [REMOTE ] CAVA: Full fetch complete (77463 records). [2025-10-16T17:54:59.527689] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-16T17:54:59.935397] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-16T17:54:59.935480] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-16T17:54:59.936415] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-16T17:54:59.936480] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-16T17:54:59.937989] [DEBUG] [LOCAL ] CAVA: Trimmed 77463 records to 53956 (keeping 200 days of data) [2025-10-16T17:55:00.149701] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T17:55:00.154425] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-16T17:55:00.265943] [DEBUG] [LOCAL ] CAVA: Primary data saved (53956 records). [2025-10-16T17:55:00.266081] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-16T17:55:00.266840] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 32.8s. Estimated remaining: 4h 31m 16s. Rate: 7.3 symbols/min [2025-10-16T17:55:00.914335] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T17:55:00.916939] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-16T17:55:01.749925] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T17:55:01.753141] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-16T17:55:02.693835] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T17:55:02.696745] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-16T17:55:03.198785] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T17:55:03.201444] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-16T17:55:03.989853] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T17:55:03.991562] [INFO ] [REMOTE ] CBAN: Full fetch complete (16209 records). [2025-10-16T17:55:03.991638] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-16T17:55:04.356698] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-16T17:55:04.356790] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-16T17:55:04.357068] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-16T17:55:04.357109] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-16T17:55:04.357577] [DEBUG] [LOCAL ] CBAN: Trimmed 16209 records to 10553 (keeping 200 days of data) [2025-10-16T17:55:04.417995] [DEBUG] [LOCAL ] CBAN: Primary data saved (10553 records). [2025-10-16T17:55:04.418114] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-16T17:55:04.418192] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CBAN took 16.1s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-10-16T17:55:04.925067] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.112820] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.156476] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-16T17:55:05.140504] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.156621] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-16T17:55:05.160337] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:05.161032] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.161161] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-16T17:55:05.167747] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-16T17:55:05.167669] [DEBUG] [LOCAL ] CBL: Loaded 16293 existing records from primary storage. [2025-10-16T17:55:05.168830] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-16T17:55:05.200132] [INFO ] [MAIN ] CBL: Loaded 16293 existing records. [2025-10-16T17:55:05.277986] [DEBUG] [LOCAL ] CBNA: Loaded 2920 existing records from primary storage. [2025-10-16T17:55:05.301901] [INFO ] [MAIN ] CBNA: Loaded 2920 existing records. [2025-10-16T17:55:05.601517] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:05.684739] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.739759] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-16T17:55:05.779616] [DEBUG] [LOCAL ] CBRE: Loaded 50361 existing records from primary storage. [2025-10-16T17:55:05.799341] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-16T17:55:05.799515] [INFO ] [MAIN ] CBRE: Loaded 50361 existing records. [2025-10-16T17:55:05.838479] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:05.854450] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-16T17:55:05.869454] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-16T17:55:05.901441] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-16T17:55:05.928766] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-16T17:55:05.939768] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-16T17:55:06.244617] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.316092] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-16T17:55:06.376805] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:06.455397] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-16T17:55:06.521587] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-16T17:55:06.597721] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-16T17:55:06.648084] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-16T17:55:06.659562] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:55:06.713776] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-16T17:55:06.794403] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:55:06.931565] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.952979] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:06.878993] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-16T17:55:06.962187] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:55:06.965756] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-16T17:55:06.962021] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-16T17:55:06.972430] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-16T17:55:06.978585] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-16T17:55:06.989029] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-16T17:55:07.017544] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-16T17:55:07.021141] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 2.6s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-16T17:55:07.381612] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:07.385435] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-16T17:55:07.408126] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:07.408355] [DEBUG] [LOCAL ] CBT: No existing data file found in primary storage. [2025-10-16T17:55:07.408408] [WARN ] [MAIN ] CBT: No existing data found, performing full refresh instead. [2025-10-16T17:55:07.408543] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-16T17:55:07.408596] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-16T17:55:07.408673] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-10-16T17:55:07.408736] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-16T17:55:07.703052] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T17:55:07.707533] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-16T17:55:07.784815] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:07.942778] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-16T17:55:08.124311] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:55:08.222573] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T17:55:08.742867] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-16T17:55:09.301358] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:55:09.336880] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T17:55:09.415459] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T17:55:09.542818] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-16T17:55:10.342792] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-16T17:55:10.497972] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:55:10.788945] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T17:55:11.142818] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-16T17:55:11.942824] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-16T17:55:12.392391] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-16T17:55:12.747938] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-16T17:55:12.764463] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:55:13.063115] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T17:55:13.542830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-16T17:55:14.085740] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T17:55:14.342812] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-16T17:55:15.142787] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-16T17:55:15.347144] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:55:15.942858] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-16T17:55:16.676011] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T17:55:16.742779] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-16T17:55:17.212312] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T17:55:17.542849] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-16T17:55:17.809481] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T17:55:17.984719] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T17:55:18.342853] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-16T17:55:19.142795] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-16T17:55:19.634933] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:55:19.654194] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T17:55:19.942876] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-16T17:55:20.742811] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-16T17:55:21.283168] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T17:55:21.522628] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:55:21.542775] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-16T17:55:22.342832] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-16T17:55:23.142796] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-16T17:55:23.199922] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T17:55:23.331726] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T17:55:23.578544] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:55:23.942823] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-16T17:55:24.742822] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-16T17:55:25.542825] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-16T17:55:25.733448] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T17:55:25.779838] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T17:55:26.342828] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-16T17:55:26.872682] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T17:55:27.142792] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-16T17:55:27.291375] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T17:55:27.942830] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-16T17:55:28.447032] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T17:55:28.447931] [INFO ] [REMOTE ] CBNA: Full fetch complete (4401 records). [2025-10-16T17:55:28.447999] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-16T17:55:28.627061] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T17:55:28.747928] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-16T17:55:28.852411] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-16T17:55:28.852484] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-16T17:55:28.852628] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-16T17:55:28.852705] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-16T17:55:28.853073] [DEBUG] [LOCAL ] CBNA: Trimmed 4401 records to 2936 (keeping 200 days of data) [2025-10-16T17:55:28.869560] [DEBUG] [LOCAL ] CBNA: Primary data saved (2936 records). [2025-10-16T17:55:28.869626] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-16T17:55:28.869731] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBNA took 24.4s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-16T17:55:29.036089] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:29.057191] [DEBUG] [LOCAL ] CBU: Loaded 22717 existing records from primary storage. [2025-10-16T17:55:29.057430] [INFO ] [MAIN ] CBU: Loaded 22717 existing records. [2025-10-16T17:55:29.231580] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:29.231842] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-16T17:55:29.231934] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-16T17:55:29.232159] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-16T17:55:29.232226] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-16T17:55:29.547922] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-16T17:55:29.603503] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:30.071099] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:55:30.342867] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-16T17:55:30.887949] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T17:55:31.142825] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-16T17:55:31.562176] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T17:55:31.942844] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-16T17:55:32.742863] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-16T17:55:33.072906] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T17:55:33.123420] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T17:55:33.453430] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:55:33.542827] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-16T17:55:34.342798] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-16T17:55:35.142820] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-16T17:55:35.321752] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T17:55:35.347239] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T17:55:35.942848] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-16T17:55:36.084166] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T17:55:36.742871] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-16T17:55:36.868760] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:55:36.871339] [INFO ] [REMOTE ] CBL: Full fetch complete (25139 records). [2025-10-16T17:55:36.871428] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-16T17:55:37.249725] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-16T17:55:37.249834] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-16T17:55:37.250353] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-16T17:55:37.250396] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-16T17:55:37.251338] [DEBUG] [LOCAL ] CBL: Trimmed 25139 records to 16377 (keeping 200 days of data) [2025-10-16T17:55:37.350844] [DEBUG] [LOCAL ] CBL: Primary data saved (16377 records). [2025-10-16T17:55:37.351160] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-16T17:55:37.351279] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 32.9s. Estimated remaining: 4h 31m 3s. Rate: 7.3 symbols/min [2025-10-16T17:55:37.523090] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:37.523250] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-16T17:55:37.523307] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-16T17:55:37.523431] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-16T17:55:37.523502] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-16T17:55:37.523562] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-16T17:55:37.523596] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-16T17:55:37.553733] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-16T17:55:37.881206] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:37.985487] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T17:55:38.342820] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-16T17:55:38.540783] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:55:38.541129] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-16T17:55:38.541215] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:55:38.541282] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-16T17:55:38.541346] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:55:38.541416] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-16T17:55:38.541480] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-16T17:55:38.541515] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-16T17:55:38.541553] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-16T17:55:38.541598] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBX took 1.2s. Estimated remaining: 4h 30m 20s. Rate: 7.3 symbols/min [2025-10-16T17:55:38.715843] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:38.716130] [DEBUG] [LOCAL ] CBZ: No existing data file found in primary storage. [2025-10-16T17:55:38.716182] [WARN ] [MAIN ] CBZ: No existing data found, performing full refresh instead. [2025-10-16T17:55:38.716295] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-16T17:55:38.716337] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-16T17:55:38.716378] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-16T17:55:38.716410] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-16T17:55:38.881404] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T17:55:39.098520] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:39.142779] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-16T17:55:39.942838] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-16T17:55:40.048958] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T17:55:40.742859] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-16T17:55:41.542857] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-16T17:55:41.619296] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T17:55:42.133744] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T17:55:42.329813] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T17:55:42.342816] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-16T17:55:43.142832] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-16T17:55:43.618416] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T17:55:43.942856] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-16T17:55:44.742809] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-16T17:55:44.953006] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T17:55:45.050771] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T17:55:45.057088] [INFO ] [REMOTE ] CBRE: Full fetch complete (73840 records). [2025-10-16T17:55:45.057207] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-16T17:55:45.484495] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-16T17:55:45.484621] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-16T17:55:45.485911] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-16T17:55:45.485985] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-16T17:55:45.488092] [DEBUG] [LOCAL ] CBRE: Trimmed 73840 records to 50735 (keeping 200 days of data) [2025-10-16T17:55:45.551989] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-16T17:55:45.836969] [DEBUG] [LOCAL ] CBRE: Primary data saved (50735 records). [2025-10-16T17:55:45.837185] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-16T17:55:45.837298] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBRE took 41.4s. Estimated remaining: 4h 30m 7s. Rate: 7.3 symbols/min [2025-10-16T17:55:46.021818] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:46.038558] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:55:46.102521] [DEBUG] [LOCAL ] CC: Loaded 53013 existing records from primary storage. [2025-10-16T17:55:46.103157] [INFO ] [MAIN ] CC: Loaded 53013 existing records. [2025-10-16T17:55:46.289831] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:46.290133] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-16T17:55:46.290189] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-16T17:55:46.290486] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-16T17:55:46.290540] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-16T17:55:46.347990] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-16T17:55:46.574349] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T17:55:46.716502] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:47.142878] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-16T17:55:47.549100] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T17:55:47.942845] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-16T17:55:48.742842] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-16T17:55:48.870985] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T17:55:48.902926] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T17:55:49.542786] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-16T17:55:49.599988] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:55:50.342826] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-16T17:55:50.527092] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T17:55:51.142804] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-16T17:55:51.624462] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T17:55:51.942833] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-16T17:55:52.409981] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T17:55:52.742822] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-16T17:55:52.996085] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T17:55:53.000435] [INFO ] [REMOTE ] CBT: Full fetch complete (45867 records). [2025-10-16T17:55:53.000521] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-16T17:55:53.365217] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-16T17:55:53.365291] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-16T17:55:53.365910] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-16T17:55:53.365972] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-16T17:55:53.366920] [DEBUG] [LOCAL ] CBT: Trimmed 45867 records to 31366 (keeping 200 days of data) [2025-10-16T17:55:53.543723] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-16T17:55:53.567461] [DEBUG] [LOCAL ] CBT: Primary data saved (31366 records). [2025-10-16T17:55:53.567599] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-16T17:55:53.567706] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 46.5s. Estimated remaining: 4h 29m 57s. Rate: 7.3 symbols/min [2025-10-16T17:55:53.755727] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:53.809031] [DEBUG] [LOCAL ] CCI: Loaded 53117 existing records from primary storage. [2025-10-16T17:55:53.809364] [INFO ] [MAIN ] CCI: Loaded 53117 existing records. [2025-10-16T17:55:53.989301] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:55:53.989604] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-16T17:55:53.989788] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-16T17:55:53.990359] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-16T17:55:53.990416] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-16T17:55:54.126929] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:55:54.358492] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-16T17:55:54.400964] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:54.415095] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T17:55:55.142823] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-16T17:55:55.484739] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T17:55:55.942807] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-16T17:55:56.387210] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T17:55:56.390492] [INFO ] [REMOTE ] CBU: Full fetch complete (32561 records). [2025-10-16T17:55:56.390569] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-16T17:55:56.748670] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-16T17:55:56.812206] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-16T17:55:56.812282] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-16T17:55:56.812790] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-16T17:55:56.812851] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-16T17:55:56.813616] [DEBUG] [LOCAL ] CBU: Trimmed 32561 records to 22932 (keeping 200 days of data) [2025-10-16T17:55:56.952503] [DEBUG] [LOCAL ] CBU: Primary data saved (22932 records). [2025-10-16T17:55:56.952635] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-16T17:55:56.952803] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 28.1s. Estimated remaining: 4h 29m 25s. Rate: 7.3 symbols/min [2025-10-16T17:55:57.123711] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:55:57.123866] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-16T17:55:57.123904] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-16T17:55:57.124015] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-16T17:55:57.124056] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-16T17:55:57.124101] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-16T17:55:57.124135] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-16T17:55:57.491133] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:55:57.547913] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-16T17:55:57.563112] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:55:57.979464] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T17:55:58.342780] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-16T17:55:58.582795] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T17:55:58.762147] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T17:55:59.142836] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-16T17:55:59.474337] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T17:55:59.942862] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-16T17:56:00.742811] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-16T17:56:01.431835] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T17:56:01.542811] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-16T17:56:01.888486] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T17:56:02.342811] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-16T17:56:02.940477] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T17:56:03.142805] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-16T17:56:03.578087] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T17:56:03.733551] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T17:56:03.942797] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-16T17:56:04.330988] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-16T17:56:04.742806] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-16T17:56:05.542855] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-16T17:56:05.878758] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T17:56:06.262796] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T17:56:06.342824] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-16T17:56:07.142867] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-16T17:56:07.831303] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T17:56:07.836341] [INFO ] [REMOTE ] CBZ: Full fetch complete (46127 records). [2025-10-16T17:56:07.836444] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-16T17:56:07.946197] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-16T17:56:08.220326] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-16T17:56:08.220440] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-16T17:56:08.221446] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-16T17:56:08.221511] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-16T17:56:08.222722] [DEBUG] [LOCAL ] CBZ: Trimmed 46127 records to 34513 (keeping 200 days of data) [2025-10-16T17:56:08.415381] [DEBUG] [LOCAL ] CBZ: Primary data saved (34513 records). [2025-10-16T17:56:08.415519] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-16T17:56:08.415589] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBZ took 29.9s. Estimated remaining: 4h 29m 32s. Rate: 7.3 symbols/min [2025-10-16T17:56:08.583115] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:08.598345] [DEBUG] [LOCAL ] CCIF: Loaded 15528 existing records from primary storage. [2025-10-16T17:56:08.598537] [INFO ] [MAIN ] CCIF: Loaded 15528 existing records. [2025-10-16T17:56:08.750422] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-16T17:56:08.780154] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:08.781491] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-16T17:56:08.781610] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-16T17:56:08.781949] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-16T17:56:08.782006] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-16T17:56:09.139053] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:09.173086] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T17:56:09.542847] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-16T17:56:09.596243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:56:09.641874] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T17:56:10.342854] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-16T17:56:10.414620] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T17:56:10.612557] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-16T17:56:11.142811] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-16T17:56:11.942821] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-16T17:56:12.743290] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-16T17:56:12.745709] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T17:56:13.185243] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:56:13.369805] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T17:56:13.542821] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-16T17:56:14.342824] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-16T17:56:15.142804] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-16T17:56:15.302488] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T17:56:15.696590] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T17:56:15.942783] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-16T17:56:16.266907] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T17:56:16.742833] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-16T17:56:17.477774] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:56:17.542770] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-16T17:56:18.204779] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T17:56:18.342780] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-16T17:56:19.142783] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-16T17:56:19.523868] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-16T17:56:19.908381] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T17:56:19.942793] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-16T17:56:19.960334] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T17:56:20.742897] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-16T17:56:21.542784] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-16T17:56:21.572132] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T17:56:21.573283] [INFO ] [REMOTE ] CCIA: Full fetch complete (2163 records). [2025-10-16T17:56:21.573369] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-16T17:56:21.764583] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T17:56:21.764961] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:56:21.765165] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:56:21.765284] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-16T17:56:21.780837] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-16T17:56:21.781875] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-16T17:56:21.791802] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-16T17:56:21.791961] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CCIA took 24.8s. Estimated remaining: 4h 29m 48s. Rate: 7.3 symbols/min [2025-10-16T17:56:21.828104] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T17:56:21.981020] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:22.030955] [DEBUG] [LOCAL ] CCJ: Loaded 53688 existing records from primary storage. [2025-10-16T17:56:22.031269] [INFO ] [MAIN ] CCJ: Loaded 53688 existing records. [2025-10-16T17:56:22.215827] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:22.216268] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-16T17:56:22.216323] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-16T17:56:22.216823] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-16T17:56:22.216894] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-16T17:56:22.345505] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-16T17:56:22.463254] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T17:56:22.587663] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:23.142827] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-16T17:56:23.942778] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-16T17:56:24.095907] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T17:56:24.742839] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-16T17:56:25.218309] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T17:56:25.467633] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T17:56:25.542798] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-16T17:56:25.856388] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T17:56:26.342828] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-16T17:56:26.532180] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T17:56:27.142860] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-16T17:56:27.942880] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-16T17:56:28.288319] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-16T17:56:28.469847] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T17:56:28.555327] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T17:56:28.742829] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-16T17:56:29.542852] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-16T17:56:30.275077] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:56:30.342802] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-16T17:56:30.477423] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T17:56:31.142853] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-16T17:56:31.819090] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T17:56:31.844463] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T17:56:31.942805] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-16T17:56:32.742784] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-16T17:56:32.772101] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T17:56:33.542881] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-16T17:56:34.342843] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-16T17:56:34.539989] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T17:56:34.553070] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T17:56:34.552881] [INFO ] [REMOTE ] CC: Full fetch complete (76077 records). [2025-10-16T17:56:34.553282] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-16T17:56:34.555538] [INFO ] [REMOTE ] CCIF: Full fetch complete (21887 records). [2025-10-16T17:56:34.555671] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-16T17:56:35.153707] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-16T17:56:35.333726] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-16T17:56:35.348824] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-16T17:56:35.352788] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-16T17:56:35.352867] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-16T17:56:35.353144] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-16T17:56:35.353454] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-16T17:56:35.354534] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-16T17:56:35.354774] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-16T17:56:35.354876] [DEBUG] [LOCAL ] CCIF: Trimmed 21887 records to 15625 (keeping 200 days of data) [2025-10-16T17:56:35.390822] [DEBUG] [LOCAL ] CC: Trimmed 76077 records to 53400 (keeping 200 days of data) [2025-10-16T17:56:35.621075] [DEBUG] [LOCAL ] CCIF: Primary data saved (15625 records). [2025-10-16T17:56:35.630114] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-16T17:56:35.630503] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIF took 27.2s. Estimated remaining: 4h 30m 7s. Rate: 7.3 symbols/min [2025-10-16T17:56:35.841786] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:35.889896] [DEBUG] [LOCAL ] CCK: Loaded 46451 existing records from primary storage. [2025-10-16T17:56:35.893179] [INFO ] [MAIN ] CCK: Loaded 46451 existing records. [2025-10-16T17:56:36.153299] [DEBUG] [LOCAL ] CC: Primary data saved (53400 records). [2025-10-16T17:56:36.142400] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:36.153666] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-16T17:56:36.153525] [INFO ] [MAIN ] CC: Full history saved. [2025-10-16T17:56:36.153838] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-16T17:56:36.155107] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 50.3s. Estimated remaining: 4h 29m 22s. Rate: 7.3 symbols/min [2025-10-16T17:56:36.160759] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-16T17:56:36.166973] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-16T17:56:36.483104] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:36.705699] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:36.722034] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-16T17:56:36.725058] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-16T17:56:36.751901] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-16T17:56:36.774596] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-16T17:56:36.774925] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-16T17:56:36.950288] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:36.950469] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-16T17:56:36.950516] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-16T17:56:36.950736] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-16T17:56:36.950793] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-16T17:56:37.315036] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:37.322346] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T17:56:37.329136] [INFO ] [REMOTE ] CCI: Full fetch complete (77108 records). [2025-10-16T17:56:37.329238] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-16T17:56:37.553587] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-16T17:56:37.729541] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-16T17:56:37.729614] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-16T17:56:37.730477] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-16T17:56:37.730535] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-16T17:56:37.731924] [DEBUG] [LOCAL ] CCI: Trimmed 77108 records to 53506 (keeping 200 days of data) [2025-10-16T17:56:38.056349] [DEBUG] [LOCAL ] CCI: Primary data saved (53506 records). [2025-10-16T17:56:38.056477] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-16T17:56:38.057130] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCI took 44.5s. Estimated remaining: 4h 28m 43s. Rate: 7.3 symbols/min [2025-10-16T17:56:38.242292] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:56:38.288710] [DEBUG] [LOCAL ] CCO: Loaded 48392 existing records from primary storage. [2025-10-16T17:56:38.289195] [INFO ] [MAIN ] CCO: Loaded 48392 existing records. [2025-10-16T17:56:38.472454] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:56:38.496535] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-16T17:56:38.497388] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-16T17:56:38.498378] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T17:56:38.508446] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-16T17:56:38.509478] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-16T17:56:38.509713] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-16T17:56:38.837322] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T17:56:38.920340] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:56:39.142867] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-16T17:56:39.845353] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T17:56:39.942908] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-16T17:56:40.191305] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T17:56:40.501932] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T17:56:40.742853] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-16T17:56:41.542894] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-16T17:56:42.241311] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-16T17:56:42.344540] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-16T17:56:42.349939] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T17:56:42.807035] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T17:56:43.142814] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-16T17:56:43.942821] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-16T17:56:44.480967] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-16T17:56:44.742852] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-16T17:56:45.050272] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T17:56:45.319145] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T17:56:45.542854] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-16T17:56:45.988964] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T17:56:46.342850] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-16T17:56:47.142894] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-16T17:56:47.853337] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T17:56:47.890066] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:56:47.942778] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-16T17:56:48.602828] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:56:48.742800] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-16T17:56:49.335885] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T17:56:49.542824] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-16T17:56:50.153905] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T17:56:50.342838] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-16T17:56:51.072871] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T17:56:51.142799] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-16T17:56:51.942836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-16T17:56:52.742832] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-16T17:56:52.785079] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-16T17:56:53.542846] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-16T17:56:54.084465] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T17:56:54.123115] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T17:56:54.342832] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-16T17:56:55.154474] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-16T17:56:55.157422] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (4.01 seconds). [2025-10-16T17:56:55.799770] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T17:56:55.850898] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T17:56:55.942767] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-16T17:56:56.322547] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T17:56:56.742863] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-16T17:56:57.542826] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-16T17:56:58.227166] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T17:56:58.272602] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-16T17:56:58.342791] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-16T17:56:59.142807] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-16T17:56:59.503327] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T17:56:59.883738] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T17:56:59.942766] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-16T17:57:00.699123] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T17:57:00.742777] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-16T17:57:01.542845] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-16T17:57:01.707209] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T17:57:02.342812] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-16T17:57:02.941489] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T17:57:03.142817] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-16T17:57:03.749595] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-16T17:57:03.783534] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T17:57:03.789675] [INFO ] [REMOTE ] CCK: Full fetch complete (67844 records). [2025-10-16T17:57:03.789813] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-16T17:57:03.961428] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-16T17:57:04.176792] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-16T17:57:04.176864] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-16T17:57:04.177694] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-16T17:57:04.177758] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-16T17:57:04.179010] [DEBUG] [LOCAL ] CCK: Trimmed 67844 records to 46797 (keeping 200 days of data) [2025-10-16T17:57:04.471912] [DEBUG] [LOCAL ] CCK: Primary data saved (46797 records). [2025-10-16T17:57:04.472077] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-16T17:57:04.472622] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCK took 28.8s. Estimated remaining: 4h 30m 1s. Rate: 7.2 symbols/min [2025-10-16T17:57:04.646467] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:04.675689] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T17:57:04.692519] [DEBUG] [LOCAL ] CCRD: Loaded 9504 existing records from primary storage. [2025-10-16T17:57:04.692780] [INFO ] [MAIN ] CCRD: Loaded 9504 existing records. [2025-10-16T17:57:04.754519] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-16T17:57:04.877383] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:04.877593] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-16T17:57:04.877662] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-16T17:57:04.877864] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-16T17:57:04.877905] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-16T17:57:05.237759] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:05.542886] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-16T17:57:06.342858] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-16T17:57:06.435044] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-16T17:57:06.571467] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T17:57:07.046734] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T17:57:07.053153] [INFO ] [REMOTE ] CCO: Full fetch complete (67100 records). [2025-10-16T17:57:07.053295] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-16T17:57:07.148410] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-16T17:57:07.362486] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T17:57:07.455407] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-16T17:57:07.455483] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-16T17:57:07.456259] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-16T17:57:07.456321] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-16T17:57:07.457627] [DEBUG] [LOCAL ] CCO: Trimmed 67100 records to 48741 (keeping 200 days of data) [2025-10-16T17:57:07.724835] [DEBUG] [LOCAL ] CCO: Primary data saved (48741 records). [2025-10-16T17:57:07.724993] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-16T17:57:07.725613] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCO took 29.7s. Estimated remaining: 4h 29m 29s. Rate: 7.3 symbols/min [2025-10-16T17:57:07.903521] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:07.935222] [DEBUG] [LOCAL ] CCS: Loaded 30343 existing records from primary storage. [2025-10-16T17:57:07.935519] [INFO ] [MAIN ] CCS: Loaded 30343 existing records. [2025-10-16T17:57:07.947916] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-16T17:57:08.121511] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:08.121785] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-16T17:57:08.121838] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-16T17:57:08.122173] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-16T17:57:08.122212] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-16T17:57:08.479265] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:08.639913] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T17:57:08.742817] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-16T17:57:09.318677] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T17:57:09.500763] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T17:57:09.542793] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-16T17:57:10.342836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-16T17:57:11.142856] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-16T17:57:11.720441] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-16T17:57:11.727401] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-16T17:57:11.727557] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-16T17:57:11.834998] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T17:57:11.950221] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-16T17:57:12.149121] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-16T17:57:12.149192] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-16T17:57:12.150060] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-16T17:57:12.150121] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-16T17:57:12.151495] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54190 (keeping 200 days of data) [2025-10-16T17:57:12.474629] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-16T17:57:12.474780] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-16T17:57:12.474858] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCL took 36.3s. Estimated remaining: 4h 29m 4s. Rate: 7.3 symbols/min [2025-10-16T17:57:12.661071] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:12.662720] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-16T17:57:12.669686] [INFO ] [REMOTE ] CCJ: Full fetch complete (77839 records). [2025-10-16T17:57:12.669856] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-16T17:57:12.747003] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-16T17:57:12.845946] [DEBUG] [LOCAL ] CCU: Loaded 22294 existing records from primary storage. [2025-10-16T17:57:12.868494] [INFO ] [MAIN ] CCU: Loaded 22294 existing records. [2025-10-16T17:57:13.245381] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:13.264591] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-16T17:57:13.264766] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-16T17:57:13.265926] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-16T17:57:13.266231] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-16T17:57:13.266150] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-16T17:57:13.266335] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-16T17:57:13.266888] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-16T17:57:13.267230] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-16T17:57:13.303574] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T17:57:13.380269] [DEBUG] [LOCAL ] CCJ: Trimmed 77839 records to 54078 (keeping 200 days of data) [2025-10-16T17:57:13.554453] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-16T17:57:13.576493] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T17:57:13.806758] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:14.007955] [DEBUG] [LOCAL ] CCJ: Primary data saved (54078 records). [2025-10-16T17:57:14.008094] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-16T17:57:14.008830] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCJ took 52.2s. Estimated remaining: 4h 28m 24s. Rate: 7.3 symbols/min [2025-10-16T17:57:14.172442] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:14.172613] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-16T17:57:14.172677] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-16T17:57:14.172790] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-16T17:57:14.172830] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-16T17:57:14.172871] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-16T17:57:14.172903] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-16T17:57:14.348133] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-16T17:57:14.523692] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:14.866818] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T17:57:15.142853] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-16T17:57:15.551767] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-16T17:57:15.630753] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T17:57:15.942798] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-16T17:57:16.539827] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T17:57:16.742824] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-16T17:57:17.542852] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-16T17:57:17.765087] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-16T17:57:18.097008] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T17:57:18.342819] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-16T17:57:18.560079] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-16T17:57:19.142854] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-16T17:57:19.356272] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-16T17:57:19.942823] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-16T17:57:20.742790] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-16T17:57:20.981251] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T17:57:21.467690] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T17:57:21.542846] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-16T17:57:22.342806] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-16T17:57:22.543626] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:57:22.662673] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T17:57:23.142820] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-16T17:57:23.408588] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-16T17:57:23.942835] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-16T17:57:24.742795] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-16T17:57:24.796997] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:57:25.542841] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-16T17:57:25.973435] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T17:57:26.342883] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-16T17:57:26.375056] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T17:57:27.142841] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-16T17:57:27.583968] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:57:27.584263] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-16T17:57:27.584354] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:57:27.584428] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-16T17:57:27.584496] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:57:27.584683] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-16T17:57:27.584795] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-16T17:57:27.590524] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-16T17:57:27.600583] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-16T17:57:27.600745] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCZ took 13.6s. Estimated remaining: 4h 28m 41s. Rate: 7.3 symbols/min [2025-10-16T17:57:27.634880] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T17:57:27.782049] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:27.835063] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-16T17:57:27.835369] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-16T17:57:27.947983] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-16T17:57:28.027366] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:28.027590] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-16T17:57:28.027664] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-16T17:57:28.027892] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-16T17:57:28.027949] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-16T17:57:28.372754] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:28.742814] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-16T17:57:29.346601] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T17:57:29.542820] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-16T17:57:29.804377] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:57:29.981043] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:57:30.342833] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-16T17:57:31.142811] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-16T17:57:31.942805] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-16T17:57:32.282551] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T17:57:32.540070] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T17:57:32.742806] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-16T17:57:33.030181] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T17:57:33.542866] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-16T17:57:33.670006] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T17:57:34.342822] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-16T17:57:34.561872] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T17:57:34.563483] [INFO ] [REMOTE ] CCRD: Full fetch complete (11920 records). [2025-10-16T17:57:34.563555] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-16T17:57:34.931446] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-16T17:57:34.931566] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-16T17:57:34.931948] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-16T17:57:34.932015] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-16T17:57:34.932839] [DEBUG] [LOCAL ] CCRD: Trimmed 11920 records to 9580 (keeping 200 days of data) [2025-10-16T17:57:34.999314] [DEBUG] [LOCAL ] CCRD: Primary data saved (9580 records). [2025-10-16T17:57:34.999446] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-16T17:57:34.999528] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 30.5s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-16T17:57:35.171244] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:35.153214] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-16T17:57:35.183008] [DEBUG] [LOCAL ] CDLR: Loaded 10075 existing records from primary storage. [2025-10-16T17:57:35.183214] [INFO ] [MAIN ] CDLR: Loaded 10075 existing records. [2025-10-16T17:57:35.360041] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:35.360320] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-16T17:57:35.360391] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-16T17:57:35.360552] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-16T17:57:35.360612] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-16T17:57:35.727521] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:35.942781] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-16T17:57:36.124458] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T17:57:36.353937] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T17:57:36.742874] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-16T17:57:36.872373] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T17:57:37.542790] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-16T17:57:37.622023] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T17:57:38.074063] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T17:57:38.342826] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-16T17:57:39.142870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-16T17:57:39.739131] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T17:57:39.942799] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-16T17:57:40.167396] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T17:57:40.581897] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T17:57:40.742825] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-16T17:57:41.542836] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-16T17:57:41.668775] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T17:57:41.671303] [INFO ] [REMOTE ] CCU: Full fetch complete (32486 records). [2025-10-16T17:57:41.671394] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-16T17:57:42.036093] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-16T17:57:42.036166] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-16T17:57:42.036723] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-16T17:57:42.036784] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-16T17:57:42.037512] [DEBUG] [LOCAL ] CCU: Trimmed 32486 records to 22447 (keeping 200 days of data) [2025-10-16T17:57:42.171591] [DEBUG] [LOCAL ] CCU: Primary data saved (22447 records). [2025-10-16T17:57:42.171821] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-16T17:57:42.171944] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCU took 29.7s. Estimated remaining: 4h 28m 16s. Rate: 7.3 symbols/min [2025-10-16T17:57:42.339790] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:42.342802] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-16T17:57:42.377790] [DEBUG] [LOCAL ] CDP: Loaded 42531 existing records from primary storage. [2025-10-16T17:57:42.378060] [INFO ] [MAIN ] CDP: Loaded 42531 existing records. [2025-10-16T17:57:42.556516] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:42.556746] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-16T17:57:42.556802] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-16T17:57:42.557074] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-16T17:57:42.557114] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-16T17:57:42.884145] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T17:57:42.942766] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:43.142789] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-16T17:57:43.942776] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-16T17:57:44.287471] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-16T17:57:44.684924] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T17:57:44.742781] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-16T17:57:44.868668] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T17:57:45.542858] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-16T17:57:46.209942] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:57:46.233376] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:57:46.342769] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-16T17:57:47.142799] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-16T17:57:47.659922] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T17:57:47.942857] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-16T17:57:48.742788] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-16T17:57:48.968196] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:57:49.141252] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T17:57:49.542882] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-16T17:57:50.043262] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T17:57:50.047290] [INFO ] [REMOTE ] CCS: Full fetch complete (44867 records). [2025-10-16T17:57:50.047615] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-16T17:57:50.349066] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-16T17:57:50.421320] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T17:57:50.601846] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-16T17:57:50.601961] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-16T17:57:50.602797] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-16T17:57:50.602874] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-16T17:57:50.604203] [DEBUG] [LOCAL ] CCS: Trimmed 44867 records to 30488 (keeping 200 days of data) [2025-10-16T17:57:50.833771] [DEBUG] [LOCAL ] CCS: Primary data saved (30488 records). [2025-10-16T17:57:50.833928] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-16T17:57:50.834013] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCS took 43.1s. Estimated remaining: 4h 28m 9s. Rate: 7.3 symbols/min [2025-10-16T17:57:51.023679] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:57:51.047354] [DEBUG] [LOCAL ] CDRE: Loaded 24933 existing records from primary storage. [2025-10-16T17:57:51.047616] [INFO ] [MAIN ] CDRE: Loaded 24933 existing records. [2025-10-16T17:57:51.147960] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-16T17:57:51.234553] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:57:51.234873] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-16T17:57:51.234931] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-16T17:57:51.235217] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-16T17:57:51.235275] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-16T17:57:51.597158] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:57:51.788749] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:57:51.808033] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T17:57:51.942774] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-16T17:57:52.742812] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-16T17:57:53.515718] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T17:57:53.542792] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-16T17:57:53.620831] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T17:57:54.342816] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-16T17:57:55.126437] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T17:57:55.142763] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-16T17:57:55.197681] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T17:57:55.942835] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-16T17:57:56.455113] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T17:57:56.742850] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-16T17:57:57.542793] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-16T17:57:57.802230] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T17:57:58.040848] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T17:57:58.342806] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-16T17:57:59.024323] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T17:57:59.142786] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-16T17:57:59.942836] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-16T17:58:00.148542] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T17:58:00.215317] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T17:58:00.742816] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-16T17:58:00.847944] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T17:58:01.542851] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-16T17:58:02.342850] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-16T17:58:02.614435] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T17:58:02.671759] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T17:58:03.131734] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T17:58:03.142776] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-16T17:58:03.942847] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-16T17:58:04.202474] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T17:58:04.205108] [INFO ] [REMOTE ] CDLR: Full fetch complete (13931 records). [2025-10-16T17:58:04.205190] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-16T17:58:04.585363] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-16T17:58:04.585459] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-16T17:58:04.585985] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-16T17:58:04.586080] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-16T17:58:04.586794] [DEBUG] [LOCAL ] CDLR: Trimmed 13931 records to 10199 (keeping 200 days of data) [2025-10-16T17:58:04.655507] [DEBUG] [LOCAL ] CDLR: Primary data saved (10199 records). [2025-10-16T17:58:04.655747] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-16T17:58:04.655877] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 29.7s. Estimated remaining: 4h 28m 27s. Rate: 7.3 symbols/min [2025-10-16T17:58:04.747967] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-16T17:58:04.831749] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:04.883797] [DEBUG] [LOCAL ] CE: Loaded 51344 existing records from primary storage. [2025-10-16T17:58:04.884227] [INFO ] [MAIN ] CE: Loaded 51344 existing records. [2025-10-16T17:58:05.064732] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:05.065193] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-16T17:58:05.065259] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-16T17:58:05.065497] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-16T17:58:05.065555] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-16T17:58:05.447095] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:05.542845] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-16T17:58:05.862937] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T17:58:06.342810] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-16T17:58:06.525709] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T17:58:06.545156] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T17:58:07.142843] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-16T17:58:07.942826] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-16T17:58:08.141692] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:58:08.669083] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T17:58:08.676057] [INFO ] [REMOTE ] CDP: Full fetch complete (62029 records). [2025-10-16T17:58:08.676189] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-16T17:58:08.755689] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-16T17:58:09.076234] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-16T17:58:09.076314] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-16T17:58:09.077111] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-16T17:58:09.077174] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-16T17:58:09.078392] [DEBUG] [LOCAL ] CDP: Trimmed 62029 records to 42851 (keeping 200 days of data) [2025-10-16T17:58:09.356514] [DEBUG] [LOCAL ] CDP: Primary data saved (42851 records). [2025-10-16T17:58:09.356665] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-16T17:58:09.357249] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDP took 27.2s. Estimated remaining: 4h 28m 2s. Rate: 7.3 symbols/min [2025-10-16T17:58:09.531978] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:09.561456] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-16T17:58:09.568124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T17:58:09.581866] [DEBUG] [LOCAL ] CEE: Loaded 5365 existing records from primary storage. [2025-10-16T17:58:09.582612] [INFO ] [MAIN ] CEE: Loaded 5365 existing records. [2025-10-16T17:58:09.765273] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:09.765487] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-16T17:58:09.765543] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-16T17:58:09.766132] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-16T17:58:09.766189] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-16T17:58:10.131042] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:10.342805] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-16T17:58:10.589383] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T17:58:10.724545] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T17:58:11.142885] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-16T17:58:11.897439] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T17:58:11.942825] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-16T17:58:12.240015] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T17:58:12.742839] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-16T17:58:13.382326] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T17:58:13.542807] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-16T17:58:14.342789] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-16T17:58:14.443235] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T17:58:15.053212] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T17:58:15.104442] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-16T17:58:15.113294] [INFO ] [REMOTE ] CDE: Full fetch complete (77781 records). [2025-10-16T17:58:15.113458] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-16T17:58:15.148040] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-16T17:58:15.516745] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-16T17:58:15.516874] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-16T17:58:15.517811] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-16T17:58:15.517896] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-16T17:58:15.519413] [DEBUG] [LOCAL ] CDE: Trimmed 77781 records to 54033 (keeping 200 days of data) [2025-10-16T17:58:15.830242] [DEBUG] [LOCAL ] CDE: Primary data saved (54033 records). [2025-10-16T17:58:15.830379] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-16T17:58:15.831060] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 48.2s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-16T17:58:15.947956] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-16T17:58:16.003103] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:16.031867] [DEBUG] [LOCAL ] CEPU: Loaded 26707 existing records from primary storage. [2025-10-16T17:58:16.032183] [INFO ] [MAIN ] CEPU: Loaded 26707 existing records. [2025-10-16T17:58:16.214269] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:16.214527] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-16T17:58:16.214599] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-16T17:58:16.214810] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-16T17:58:16.214883] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-16T17:58:16.575105] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:16.579574] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-16T17:58:16.742782] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-16T17:58:16.898987] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T17:58:17.413031] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T17:58:17.542887] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-16T17:58:18.342853] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-16T17:58:18.649338] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T17:58:19.142856] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-16T17:58:19.942829] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-16T17:58:20.317161] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T17:58:20.363935] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T17:58:20.742858] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-16T17:58:20.946533] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T17:58:21.542873] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-16T17:58:21.927629] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T17:58:22.342791] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-16T17:58:23.142791] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-16T17:58:23.233544] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T17:58:23.471373] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T17:58:23.638698] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T17:58:23.942821] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-16T17:58:24.742846] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-16T17:58:24.932918] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T17:58:25.542782] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-16T17:58:25.600452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T17:58:26.342793] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-16T17:58:27.005023] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T17:58:27.142839] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-16T17:58:27.217139] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:58:27.539735] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T17:58:27.942830] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-16T17:58:28.742777] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-16T17:58:29.177496] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T17:58:29.228761] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T17:58:29.542866] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-16T17:58:30.342792] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-16T17:58:30.580932] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T17:58:31.051229] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T17:58:31.142841] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-16T17:58:31.942770] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-16T17:58:32.191554] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T17:58:32.378473] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T17:58:32.742856] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-16T17:58:33.542902] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-16T17:58:33.824037] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T17:58:33.828317] [INFO ] [REMOTE ] CDRE: Full fetch complete (35110 records). [2025-10-16T17:58:33.828494] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-16T17:58:34.224284] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-16T17:58:34.224390] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-16T17:58:34.225106] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-16T17:58:34.225172] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-16T17:58:34.226358] [DEBUG] [LOCAL ] CDRE: Trimmed 35110 records to 25091 (keeping 200 days of data) [2025-10-16T17:58:34.344176] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-16T17:58:34.391369] [DEBUG] [LOCAL ] CDRE: Primary data saved (25091 records). [2025-10-16T17:58:34.391578] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-16T17:58:34.391707] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 43.6s. Estimated remaining: 4h 28m 25s. Rate: 7.2 symbols/min [2025-10-16T17:58:34.583317] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:34.602727] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:58:34.660982] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-16T17:58:34.661535] [INFO ] [MAIN ] CF: Loaded 52155 existing records. [2025-10-16T17:58:34.850721] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:34.851025] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-16T17:58:34.851079] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-16T17:58:34.851474] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-16T17:58:34.851548] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-16T17:58:35.147935] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-16T17:58:35.148182] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T17:58:35.190141] [INFO ] [REMOTE ] CEE: Full fetch complete (10144 records). [2025-10-16T17:58:35.196878] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-16T17:58:35.415056] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:35.654100] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-16T17:58:35.654179] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-16T17:58:35.654463] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-16T17:58:35.654502] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-16T17:58:35.654935] [DEBUG] [LOCAL ] CEE: Trimmed 10144 records to 5411 (keeping 200 days of data) [2025-10-16T17:58:35.685513] [DEBUG] [LOCAL ] CEE: Primary data saved (5411 records). [2025-10-16T17:58:35.685606] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-16T17:58:35.685705] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 26.3s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-16T17:58:35.848523] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:35.899883] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-16T17:58:35.900250] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-16T17:58:35.953855] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-16T17:58:36.074900] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:36.075109] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-16T17:58:36.075156] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-16T17:58:36.075393] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-16T17:58:36.075449] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-16T17:58:36.452344] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:36.742845] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-16T17:58:36.941494] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T17:58:37.542791] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-16T17:58:37.771107] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T17:58:38.194730] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T17:58:38.342794] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-16T17:58:39.150700] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-16T17:58:39.186713] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T17:58:39.831192] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T17:58:39.942821] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-16T17:58:40.210348] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T17:58:40.742834] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-16T17:58:41.500303] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T17:58:41.533702] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T17:58:41.542758] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-16T17:58:42.342846] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-16T17:58:42.517612] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T17:58:43.142842] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-16T17:58:43.942830] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-16T17:58:44.072447] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:58:44.435177] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T17:58:44.742856] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-16T17:58:45.255357] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T17:58:45.542829] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-16T17:58:46.342806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-16T17:58:46.559728] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T17:58:46.769018] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:58:46.773199] [INFO ] [REMOTE ] CEPU: Full fetch complete (39545 records). [2025-10-16T17:58:46.773301] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-16T17:58:46.773842] [FATAL] [VALIDATOR ] CEPU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T17:58:46.773931] [FATAL] [MAIN ] CEPU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T17:58:46.773974] [WARN ] [MAIN ] CEPU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T17:58:46.774036] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-16T17:58:46.774121] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-16T17:58:46.774176] [INFO ] [LOCAL ] CEPU: Starting deletion of derivative data. [2025-10-16T17:58:46.774465] [DEBUG] [LOCAL ] CEPU: Deleted derivative data file. [2025-10-16T17:58:46.774555] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CEPU took 30.9s. Estimated remaining: 4h 27m 49s. Rate: 7.3 symbols/min [2025-10-16T17:58:46.941239] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:46.941435] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-16T17:58:46.941474] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-16T17:58:46.941582] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-16T17:58:46.941624] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-16T17:58:46.941704] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-16T17:58:46.941748] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-16T17:58:47.151994] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-16T17:58:47.287007] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:47.942777] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-16T17:58:48.116130] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T17:58:48.128244] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T17:58:48.128479] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-16T17:58:48.128565] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T17:58:48.128611] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-16T17:58:48.128777] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T17:58:48.128852] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-16T17:58:48.128934] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-16T17:58:48.129013] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-16T17:58:48.129063] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-16T17:58:48.129108] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CFND took 1.4s. Estimated remaining: 4h 27m 9s. Rate: 7.3 symbols/min [2025-10-16T17:58:48.295161] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:48.330314] [DEBUG] [LOCAL ] CFR: Loaded 32574 existing records from primary storage. [2025-10-16T17:58:48.330568] [INFO ] [MAIN ] CFR: Loaded 32574 existing records. [2025-10-16T17:58:48.509215] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:48.509462] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-16T17:58:48.509512] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-16T17:58:48.509938] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-16T17:58:48.509994] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-16T17:58:48.746537] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-16T17:58:48.862530] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:49.108173] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T17:58:49.114624] [INFO ] [REMOTE ] CE: Full fetch complete (74863 records). [2025-10-16T17:58:49.114768] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-16T17:58:49.497091] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-16T17:58:49.497167] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-16T17:58:49.498206] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-16T17:58:49.498268] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-16T17:58:49.500058] [DEBUG] [LOCAL ] CE: Trimmed 74863 records to 51713 (keeping 200 days of data) [2025-10-16T17:58:49.553350] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-16T17:58:49.805888] [DEBUG] [LOCAL ] CE: Primary data saved (51713 records). [2025-10-16T17:58:49.806036] [INFO ] [MAIN ] CE: Full history saved. [2025-10-16T17:58:49.806481] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CE took 45.2s. Estimated remaining: 4h 26m 31s. Rate: 7.3 symbols/min [2025-10-16T17:58:49.971793] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:58:50.011455] [DEBUG] [LOCAL ] CGAU: Loaded 43550 existing records from primary storage. [2025-10-16T17:58:50.011816] [INFO ] [MAIN ] CGAU: Loaded 43550 existing records. [2025-10-16T17:58:50.190291] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:58:50.190505] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-16T17:58:50.190571] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-16T17:58:50.191259] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-16T17:58:50.191317] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-16T17:58:50.364766] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-16T17:58:50.569334] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:58:50.710472] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T17:58:51.142819] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-16T17:58:51.266592] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T17:58:51.771298] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T17:58:51.942809] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-16T17:58:52.742803] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-16T17:58:52.877122] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T17:58:52.956882] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T17:58:53.542785] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-16T17:58:54.350156] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-16T17:58:54.355853] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T17:58:54.932873] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T17:58:55.142832] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-16T17:58:55.436287] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T17:58:55.942827] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-16T17:58:56.563573] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T17:58:56.742794] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-16T17:58:57.542867] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-16T17:58:57.766975] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T17:58:58.173987] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T17:58:58.342805] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-16T17:58:59.142798] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-16T17:58:59.286705] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T17:58:59.888202] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T17:58:59.942820] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-16T17:59:00.742801] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-16T17:59:00.819780] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T17:59:01.382843] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T17:59:01.542877] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-16T17:59:02.315629] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T17:59:02.342779] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-16T17:59:03.142877] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-16T17:59:03.645192] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T17:59:03.942808] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-16T17:59:03.978663] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T17:59:04.703867] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T17:59:04.742797] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-16T17:59:05.123622] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T17:59:05.542874] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-16T17:59:06.248109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T17:59:06.342827] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-16T17:59:06.999372] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T17:59:07.142826] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-16T17:59:07.859170] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T17:59:07.942783] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-16T17:59:08.541335] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T17:59:08.550695] [INFO ] [REMOTE ] CF: Full fetch complete (75572 records). [2025-10-16T17:59:08.550910] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-16T17:59:08.745843] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-16T17:59:08.985452] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-16T17:59:08.985536] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-16T17:59:08.986764] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-16T17:59:08.986829] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-16T17:59:08.988295] [DEBUG] [LOCAL ] CF: Trimmed 75572 records to 52532 (keeping 200 days of data) [2025-10-16T17:59:09.311231] [DEBUG] [LOCAL ] CF: Primary data saved (52532 records). [2025-10-16T17:59:09.311454] [INFO ] [MAIN ] CF: Full history saved. [2025-10-16T17:59:09.312337] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 34.9s. Estimated remaining: 4h 27m 14s. Rate: 7.3 symbols/min [2025-10-16T17:59:09.435299] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T17:59:09.528402] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:09.531308] [DEBUG] [LOCAL ] CGV: Loaded 1398 existing records from primary storage. [2025-10-16T17:59:09.531444] [INFO ] [MAIN ] CGV: Loaded 1398 existing records. [2025-10-16T17:59:09.551101] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-16T17:59:09.710138] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:09.710382] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-16T17:59:09.710431] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-16T17:59:09.710603] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-16T17:59:09.710695] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-16T17:59:10.070301] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:10.093867] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T17:59:10.342809] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-16T17:59:11.142844] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-16T17:59:11.389143] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T17:59:11.473939] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T17:59:11.494304] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T17:59:11.942938] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-16T17:59:12.742809] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-16T17:59:13.258734] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T17:59:13.542850] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-16T17:59:14.342086] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T17:59:14.352407] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-16T17:59:14.781976] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T17:59:14.806560] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T17:59:15.142825] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-16T17:59:15.407624] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-16T17:59:15.942817] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-16T17:59:16.742794] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-16T17:59:17.542894] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-16T17:59:17.926982] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T17:59:17.928918] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T17:59:17.958385] [INFO ] [REMOTE ] CFG: Full fetch complete (77755 records). [2025-10-16T17:59:17.960242] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T17:59:17.960522] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-16T17:59:18.352379] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-16T17:59:18.396549] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-16T17:59:18.396697] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-16T17:59:18.397800] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-16T17:59:18.397867] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-16T17:59:18.399899] [DEBUG] [LOCAL ] CFG: Trimmed 77755 records to 54013 (keeping 200 days of data) [2025-10-16T17:59:18.752806] [DEBUG] [LOCAL ] CFG: Primary data saved (54013 records). [2025-10-16T17:59:18.753053] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-16T17:59:18.753842] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 43.1s. Estimated remaining: 4h 27m 11s. Rate: 7.3 symbols/min [2025-10-16T17:59:18.931226] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:18.963159] [DEBUG] [LOCAL ] CHCT: Loaded 24209 existing records from primary storage. [2025-10-16T17:59:18.963565] [INFO ] [MAIN ] CHCT: Loaded 24209 existing records. [2025-10-16T17:59:19.146839] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-16T17:59:19.151349] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:19.152772] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-16T17:59:19.152833] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-16T17:59:19.153311] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-16T17:59:19.153371] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-16T17:59:19.508372] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:19.942830] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-16T17:59:20.742818] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-16T17:59:20.828327] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T17:59:21.340685] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-16T17:59:21.415711] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-16T17:59:21.422683] [INFO ] [REMOTE ] CGAU: Full fetch complete (61699 records). [2025-10-16T17:59:21.422804] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-16T17:59:21.547979] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-16T17:59:21.845752] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-16T17:59:21.845915] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-16T17:59:21.846775] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-16T17:59:21.846890] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-16T17:59:21.862726] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T17:59:21.869584] [DEBUG] [LOCAL ] CGAU: Trimmed 61699 records to 43931 (keeping 200 days of data) [2025-10-16T17:59:22.120996] [DEBUG] [LOCAL ] CGAU: Primary data saved (43931 records). [2025-10-16T17:59:22.121125] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-16T17:59:22.121488] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CGAU took 32.3s. Estimated remaining: 4h 26m 41s. Rate: 7.3 symbols/min [2025-10-16T17:59:22.189368] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T17:59:22.295702] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:22.345297] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-16T17:59:22.347508] [DEBUG] [LOCAL ] CHD: Loaded 52319 existing records from primary storage. [2025-10-16T17:59:22.347970] [INFO ] [MAIN ] CHD: Loaded 52319 existing records. [2025-10-16T17:59:22.531054] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:22.531304] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-16T17:59:22.531361] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-16T17:59:22.531766] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-16T17:59:22.531822] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-16T17:59:22.872452] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:23.142819] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-16T17:59:23.692939] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T17:59:23.942846] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-16T17:59:24.355774] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T17:59:24.699555] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T17:59:24.742774] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-16T17:59:25.542857] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-16T17:59:26.347929] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-16T17:59:26.366218] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T17:59:26.644349] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T17:59:27.142839] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-16T17:59:27.676765] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T17:59:27.680701] [INFO ] [REMOTE ] CFR: Full fetch complete (48389 records). [2025-10-16T17:59:27.680817] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-16T17:59:27.947964] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-16T17:59:28.055898] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-16T17:59:28.055974] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-16T17:59:28.056660] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-16T17:59:28.056724] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-16T17:59:28.057685] [DEBUG] [LOCAL ] CFR: Trimmed 48389 records to 32885 (keeping 200 days of data) [2025-10-16T17:59:28.269188] [DEBUG] [LOCAL ] CFR: Primary data saved (32885 records). [2025-10-16T17:59:28.270920] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-16T17:59:28.275505] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 40.1s. Estimated remaining: 4h 26m 23s. Rate: 7.3 symbols/min [2025-10-16T17:59:28.307982] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T17:59:28.449257] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:28.465558] [DEBUG] [LOCAL ] CHE: Loaded 15315 existing records from primary storage. [2025-10-16T17:59:28.465825] [INFO ] [MAIN ] CHE: Loaded 15315 existing records. [2025-10-16T17:59:28.642205] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:28.642436] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-16T17:59:28.642491] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-16T17:59:28.642736] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-16T17:59:28.642797] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-16T17:59:28.747936] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-16T17:59:29.003428] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:29.175158] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T17:59:29.551358] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-16T17:59:29.568466] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T17:59:30.342902] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-16T17:59:30.691387] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T17:59:31.142807] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-16T17:59:31.478691] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T17:59:31.918616] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T17:59:31.942771] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-16T17:59:32.742803] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-16T17:59:33.542779] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-16T17:59:33.777319] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T17:59:33.936060] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T17:59:34.340891] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T17:59:34.343790] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-16T17:59:35.142887] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-16T17:59:35.262565] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T17:59:35.942862] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-16T17:59:36.742837] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-16T17:59:37.000019] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T17:59:37.081790] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T17:59:37.537157] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T17:59:37.542770] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-16T17:59:38.342863] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-16T17:59:39.142776] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-16T17:59:39.216998] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T17:59:39.388436] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T17:59:39.942798] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-16T17:59:39.978807] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T17:59:40.742805] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-16T17:59:41.527210] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T17:59:41.542766] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-16T17:59:41.970783] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T17:59:42.342830] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-16T17:59:42.791484] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T17:59:43.142804] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-16T17:59:43.338847] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T17:59:43.942784] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-16T17:59:44.179518] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T17:59:44.742868] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-16T17:59:45.542837] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-16T17:59:45.676918] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T17:59:45.791506] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T17:59:46.342879] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-16T17:59:46.754227] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T17:59:46.795415] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T17:59:46.797021] [INFO ] [REMOTE ] CGV: Full fetch complete (2277 records). [2025-10-16T17:59:46.797111] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-16T17:59:47.146819] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-16T17:59:47.173161] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-16T17:59:47.173252] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-16T17:59:47.173380] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-16T17:59:47.173421] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-16T17:59:47.173810] [DEBUG] [LOCAL ] CGV: Trimmed 2277 records to 1404 (keeping 200 days of data) [2025-10-16T17:59:47.182860] [DEBUG] [LOCAL ] CGV: Primary data saved (1404 records). [2025-10-16T17:59:47.182928] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-16T17:59:47.183022] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGV took 37.9s. Estimated remaining: 4h 27m 2s. Rate: 7.2 symbols/min [2025-10-16T17:59:47.359053] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:47.404568] [DEBUG] [LOCAL ] CHGG: Loaded 47763 existing records from primary storage. [2025-10-16T17:59:47.404899] [INFO ] [MAIN ] CHGG: Loaded 47763 existing records. [2025-10-16T17:59:47.593009] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:47.593315] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-16T17:59:47.593366] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-16T17:59:47.593719] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-16T17:59:47.593778] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-16T17:59:47.943351] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-16T17:59:47.984810] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:47.993866] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T17:59:48.742791] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-16T17:59:49.023483] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T17:59:49.542865] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-16T17:59:50.342803] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-16T17:59:50.510780] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T17:59:50.517522] [INFO ] [REMOTE ] CHD: Full fetch complete (74850 records). [2025-10-16T17:59:50.517784] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-16T17:59:50.653441] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T17:59:50.933903] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-16T17:59:50.933998] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-16T17:59:50.935001] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-16T17:59:50.935083] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-16T17:59:50.936491] [DEBUG] [LOCAL ] CHD: Trimmed 74850 records to 52698 (keeping 200 days of data) [2025-10-16T17:59:51.149496] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-16T17:59:51.259131] [DEBUG] [LOCAL ] CHD: Primary data saved (52698 records). [2025-10-16T17:59:51.259282] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-16T17:59:51.259764] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CHD took 29.1s. Estimated remaining: 4h 26m 35s. Rate: 7.3 symbols/min [2025-10-16T17:59:51.451007] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:51.488475] [DEBUG] [LOCAL ] CHH: Loaded 32425 existing records from primary storage. [2025-10-16T17:59:51.488868] [INFO ] [MAIN ] CHH: Loaded 32425 existing records. [2025-10-16T17:59:51.572254] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:59:51.607999] [INFO ] [REMOTE ] CHCT: Full fetch complete (34754 records). [2025-10-16T17:59:51.618761] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-16T17:59:51.770702] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T17:59:51.791571] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-16T17:59:51.791732] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-16T17:59:51.797468] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-16T17:59:51.797572] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-16T17:59:51.965491] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-16T17:59:52.395420] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-16T17:59:52.403009] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-16T17:59:52.407192] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-16T17:59:52.407286] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-16T17:59:52.479534] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T17:59:52.500360] [DEBUG] [LOCAL ] CHCT: Trimmed 34754 records to 24391 (keeping 200 days of data) [2025-10-16T17:59:52.500085] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:52.652324] [DEBUG] [LOCAL ] CHCT: Primary data saved (24391 records). [2025-10-16T17:59:52.652459] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-16T17:59:52.652538] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 33.9s. Estimated remaining: 4h 25m 56s. Rate: 7.3 symbols/min [2025-10-16T17:59:52.747988] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-16T17:59:52.819573] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:52.819863] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-16T17:59:52.819907] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-16T17:59:52.820018] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-16T17:59:52.820060] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-16T17:59:52.820100] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-16T17:59:52.820131] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-16T17:59:53.162944] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:53.542793] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-16T17:59:53.641477] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T17:59:53.760401] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T17:59:54.342806] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-16T17:59:54.576873] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T17:59:55.142815] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-16T17:59:55.942813] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-16T17:59:56.043242] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T17:59:56.093348] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T17:59:56.742828] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-16T17:59:57.278780] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T17:59:57.542859] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-16T17:59:58.204011] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T17:59:58.342831] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-16T17:59:58.773135] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T17:59:58.776929] [INFO ] [REMOTE ] CHE: Full fetch complete (20397 records). [2025-10-16T17:59:58.777019] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-16T17:59:59.146686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-16T17:59:59.146989] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-16T17:59:59.147222] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-16T17:59:59.148632] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-16T17:59:59.159547] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-16T17:59:59.163094] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T17:59:59.168486] [DEBUG] [LOCAL ] CHE: Trimmed 20397 records to 15454 (keeping 200 days of data) [2025-10-16T17:59:59.265063] [DEBUG] [LOCAL ] CHE: Primary data saved (15454 records). [2025-10-16T17:59:59.265206] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-16T17:59:59.265304] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 31.0s. Estimated remaining: 4h 25m 41s. Rate: 7.3 symbols/min [2025-10-16T17:59:59.430581] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T17:59:59.430796] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-16T17:59:59.430840] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-16T17:59:59.430949] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-16T17:59:59.430993] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-16T17:59:59.431075] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-16T17:59:59.431128] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-16T17:59:59.784455] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T17:59:59.942788] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-16T18:00:00.686979] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:00:00.742888] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-16T18:00:00.958199] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:00:01.542810] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-16T18:00:01.671310] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-16T18:00:02.342836] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-16T18:00:03.142834] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-16T18:00:03.405277] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:00:03.602210] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-16T18:00:03.942846] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-16T18:00:04.566572] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:00:04.742879] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-16T18:00:05.542797] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-16T18:00:05.740320] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T18:00:06.039294] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:00:06.180392] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T18:00:06.342843] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-16T18:00:07.142878] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-16T18:00:07.737988] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:00:07.749100] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:00:07.942809] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-16T18:00:08.742843] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-16T18:00:09.542868] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-16T18:00:09.697867] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:00:09.766529] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:00:10.342812] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-16T18:00:11.058412] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:00:11.142807] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-16T18:00:11.942788] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-16T18:00:12.058479] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T18:00:12.293679] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:00:12.742815] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-16T18:00:13.542823] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-16T18:00:13.961274] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T18:00:14.342771] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-16T18:00:14.411566] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T18:00:14.529017] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:00:14.710725] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T18:00:15.142807] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-16T18:00:15.942883] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-16T18:00:16.742825] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-16T18:00:17.072422] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T18:00:17.102213] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T18:00:17.542817] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-16T18:00:17.938840] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:00:18.342821] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-16T18:00:19.053850] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:00:19.142773] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-16T18:00:19.942869] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-16T18:00:20.020906] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:00:20.457784] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:00:20.571397] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:00:20.742789] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-16T18:00:21.542826] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-16T18:00:21.826141] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-16T18:00:22.342809] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-16T18:00:22.965300] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:00:23.115856] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:00:23.122127] [INFO ] [REMOTE ] CHGG: Full fetch complete (70309 records). [2025-10-16T18:00:23.122308] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-16T18:00:23.151429] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-16T18:00:23.547513] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-16T18:00:23.547599] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-16T18:00:23.548469] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-16T18:00:23.548545] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-16T18:00:23.549987] [DEBUG] [LOCAL ] CHGG: Trimmed 70309 records to 48094 (keeping 200 days of data) [2025-10-16T18:00:23.815198] [DEBUG] [LOCAL ] CHGG: Primary data saved (48094 records). [2025-10-16T18:00:23.815330] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-16T18:00:23.816018] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 36.6s. Estimated remaining: 4h 26m 45s. Rate: 7.2 symbols/min [2025-10-16T18:00:23.942781] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-16T18:00:24.025315] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:00:24.742831] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-16T18:00:25.027102] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:00:25.542780] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-16T18:00:25.572969] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:00:25.575931] [INFO ] [REMOTE ] CHMI: Full fetch complete (31735 records). [2025-10-16T18:00:25.576008] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-16T18:00:25.576495] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:00:25.576576] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:00:25.576619] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:00:25.576704] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-16T18:00:25.576766] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-16T18:00:25.576813] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-16T18:00:25.576879] [DEBUG] [LOCAL ] CHMI: No derivative data file found to delete. [2025-10-16T18:00:25.576937] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHMI took 32.9s. Estimated remaining: 4h 26m 8s. Rate: 7.3 symbols/min [2025-10-16T18:00:26.147395] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T18:00:26.148719] [INFO ] [REMOTE ] CHN: Full fetch complete (7555 records). [2025-10-16T18:00:26.148790] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-16T18:00:26.371420] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-16T18:00:26.529433] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-16T18:00:26.529503] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-16T18:00:26.529718] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-16T18:00:26.529778] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-16T18:00:26.530154] [DEBUG] [LOCAL ] CHN: Trimmed 7555 records to 5044 (keeping 200 days of data) [2025-10-16T18:00:26.558537] [DEBUG] [LOCAL ] CHN: Primary data saved (5044 records). [2025-10-16T18:00:26.558613] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-16T18:00:26.558704] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHN took 27.3s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-16T18:00:27.757512] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:00:27.768315] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-16T18:00:29.184873] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:00:29.191704] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-16T18:00:30.565621] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:00:30.570816] [INFO ] [REMOTE ] CHH: Full fetch complete (47510 records). [2025-10-16T18:00:30.570940] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-16T18:00:30.959554] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-16T18:00:30.959631] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-16T18:00:30.960363] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-16T18:00:30.960415] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-16T18:00:30.961456] [DEBUG] [LOCAL ] CHH: Trimmed 47510 records to 32689 (keeping 200 days of data) [2025-10-16T18:00:31.168518] [DEBUG] [LOCAL ] CHH: Primary data saved (32689 records). [2025-10-16T18:00:31.168731] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-16T18:00:31.169276] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHH took 39.9s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-16T18:00:31.718511] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.819009] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.889230] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.889595] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-16T18:00:31.894242] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:31.890025] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-16T18:00:31.895603] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-16T18:00:31.896204] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-16T18:00:31.896552] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-16T18:00:31.896676] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-16T18:00:32.188031] [DEBUG] [LOCAL ] CHPT: Loaded 47661 existing records from primary storage. [2025-10-16T18:00:32.230217] [INFO ] [MAIN ] CHPT: Loaded 47661 existing records. [2025-10-16T18:00:32.291437] [DEBUG] [LOCAL ] CHWY: Loaded 53655 existing records from primary storage. [2025-10-16T18:00:32.301903] [INFO ] [MAIN ] CHWY: Loaded 53655 existing records. [2025-10-16T18:00:32.303015] [DEBUG] [LOCAL ] CI: Loaded 49737 existing records from primary storage. [2025-10-16T18:00:32.362545] [INFO ] [MAIN ] CI: Loaded 49737 existing records. [2025-10-16T18:00:32.643460] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:32.709766] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-16T18:00:32.928398] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.896872] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.942304] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.943790] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.959039] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-16T18:00:32.963496] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-16T18:00:32.963377] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:00:32.963763] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-16T18:00:32.963807] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-16T18:00:32.964231] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-16T18:00:32.964314] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-16T18:00:32.969658] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-16T18:00:32.977313] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-16T18:00:32.977413] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-16T18:00:33.023806] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-16T18:00:33.988181] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.011785] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-16T18:00:34.000786] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T18:00:34.069180] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-16T18:00:34.160040] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.139443] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:34.161110] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-16T18:00:34.161564] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-16T18:00:34.910227] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:00:34.913968] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-16T18:00:35.970158] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:00:35.974880] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-16T18:00:36.006217] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T18:00:36.018768] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-16T18:00:36.055519] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T18:00:36.066974] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-16T18:00:36.297426] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:00:36.309130] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-16T18:00:37.102283] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:00:37.106952] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-16T18:00:37.715007] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:00:37.725938] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-16T18:00:37.831553] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T18:00:37.876624] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:00:38.051400] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T18:00:38.342812] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-16T18:00:39.102556] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:00:39.142773] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-16T18:00:39.937385] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:00:39.946423] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-16T18:00:40.742786] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-16T18:00:40.955551] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:00:41.542783] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-16T18:00:41.804255] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:00:42.131413] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-16T18:00:42.342793] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-16T18:00:43.142807] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-16T18:00:43.195306] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T18:00:43.942776] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-16T18:00:44.344481] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:00:44.344052] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:00:44.742807] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-16T18:00:45.542803] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-16T18:00:45.692954] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:00:46.342784] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-16T18:00:46.545544] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:00:46.885245] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T18:00:47.142833] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-16T18:00:47.942871] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-16T18:00:48.721743] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-16T18:00:48.742787] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-16T18:00:49.020572] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T18:00:49.542809] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-16T18:00:49.932871] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T18:00:50.342810] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-16T18:00:50.708899] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:00:51.142814] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-16T18:00:51.165443] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:00:51.585399] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T18:00:51.942825] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-16T18:00:52.755162] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-16T18:00:52.757699] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:00:52.958501] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:00:53.542815] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-16T18:00:54.342808] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-16T18:00:54.880294] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T18:00:55.142776] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-16T18:00:55.152333] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T18:00:55.155102] [INFO ] [REMOTE ] CHT: Full fetch complete (27630 records). [2025-10-16T18:00:55.155180] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-16T18:00:55.537894] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-16T18:00:55.538024] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-16T18:00:55.538515] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-16T18:00:55.538640] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-16T18:00:55.551016] [DEBUG] [LOCAL ] CHT: Trimmed 27630 records to 19654 (keeping 200 days of data) [2025-10-16T18:00:55.573552] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T18:00:55.698478] [DEBUG] [LOCAL ] CHT: Primary data saved (19654 records). [2025-10-16T18:00:55.698629] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-16T18:00:55.698742] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHT took 24.5s. Estimated remaining: 4h 26m 6s. Rate: 7.2 symbols/min [2025-10-16T18:00:55.869246] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:00:55.869473] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-10-16T18:00:55.869536] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-10-16T18:00:55.869676] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-16T18:00:55.869732] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-16T18:00:55.869781] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-16T18:00:55.869816] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-16T18:00:55.948034] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-16T18:00:56.227398] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:00:56.742908] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-16T18:00:57.098086] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T18:00:57.542853] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-16T18:00:57.689022] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:00:58.350416] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-16T18:00:58.358737] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T18:00:59.142793] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-16T18:00:59.205131] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:00:59.942820] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-16T18:01:00.754254] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-16T18:01:00.760403] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-16T18:01:01.329306] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:01:01.336780] [INFO ] [REMOTE ] CHWY: Full fetch complete (77778 records). [2025-10-16T18:01:01.336957] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-16T18:01:01.559539] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-16T18:01:01.793139] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-16T18:01:01.793461] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-16T18:01:01.804404] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-16T18:01:01.804721] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-16T18:01:01.806801] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:01:01.812009] [DEBUG] [LOCAL ] CHWY: Trimmed 77778 records to 54045 (keeping 200 days of data) [2025-10-16T18:01:01.936067] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:01:02.175989] [DEBUG] [LOCAL ] CHWY: Primary data saved (54045 records). [2025-10-16T18:01:02.176126] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-16T18:01:02.176205] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHWY took 31.0s. Estimated remaining: 4h 25m 50s. Rate: 7.2 symbols/min [2025-10-16T18:01:02.340801] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:02.342788] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-16T18:01:02.371772] [DEBUG] [LOCAL ] CIB: Loaded 30426 existing records from primary storage. [2025-10-16T18:01:02.372071] [INFO ] [MAIN ] CIB: Loaded 30426 existing records. [2025-10-16T18:01:02.548480] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:02.548639] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-16T18:01:02.548726] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-16T18:01:02.549262] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-16T18:01:02.549320] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-16T18:01:02.910853] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:03.142821] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-16T18:01:03.482936] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T18:01:03.942810] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-16T18:01:04.080553] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:01:04.131401] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T18:01:04.742787] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-16T18:01:04.848603] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:01:05.542820] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-16T18:01:06.175052] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:01:06.191755] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:01:06.342840] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-16T18:01:07.142875] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-16T18:01:07.942819] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-16T18:01:08.070540] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:01:08.259899] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:01:08.729535] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:01:08.735827] [INFO ] [REMOTE ] CI: Full fetch complete (72145 records). [2025-10-16T18:01:08.735983] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-16T18:01:08.747966] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-16T18:01:09.130122] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-16T18:01:09.130203] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-16T18:01:09.131039] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-16T18:01:09.131105] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-16T18:01:09.132483] [DEBUG] [LOCAL ] CI: Trimmed 72145 records to 50066 (keeping 200 days of data) [2025-10-16T18:01:09.441180] [DEBUG] [LOCAL ] CI: Primary data saved (50066 records). [2025-10-16T18:01:09.441327] [INFO ] [MAIN ] CI: Full history saved. [2025-10-16T18:01:09.442103] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CI took 38.3s. Estimated remaining: 4h 25m 37s. Rate: 7.3 symbols/min [2025-10-16T18:01:09.549875] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-16T18:01:09.626316] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:09.626603] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-16T18:01:09.626743] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-16T18:01:09.626883] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-16T18:01:09.626962] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-16T18:01:09.634949] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-16T18:01:09.635537] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-16T18:01:09.635935] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T18:01:09.997126] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:10.342827] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-16T18:01:10.797550] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:01:11.142813] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-16T18:01:11.942818] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-16T18:01:12.067274] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:01:12.074608] [INFO ] [REMOTE ] CHPT: Full fetch complete (71397 records). [2025-10-16T18:01:12.074862] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-16T18:01:12.075803] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:01:12.075928] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:01:12.076001] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:01:12.076058] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-16T18:01:12.076128] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-16T18:01:12.076176] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-16T18:01:12.076379] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-16T18:01:12.077253] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHPT took 40.9s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-16T18:01:12.247249] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:12.297810] [DEBUG] [LOCAL ] CIEN: Loaded 52151 existing records from primary storage. [2025-10-16T18:01:12.298162] [INFO ] [MAIN ] CIEN: Loaded 52151 existing records. [2025-10-16T18:01:12.477558] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:12.477939] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-16T18:01:12.478021] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-16T18:01:12.478957] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-16T18:01:12.479017] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-16T18:01:12.680022] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:01:12.750362] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-16T18:01:12.937766] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:01:12.945761] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:13.414140] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:01:13.542837] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-16T18:01:14.051574] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-16T18:01:14.342874] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-16T18:01:15.142798] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-16T18:01:15.398705] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:01:15.450709] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:01:15.942799] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-16T18:01:16.742858] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-16T18:01:16.968289] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:01:17.210599] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:01:17.542847] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-16T18:01:18.342888] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-16T18:01:19.143690] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-16T18:01:19.146831] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T18:01:19.187147] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T18:01:19.607577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T18:01:19.942866] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-16T18:01:20.742796] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-16T18:01:20.828473] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:01:20.830456] [INFO ] [REMOTE ] CIA: Full fetch complete (23418 records). [2025-10-16T18:01:20.830524] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-16T18:01:21.188324] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-16T18:01:21.188397] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-16T18:01:21.188851] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-16T18:01:21.188942] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-16T18:01:21.189524] [DEBUG] [LOCAL ] CIA: Trimmed 23418 records to 16720 (keeping 200 days of data) [2025-10-16T18:01:21.284163] [DEBUG] [LOCAL ] CIA: Primary data saved (16720 records). [2025-10-16T18:01:21.284297] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-16T18:01:21.284385] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CIA took 25.6s. Estimated remaining: 4h 25m 0s. Rate: 7.3 symbols/min [2025-10-16T18:01:21.452422] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:21.458164] [DEBUG] [LOCAL ] CIF: Loaded 4024 existing records from primary storage. [2025-10-16T18:01:21.458337] [INFO ] [MAIN ] CIF: Loaded 4024 existing records. [2025-10-16T18:01:21.547942] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-16T18:01:21.643370] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:21.643537] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-16T18:01:21.643583] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-16T18:01:21.643795] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-16T18:01:21.643852] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-16T18:01:22.012256] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:22.342848] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-16T18:01:22.785840] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T18:01:22.818335] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:01:22.982388] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:01:23.142846] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-16T18:01:23.942846] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-16T18:01:24.433030] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:01:24.448258] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:01:24.742817] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-16T18:01:25.542832] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-16T18:01:25.811209] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:01:26.254677] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:01:26.342775] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-16T18:01:27.142866] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-16T18:01:27.942845] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-16T18:01:28.144831] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:01:28.206005] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:01:28.521083] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:01:28.742879] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-16T18:01:29.253529] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-16T18:01:29.542876] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-16T18:01:30.342907] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-16T18:01:31.142830] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-16T18:01:31.283164] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:01:31.460721] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:01:31.886420] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:01:31.942830] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-16T18:01:32.742838] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-16T18:01:33.477121] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:01:33.542796] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-16T18:01:33.637035] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:01:34.028365] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T18:01:34.342862] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-16T18:01:35.142884] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-16T18:01:35.630563] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:01:35.942838] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-16T18:01:35.985498] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T18:01:36.462549] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T18:01:36.463272] [INFO ] [REMOTE ] CICB: Full fetch complete (1984 records). [2025-10-16T18:01:36.463341] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-16T18:01:36.635638] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T18:01:36.635865] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:01:36.635948] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:01:36.636036] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-16T18:01:36.636131] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-16T18:01:36.636195] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-16T18:01:36.636254] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-16T18:01:36.636329] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CICB took 27.2s. Estimated remaining: 4h 25m 23s. Rate: 7.2 symbols/min [2025-10-16T18:01:36.747908] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-16T18:01:36.821489] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:36.861756] [DEBUG] [LOCAL ] CIG: Loaded 44317 existing records from primary storage. [2025-10-16T18:01:36.862086] [INFO ] [MAIN ] CIG: Loaded 44317 existing records. [2025-10-16T18:01:37.035903] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:37.036132] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-16T18:01:37.036186] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-16T18:01:37.036960] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-16T18:01:37.037044] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-16T18:01:37.414550] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:37.542767] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-16T18:01:38.325217] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:01:38.342767] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-16T18:01:38.509795] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T18:01:39.142856] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-16T18:01:39.662164] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:01:39.942842] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-16T18:01:40.103574] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:01:40.742824] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-16T18:01:41.097928] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T18:01:41.102075] [INFO ] [REMOTE ] CIB: Full fetch complete (45131 records). [2025-10-16T18:01:41.102174] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-16T18:01:41.476495] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-16T18:01:41.476579] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-16T18:01:41.477433] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-16T18:01:41.477496] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-16T18:01:41.478451] [DEBUG] [LOCAL ] CIB: Trimmed 45131 records to 30684 (keeping 200 days of data) [2025-10-16T18:01:41.563783] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-16T18:01:41.656916] [DEBUG] [LOCAL ] CIB: Primary data saved (30684 records). [2025-10-16T18:01:41.657048] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-16T18:01:41.657128] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 39.5s. Estimated remaining: 4h 25m 0s. Rate: 7.3 symbols/min [2025-10-16T18:01:41.827146] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:41.842344] [DEBUG] [LOCAL ] CII: Loaded 15321 existing records from primary storage. [2025-10-16T18:01:41.842578] [INFO ] [MAIN ] CII: Loaded 15321 existing records. [2025-10-16T18:01:42.019680] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:42.019922] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-16T18:01:42.019977] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-16T18:01:42.020301] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-16T18:01:42.020357] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-16T18:01:42.300906] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:01:42.347926] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-16T18:01:42.383469] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:42.406577] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:01:43.142887] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-16T18:01:43.942793] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-16T18:01:44.234537] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T18:01:44.269536] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:01:44.742827] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-16T18:01:45.097905] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:01:45.511459] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:01:45.542775] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-16T18:01:46.342803] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-16T18:01:46.394521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T18:01:46.844304] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:01:47.142810] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-16T18:01:47.603401] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T18:01:47.942829] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-16T18:01:48.583534] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:01:48.742791] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-16T18:01:49.297871] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T18:01:49.542811] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-16T18:01:50.342878] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-16T18:01:51.142857] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-16T18:01:51.240256] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:01:51.405557] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T18:01:51.942831] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-16T18:01:52.706614] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:01:52.742817] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-16T18:01:53.093505] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:01:53.542779] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-16T18:01:54.342798] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-16T18:01:54.435494] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:01:54.591215] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:01:55.073407] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:01:55.074383] [INFO ] [REMOTE ] CIF: Full fetch complete (6594 records). [2025-10-16T18:01:55.074471] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-16T18:01:55.148005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-16T18:01:55.455472] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-16T18:01:55.455553] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-16T18:01:55.455772] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-16T18:01:55.455836] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-16T18:01:55.456306] [DEBUG] [LOCAL ] CIF: Trimmed 6594 records to 4057 (keeping 200 days of data) [2025-10-16T18:01:55.482072] [DEBUG] [LOCAL ] CIF: Primary data saved (4057 records). [2025-10-16T18:01:55.482212] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-16T18:01:55.482293] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIF took 34.2s. Estimated remaining: 4h 25m 16s. Rate: 7.2 symbols/min [2025-10-16T18:01:55.675759] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:55.716626] [DEBUG] [LOCAL ] CIM: Loaded 37688 existing records from primary storage. [2025-10-16T18:01:55.717000] [INFO ] [MAIN ] CIM: Loaded 37688 existing records. [2025-10-16T18:01:55.915324] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:55.915580] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-16T18:01:55.915630] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-16T18:01:55.916438] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-16T18:01:55.916501] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-16T18:01:55.951718] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-16T18:01:56.272274] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:56.742839] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-16T18:01:56.884795] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:01:57.056974] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T18:01:57.064088] [INFO ] [REMOTE ] CIEN: Full fetch complete (75821 records). [2025-10-16T18:01:57.064263] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-16T18:01:57.460108] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-16T18:01:57.460201] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-16T18:01:57.461180] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-16T18:01:57.461251] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-16T18:01:57.462749] [DEBUG] [LOCAL ] CIEN: Trimmed 75821 records to 52535 (keeping 200 days of data) [2025-10-16T18:01:57.545682] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-16T18:01:57.771511] [DEBUG] [LOCAL ] CIEN: Primary data saved (52535 records). [2025-10-16T18:01:57.771670] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-16T18:01:57.772521] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 45.7s. Estimated remaining: 4h 24m 42s. Rate: 7.3 symbols/min [2025-10-16T18:01:57.951329] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:01:57.977046] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:01:57.987802] [DEBUG] [LOCAL ] CIMN: Loaded 2756 existing records from primary storage. [2025-10-16T18:01:57.988439] [INFO ] [MAIN ] CIMN: Loaded 2756 existing records. [2025-10-16T18:01:58.166660] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:01:58.166932] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-16T18:01:58.166993] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-16T18:01:58.167263] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-16T18:01:58.167325] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-16T18:01:58.349312] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-16T18:01:58.538713] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:01:58.559755] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:01:59.142865] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-16T18:01:59.685885] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-16T18:01:59.724822] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:01:59.942858] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-16T18:02:00.742865] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-16T18:02:01.542830] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-16T18:02:01.646622] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T18:02:02.007200] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:02:02.023141] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:02:02.342821] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-16T18:02:03.142848] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-16T18:02:03.747967] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T18:02:03.942786] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-16T18:02:04.154622] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T18:02:04.235735] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-16T18:02:04.742812] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-16T18:02:05.278280] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-16T18:02:05.542890] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-16T18:02:06.342834] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-16T18:02:07.114790] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:02:07.142799] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-16T18:02:07.360260] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T18:02:07.942812] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-16T18:02:08.573372] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:02:08.742863] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-16T18:02:09.437291] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:02:09.543013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-16T18:02:10.349275] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-16T18:02:10.373278] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:02:10.413914] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-16T18:02:11.142852] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-16T18:02:11.785497] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-16T18:02:11.942818] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-16T18:02:12.067588] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:02:12.422086] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T18:02:12.742846] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-16T18:02:13.542849] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-16T18:02:14.318010] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:02:14.342847] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-16T18:02:15.142823] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-16T18:02:15.314658] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:02:15.321163] [INFO ] [REMOTE ] CIG: Full fetch complete (61897 records). [2025-10-16T18:02:15.321353] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-16T18:02:15.322293] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:02:15.322403] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:02:15.322448] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:02:15.322540] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-16T18:02:15.322610] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-16T18:02:15.322677] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-16T18:02:15.322925] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-16T18:02:15.323590] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIG took 38.7s. Estimated remaining: 4h 25m 13s. Rate: 7.2 symbols/min [2025-10-16T18:02:15.519574] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:15.519759] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-16T18:02:15.519803] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-16T18:02:15.519934] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-16T18:02:15.519994] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-16T18:02:15.520041] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-16T18:02:15.520074] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-16T18:02:15.558441] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-16T18:02:15.860611] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:02:15.932260] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:15.942769] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-16T18:02:16.742849] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-16T18:02:16.792210] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T18:02:17.542814] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-16T18:02:18.168132] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:02:18.201538] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T18:02:18.342885] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-16T18:02:19.142836] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-16T18:02:19.798720] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:02:19.942821] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-16T18:02:20.043156] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:02:20.272281] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:02:20.742873] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-16T18:02:21.174474] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T18:02:21.542863] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-16T18:02:22.342824] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-16T18:02:22.805364] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T18:02:23.117725] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:02:23.142829] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-16T18:02:23.942862] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-16T18:02:24.537593] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:02:24.545586] [INFO ] [REMOTE ] CIM: Full fetch complete (55049 records). [2025-10-16T18:02:24.545798] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-16T18:02:24.673402] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:02:24.770123] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-16T18:02:25.005915] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-16T18:02:25.006002] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-16T18:02:25.006728] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-16T18:02:25.006982] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-16T18:02:25.008178] [DEBUG] [LOCAL ] CIM: Trimmed 55049 records to 37990 (keeping 200 days of data) [2025-10-16T18:02:25.279025] [DEBUG] [LOCAL ] CIM: Primary data saved (37990 records). [2025-10-16T18:02:25.279197] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-16T18:02:25.279321] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIM took 29.8s. Estimated remaining: 4h 25m 12s. Rate: 7.2 symbols/min [2025-10-16T18:02:25.394545] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:02:25.470506] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:25.470736] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-16T18:02:25.470783] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-16T18:02:25.470897] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-16T18:02:25.470937] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-16T18:02:25.470978] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-16T18:02:25.471009] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-16T18:02:25.547951] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-16T18:02:25.840121] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:26.342820] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-16T18:02:26.698268] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T18:02:26.701086] [INFO ] [REMOTE ] CII: Full fetch complete (22921 records). [2025-10-16T18:02:26.701165] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-16T18:02:27.001694] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:02:27.003064] [INFO ] [REMOTE ] CIMN: Full fetch complete (3933 records). [2025-10-16T18:02:27.003507] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-16T18:02:27.152179] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-16T18:02:27.193943] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-16T18:02:27.215179] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-16T18:02:27.224923] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-16T18:02:27.227783] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-16T18:02:27.254630] [DEBUG] [LOCAL ] CII: Trimmed 22921 records to 15443 (keeping 200 days of data) [2025-10-16T18:02:27.609875] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-16T18:02:27.609991] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-16T18:02:27.613563] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-16T18:02:27.616886] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-16T18:02:27.620255] [DEBUG] [LOCAL ] CIMN: Trimmed 3933 records to 2780 (keeping 200 days of data) [2025-10-16T18:02:27.649106] [DEBUG] [LOCAL ] CII: Primary data saved (15443 records). [2025-10-16T18:02:27.655050] [INFO ] [MAIN ] CII: Full history saved. [2025-10-16T18:02:27.656355] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CII took 46.0s. Estimated remaining: 4h 24m 39s. Rate: 7.2 symbols/min [2025-10-16T18:02:27.656233] [DEBUG] [LOCAL ] CIMN: Primary data saved (2780 records). [2025-10-16T18:02:27.699947] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-16T18:02:27.725284] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMN took 30.0s. Estimated remaining: 4h 23m 56s. Rate: 7.3 symbols/min [2025-10-16T18:02:27.848065] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:02:27.944774] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-16T18:02:28.122528] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:28.128085] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-16T18:02:28.138762] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-16T18:02:28.206478] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:28.207103] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-16T18:02:28.207197] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-16T18:02:28.207367] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-16T18:02:28.207421] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-16T18:02:28.207474] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-16T18:02:28.207516] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-16T18:02:28.206909] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-16T18:02:28.270025] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-16T18:02:28.283959] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-16T18:02:28.284074] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-16T18:02:28.462599] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T18:02:28.753174] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-16T18:02:29.009786] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:29.117010] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:02:29.120557] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:29.121146] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-16T18:02:29.121248] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:02:29.121301] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-16T18:02:29.121357] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:02:29.121424] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-16T18:02:29.121483] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-16T18:02:29.121534] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-16T18:02:29.121600] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-16T18:02:29.121687] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIMP took 3.8s. Estimated remaining: 4h 23m 18s. Rate: 7.3 symbols/min [2025-10-16T18:02:29.306725] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:29.306944] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-16T18:02:29.306982] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-16T18:02:29.307104] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-16T18:02:29.307156] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-16T18:02:29.307238] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-16T18:02:29.307306] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-16T18:02:29.553331] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-16T18:02:29.673203] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:30.024602] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T18:02:30.343037] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-16T18:02:31.142805] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-16T18:02:31.377514] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:02:31.942864] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-16T18:02:32.494881] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:02:32.708136] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T18:02:32.742825] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-16T18:02:33.542834] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-16T18:02:33.800980] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T18:02:34.327764] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:02:34.342778] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-16T18:02:35.142808] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-16T18:02:35.237965] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:02:35.942838] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-16T18:02:36.206022] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T18:02:36.742852] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-16T18:02:36.896675] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T18:02:37.385319] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:02:37.542864] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-16T18:02:38.300936] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T18:02:38.342831] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-16T18:02:39.142840] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-16T18:02:39.408826] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T18:02:39.942830] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-16T18:02:40.180546] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:02:40.742822] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-16T18:02:41.022034] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T18:02:41.542827] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-16T18:02:41.764073] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:02:42.342814] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-16T18:02:43.062142] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:02:43.142792] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-16T18:02:43.285359] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T18:02:43.942825] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-16T18:02:43.978379] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:02:44.742850] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-16T18:02:45.291920] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:02:45.542813] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-16T18:02:45.740035] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T18:02:46.022155] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T18:02:46.023410] [INFO ] [REMOTE ] CIMO: Full fetch complete (4783 records). [2025-10-16T18:02:46.023500] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-16T18:02:46.024135] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:02:46.024244] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:02:46.024303] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:02:46.024372] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-16T18:02:46.024456] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-16T18:02:46.024524] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-16T18:02:46.024587] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-16T18:02:46.024722] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMO took 30.7s. Estimated remaining: 4h 23m 47s. Rate: 7.3 symbols/min [2025-10-16T18:02:46.224018] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:02:46.277227] [DEBUG] [LOCAL ] CIVI: Loaded 52699 existing records from primary storage. [2025-10-16T18:02:46.277549] [INFO ] [MAIN ] CIVI: Loaded 52699 existing records. [2025-10-16T18:02:46.347957] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-16T18:02:46.465963] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:02:46.466179] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-16T18:02:46.466228] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-16T18:02:46.467064] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-16T18:02:46.467132] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-16T18:02:46.837231] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:02:47.142842] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-16T18:02:47.184934] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T18:02:47.942815] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-16T18:02:48.742780] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-16T18:02:48.791183] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:02:49.152191] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T18:02:49.542855] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-16T18:02:49.843025] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:02:50.342850] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-16T18:02:51.039637] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T18:02:51.142828] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-16T18:02:51.785813] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T18:02:51.942805] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-16T18:02:52.242213] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:02:52.742858] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-16T18:02:53.449805] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T18:02:53.542836] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-16T18:02:53.874324] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:02:54.342837] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-16T18:02:54.441865] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T18:02:55.142831] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-16T18:02:55.777013] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T18:02:55.942798] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-16T18:02:56.238456] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T18:02:56.742904] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-16T18:02:57.126800] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:02:57.512942] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:02:57.542767] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-16T18:02:58.342804] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-16T18:02:58.723049] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:02:59.142845] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-16T18:02:59.688029] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:02:59.692384] [INFO ] [REMOTE ] CINT: Full fetch complete (28124 records). [2025-10-16T18:02:59.692477] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-16T18:02:59.946681] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-16T18:03:00.079418] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-16T18:03:00.079494] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-16T18:03:00.080041] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-16T18:03:00.080103] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-16T18:03:00.080850] [DEBUG] [LOCAL ] CINT: Trimmed 28124 records to 20157 (keeping 200 days of data) [2025-10-16T18:03:00.197676] [DEBUG] [LOCAL ] CINT: Primary data saved (20157 records). [2025-10-16T18:03:00.197823] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-16T18:03:00.197898] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 32.5s. Estimated remaining: 4h 24m 3s. Rate: 7.2 symbols/min [2025-10-16T18:03:00.373435] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:00.373768] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-16T18:03:00.373872] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-16T18:03:00.374013] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-16T18:03:00.374127] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-16T18:03:00.374195] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-16T18:03:00.374231] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-16T18:03:00.534178] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:03:00.748071] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-16T18:03:00.780757] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:01.542853] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-16T18:03:02.179991] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:03:02.183559] [INFO ] [REMOTE ] CIO: Full fetch complete (29388 records). [2025-10-16T18:03:02.183671] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-16T18:03:02.184158] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:02.184240] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:02.184282] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:02.184325] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-16T18:03:02.184379] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-16T18:03:02.184414] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-10-16T18:03:02.184452] [DEBUG] [LOCAL ] CIO: No derivative data file found to delete. [2025-10-16T18:03:02.184503] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 34.4s. Estimated remaining: 4h 23m 29s. Rate: 7.3 symbols/min [2025-10-16T18:03:02.350273] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-16T18:03:02.379981] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:02.413199] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-16T18:03:02.453634] [DEBUG] [LOCAL ] CLB: Loaded 33430 existing records from primary storage. [2025-10-16T18:03:02.454010] [INFO ] [MAIN ] CLB: Loaded 33430 existing records. [2025-10-16T18:03:02.647516] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:02.648639] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T18:03:02.648909] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-16T18:03:02.652486] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-16T18:03:02.652718] [INFO ] [REMOTE ] CION: Full fetch complete (40407 records). [2025-10-16T18:03:02.652815] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-16T18:03:02.653500] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:02.653554] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-16T18:03:02.653972] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-16T18:03:02.653902] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:02.687301] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:02.725154] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-16T18:03:02.736199] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-16T18:03:02.756869] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-16T18:03:02.757073] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-16T18:03:02.757173] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 33.6s. Estimated remaining: 4h 22m 48s. Rate: 7.3 symbols/min [2025-10-16T18:03:03.134024] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:03.147846] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-16T18:03:03.230997] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:03.236448] [DEBUG] [LOCAL ] CLCO: Loaded 13176 existing records from primary storage. [2025-10-16T18:03:03.236612] [INFO ] [MAIN ] CLCO: Loaded 13176 existing records. [2025-10-16T18:03:03.411621] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:03.411901] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-16T18:03:03.411962] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-16T18:03:03.412212] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-16T18:03:03.412252] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-16T18:03:03.767249] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:03.942785] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-16T18:03:04.196437] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T18:03:04.738371] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:03:04.748961] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-16T18:03:04.888063] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:03:05.542860] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-16T18:03:06.236129] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T18:03:06.342884] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-16T18:03:07.127665] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T18:03:07.142766] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-16T18:03:07.506567] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:03:07.942839] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-16T18:03:08.742806] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-16T18:03:08.977247] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:03:09.542802] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-16T18:03:09.839468] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T18:03:09.923432] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T18:03:10.342792] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-16T18:03:11.142842] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-16T18:03:11.480392] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T18:03:11.942787] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-16T18:03:12.024826] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:03:12.128148] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T18:03:12.742810] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-16T18:03:13.460248] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:03:13.542782] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-16T18:03:14.342783] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-16T18:03:14.625460] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:03:15.142874] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-16T18:03:15.541150] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:03:15.611701] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:03:15.942832] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-16T18:03:16.314906] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:03:16.742818] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-16T18:03:17.542823] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-16T18:03:17.914333] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T18:03:18.205340] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:03:18.342829] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-16T18:03:19.058328] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:03:19.142789] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-16T18:03:19.877709] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:03:19.942848] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-16T18:03:20.391840] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T18:03:20.742909] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-16T18:03:21.462414] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:03:21.542811] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-16T18:03:22.342846] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-16T18:03:22.374186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:03:22.381193] [INFO ] [REMOTE ] CIVI: Full fetch complete (75998 records). [2025-10-16T18:03:22.381365] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-16T18:03:22.784256] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-16T18:03:22.784365] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-16T18:03:22.785371] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-16T18:03:22.785441] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-16T18:03:22.786937] [DEBUG] [LOCAL ] CIVI: Trimmed 75998 records to 53088 (keeping 200 days of data) [2025-10-16T18:03:23.110108] [DEBUG] [LOCAL ] CIVI: Primary data saved (53088 records). [2025-10-16T18:03:23.110237] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-16T18:03:23.110686] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CIVI took 37.1s. Estimated remaining: 4h 23m 30s. Rate: 7.2 symbols/min [2025-10-16T18:03:23.148108] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-16T18:03:23.283516] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:23.308058] [DEBUG] [LOCAL ] CLDT: Loaded 25429 existing records from primary storage. [2025-10-16T18:03:23.308331] [INFO ] [MAIN ] CLDT: Loaded 25429 existing records. [2025-10-16T18:03:23.489370] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:23.489608] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-16T18:03:23.489706] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-16T18:03:23.490351] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-16T18:03:23.490461] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-16T18:03:23.643585] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T18:03:23.810552] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:03:23.941857] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:23.942768] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-16T18:03:24.195039] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T18:03:24.742864] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-16T18:03:25.216492] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:03:25.542847] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-16T18:03:26.342796] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-16T18:03:26.671503] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:03:26.737954] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:03:27.142805] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-16T18:03:27.254392] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:03:27.942837] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-16T18:03:28.747940] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-16T18:03:28.766201] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:03:29.438579] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:03:29.542839] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-16T18:03:29.710376] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:03:30.342873] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-16T18:03:30.958374] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:03:30.973105] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T18:03:31.142833] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-16T18:03:31.942849] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-16T18:03:32.413718] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:03:32.420366] [INFO ] [REMOTE ] CLB: Full fetch complete (47140 records). [2025-10-16T18:03:32.420544] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-16T18:03:32.748008] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-16T18:03:32.819610] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-16T18:03:32.826587] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-16T18:03:32.827799] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-16T18:03:32.828072] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:03:32.828513] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-16T18:03:32.832932] [DEBUG] [LOCAL ] CLB: Trimmed 47140 records to 33709 (keeping 200 days of data) [2025-10-16T18:03:33.043904] [DEBUG] [LOCAL ] CLB: Primary data saved (33709 records). [2025-10-16T18:03:33.044072] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-16T18:03:33.044169] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CLB took 30.9s. Estimated remaining: 4h 23m 29s. Rate: 7.2 symbols/min [2025-10-16T18:03:33.211593] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:33.261484] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-16T18:03:33.261801] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-16T18:03:33.437944] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:33.438143] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-16T18:03:33.438190] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-16T18:03:33.439003] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-16T18:03:33.439061] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-16T18:03:33.544608] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-16T18:03:33.748387] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:03:33.791092] [INFO ] [REMOTE ] CL: Full fetch complete (77811 records). [2025-10-16T18:03:33.802425] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-16T18:03:33.905576] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:34.238673] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-16T18:03:34.238770] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-16T18:03:34.240044] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-16T18:03:34.240112] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-16T18:03:34.241714] [DEBUG] [LOCAL ] CL: Trimmed 77811 records to 54039 (keeping 200 days of data) [2025-10-16T18:03:34.350700] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-16T18:03:34.581509] [DEBUG] [LOCAL ] CL: Primary data saved (54039 records). [2025-10-16T18:03:34.581685] [INFO ] [MAIN ] CL: Full history saved. [2025-10-16T18:03:34.581775] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CL took 34.4s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-16T18:03:34.754507] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:03:34.778715] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:34.806740] [DEBUG] [LOCAL ] CLH: Loaded 27821 existing records from primary storage. [2025-10-16T18:03:34.807040] [INFO ] [MAIN ] CLH: Loaded 27821 existing records. [2025-10-16T18:03:34.984872] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:34.985090] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-16T18:03:34.985136] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-16T18:03:34.985773] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-16T18:03:34.985837] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-16T18:03:35.157260] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-16T18:03:35.349330] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:35.942824] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-16T18:03:36.430381] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:03:36.457162] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T18:03:36.742818] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-16T18:03:37.355265] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:03:37.542793] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-16T18:03:37.845149] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:03:38.173225] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:03:38.342826] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-16T18:03:39.142791] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-16T18:03:39.532492] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:03:39.537027] [INFO ] [REMOTE ] CLCO: Full fetch complete (22794 records). [2025-10-16T18:03:39.537126] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-16T18:03:39.537732] [FATAL] [VALIDATOR ] CLCO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:03:39.537829] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:03:39.537883] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:03:39.537983] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-16T18:03:39.538064] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-16T18:03:39.538112] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-10-16T18:03:39.538321] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-10-16T18:03:39.538426] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 36.8s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-16T18:03:39.720496] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:39.720750] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-16T18:03:39.720797] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-16T18:03:39.720917] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-16T18:03:39.720956] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-16T18:03:39.720997] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-16T18:03:39.721029] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-16T18:03:39.947907] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-16T18:03:40.081717] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:40.742824] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-16T18:03:40.984789] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:03:41.444482] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T18:03:41.543059] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-16T18:03:41.545357] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T18:03:42.342845] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-16T18:03:43.142819] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-16T18:03:43.348431] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:03:43.759143] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-16T18:03:43.942783] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-16T18:03:44.511888] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T18:03:44.742820] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-16T18:03:44.877119] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:03:45.542875] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-16T18:03:46.237301] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:03:46.342852] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-16T18:03:46.742418] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:03:47.142894] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-16T18:03:47.942788] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-16T18:03:48.333555] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:03:48.430586] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T18:03:48.648098] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-16T18:03:48.742817] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-16T18:03:49.542958] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-16T18:03:50.344123] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-16T18:03:50.345758] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:03:50.761036] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T18:03:51.143027] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-16T18:03:51.734263] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:03:51.915491] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:03:51.942808] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-16T18:03:52.685070] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:03:52.742825] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-16T18:03:53.304051] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:03:53.542852] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-16T18:03:54.342845] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-16T18:03:54.371630] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:03:55.142880] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-16T18:03:55.942856] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-16T18:03:56.553312] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-16T18:03:56.618465] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:03:56.740337] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T18:03:56.743170] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-16T18:03:57.542830] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-16T18:03:58.018223] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:03:58.021982] [INFO ] [REMOTE ] CLDT: Full fetch complete (37426 records). [2025-10-16T18:03:58.022085] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-16T18:03:58.184274] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:03:58.359212] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-16T18:03:58.445673] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-16T18:03:58.445761] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-16T18:03:58.446328] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-16T18:03:58.446367] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-16T18:03:58.447174] [DEBUG] [LOCAL ] CLDT: Trimmed 37426 records to 25627 (keeping 200 days of data) [2025-10-16T18:03:58.589222] [DEBUG] [LOCAL ] CLDT: Primary data saved (25627 records). [2025-10-16T18:03:58.589348] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-16T18:03:58.589426] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 35.5s. Estimated remaining: 4h 23m 7s. Rate: 7.2 symbols/min [2025-10-16T18:03:58.765444] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:03:58.815536] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-16T18:03:58.815881] [INFO ] [MAIN ] CLS: Loaded 53583 existing records. [2025-10-16T18:03:58.995692] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:03:58.995944] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-16T18:03:58.995998] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-16T18:03:58.996188] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-16T18:03:58.996244] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-16T18:03:59.147917] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-16T18:03:59.257433] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:03:59.369980] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:03:59.942819] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-16T18:04:00.742865] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-16T18:04:00.771384] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:04:00.773051] [INFO ] [REMOTE ] CLPR: Full fetch complete (16147 records). [2025-10-16T18:04:00.773123] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-16T18:04:00.773548] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:04:00.773634] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:04:00.773741] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:04:00.773829] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-16T18:04:00.773906] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-16T18:04:00.773947] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-16T18:04:00.773986] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-16T18:04:00.774040] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLPR took 21.2s. Estimated remaining: 4h 22m 34s. Rate: 7.3 symbols/min [2025-10-16T18:04:00.956416] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:00.956528] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-10-16T18:04:00.956566] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-10-16T18:04:00.956700] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-16T18:04:00.956753] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-16T18:04:00.956797] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-16T18:04:00.956832] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-16T18:04:01.344122] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:01.542885] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-16T18:04:01.582892] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-16T18:04:02.342896] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-16T18:04:02.679000] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T18:04:03.111920] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:04:03.142785] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-16T18:04:03.942835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-16T18:04:04.299771] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T18:04:04.656171] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:04:04.742832] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-16T18:04:05.469765] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:04:05.542768] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-16T18:04:06.342817] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-16T18:04:07.048426] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-16T18:04:07.142766] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-16T18:04:07.213942] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:04:07.942792] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-16T18:04:08.351497] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:04:08.742858] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-16T18:04:09.117317] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T18:04:09.447198] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T18:04:09.542821] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-16T18:04:10.000515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:04:10.342873] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-16T18:04:10.963480] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:04:11.142906] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-16T18:04:11.942788] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-16T18:04:12.399476] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T18:04:12.525764] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-16T18:04:12.742868] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-16T18:04:13.542871] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-16T18:04:13.906692] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T18:04:14.345181] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-16T18:04:14.351950] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-16T18:04:14.954719] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:04:15.142827] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-16T18:04:15.825130] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:04:15.942846] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-16T18:04:16.742824] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-16T18:04:17.242226] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T18:04:17.249900] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-16T18:04:17.250110] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-16T18:04:17.548014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-16T18:04:17.715114] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-16T18:04:17.715237] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-16T18:04:17.716314] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-16T18:04:17.716383] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-16T18:04:17.717972] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54131 (keeping 200 days of data) [2025-10-16T18:04:17.961174] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T18:04:17.966800] [INFO ] [REMOTE ] CLH: Full fetch complete (42109 records). [2025-10-16T18:04:17.967811] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-16T18:04:18.474300] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-16T18:04:18.475004] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-16T18:04:18.476069] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-16T18:04:18.476628] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-16T18:04:18.481991] [DEBUG] [LOCAL ] CLH: Trimmed 42109 records to 28054 (keeping 200 days of data) [2025-10-16T18:04:18.609812] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-16T18:04:18.618942] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-16T18:04:18.627226] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 45.6s. Estimated remaining: 4h 23m 5s. Rate: 7.2 symbols/min [2025-10-16T18:04:18.634972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-16T18:04:18.705209] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-16T18:04:18.863938] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:18.934507] [DEBUG] [LOCAL ] CLW: Loaded 21508 existing records from primary storage. [2025-10-16T18:04:18.936834] [INFO ] [MAIN ] CLW: Loaded 21508 existing records. [2025-10-16T18:04:19.132995] [DEBUG] [LOCAL ] CLH: Primary data saved (28054 records). [2025-10-16T18:04:19.150595] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-16T18:04:19.168680] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLH took 44.6s. Estimated remaining: 4h 22m 25s. Rate: 7.3 symbols/min [2025-10-16T18:04:19.182564] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:19.249772] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-16T18:04:19.256349] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-16T18:04:19.282982] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-16T18:04:19.288416] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-16T18:04:19.455053] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:19.838774] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:19.839472] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-16T18:04:19.843313] [DEBUG] [LOCAL ] CLX: Loaded 51677 existing records from primary storage. [2025-10-16T18:04:19.841888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-16T18:04:19.850778] [INFO ] [MAIN ] CLX: Loaded 51677 existing records. [2025-10-16T18:04:19.953767] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-16T18:04:20.035843] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:20.036072] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-16T18:04:20.036121] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-16T18:04:20.036303] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-16T18:04:20.036343] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-16T18:04:20.390023] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:20.742869] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-16T18:04:20.878021] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T18:04:21.247613] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:04:21.355843] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T18:04:21.542829] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-16T18:04:22.079715] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:04:22.342826] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-16T18:04:22.462337] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T18:04:23.142816] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-16T18:04:23.942803] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-16T18:04:24.101290] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T18:04:24.274462] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T18:04:24.742828] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-16T18:04:25.542857] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-16T18:04:26.209832] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-16T18:04:26.342809] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-16T18:04:26.482544] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:04:26.932813] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:04:27.142844] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-16T18:04:27.942849] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-16T18:04:28.227764] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-16T18:04:28.633100] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-16T18:04:28.742810] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-16T18:04:29.399321] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:04:29.542827] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-16T18:04:30.342896] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-16T18:04:31.010071] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:04:31.142817] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-16T18:04:31.381556] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:04:31.560528] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:04:31.942809] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-16T18:04:32.742787] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-16T18:04:33.090590] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T18:04:33.542820] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-16T18:04:33.828180] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:04:34.252622] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T18:04:34.342807] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-16T18:04:34.989039] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T18:04:35.142954] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-16T18:04:35.837878] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:04:35.942816] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-16T18:04:36.629286] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T18:04:36.742814] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-16T18:04:36.859848] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T18:04:37.542858] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-16T18:04:38.342787] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-16T18:04:38.551987] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:04:39.147696] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-16T18:04:39.156429] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-16T18:04:39.163405] [INFO ] [REMOTE ] CLS: Full fetch complete (77682 records). [2025-10-16T18:04:39.163507] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-16T18:04:39.553745] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-16T18:04:39.553821] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-16T18:04:39.554725] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-16T18:04:39.554787] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-16T18:04:39.556226] [DEBUG] [LOCAL ] CLS: Trimmed 77682 records to 53972 (keeping 200 days of data) [2025-10-16T18:04:39.879819] [DEBUG] [LOCAL ] CLS: Primary data saved (53972 records). [2025-10-16T18:04:39.879942] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-16T18:04:39.880405] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLS took 41.3s. Estimated remaining: 4h 23m 7s. Rate: 7.2 symbols/min [2025-10-16T18:04:39.955775] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-16T18:04:40.053781] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:40.096949] [DEBUG] [LOCAL ] CM: Loaded 48739 existing records from primary storage. [2025-10-16T18:04:40.097239] [INFO ] [MAIN ] CM: Loaded 48739 existing records. [2025-10-16T18:04:40.251031] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:04:40.321131] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:40.321526] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-16T18:04:40.321599] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-16T18:04:40.322117] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-16T18:04:40.322177] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-16T18:04:40.670584] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:40.711709] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:04:40.718225] [INFO ] [REMOTE ] CLVT: Full fetch complete (75402 records). [2025-10-16T18:04:40.718341] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-16T18:04:40.750019] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-16T18:04:41.116971] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-16T18:04:41.122299] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-16T18:04:41.130113] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-16T18:04:41.130725] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-16T18:04:41.131562] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:04:41.137679] [DEBUG] [LOCAL ] CLVT: Trimmed 75402 records to 52319 (keeping 200 days of data) [2025-10-16T18:04:41.422084] [DEBUG] [LOCAL ] CLVT: Primary data saved (52319 records). [2025-10-16T18:04:41.422233] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-16T18:04:41.422306] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLVT took 40.6s. Estimated remaining: 4h 22m 31s. Rate: 7.2 symbols/min [2025-10-16T18:04:41.547913] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-16T18:04:41.595618] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:41.638940] [DEBUG] [LOCAL ] CMA: Loaded 50122 existing records from primary storage. [2025-10-16T18:04:41.639231] [INFO ] [MAIN ] CMA: Loaded 50122 existing records. [2025-10-16T18:04:41.818848] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:41.819098] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-16T18:04:41.819148] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-16T18:04:41.819338] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-16T18:04:41.819385] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-16T18:04:42.175570] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:42.342817] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-16T18:04:42.487454] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T18:04:42.701727] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:04:43.142809] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-16T18:04:43.942776] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-16T18:04:44.039063] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:04:44.394788] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T18:04:44.397576] [INFO ] [REMOTE ] CLW: Full fetch complete (33882 records). [2025-10-16T18:04:44.397670] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-16T18:04:44.757794] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-16T18:04:44.773535] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-16T18:04:44.774343] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-16T18:04:44.774998] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-16T18:04:44.775073] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-16T18:04:44.776248] [DEBUG] [LOCAL ] CLW: Trimmed 33882 records to 21658 (keeping 200 days of data) [2025-10-16T18:04:44.903247] [DEBUG] [LOCAL ] CLW: Primary data saved (21658 records). [2025-10-16T18:04:44.903369] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-16T18:04:44.903443] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 26.3s. Estimated remaining: 4h 22m 3s. Rate: 7.3 symbols/min [2025-10-16T18:04:45.070679] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:45.098606] [DEBUG] [LOCAL ] CMBT: Loaded 26155 existing records from primary storage. [2025-10-16T18:04:45.098985] [INFO ] [MAIN ] CMBT: Loaded 26155 existing records. [2025-10-16T18:04:45.303159] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:45.303374] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-16T18:04:45.303421] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-16T18:04:45.303589] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-16T18:04:45.303626] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-16T18:04:45.548474] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-16T18:04:45.675240] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:45.703916] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T18:04:46.342857] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-16T18:04:46.691066] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:04:47.109447] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:04:47.142780] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-16T18:04:47.611157] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:04:47.942856] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-16T18:04:48.750267] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-16T18:04:48.756407] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:04:49.476109] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T18:04:49.528382] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:04:49.542771] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-16T18:04:50.342796] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-16T18:04:50.439699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:04:51.142814] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-16T18:04:51.942785] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-16T18:04:52.100881] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:04:52.235826] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T18:04:52.742842] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-16T18:04:53.542801] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-16T18:04:53.611089] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:04:53.843825] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:04:54.342816] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-16T18:04:55.142881] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-16T18:04:55.197630] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:04:55.203967] [INFO ] [REMOTE ] CLX: Full fetch complete (73228 records). [2025-10-16T18:04:55.204100] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-16T18:04:55.204956] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:04:55.205058] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:04:55.205120] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:04:55.205192] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-16T18:04:55.205257] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-16T18:04:55.205306] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-10-16T18:04:55.205542] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-10-16T18:04:55.205637] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 36.0s. Estimated remaining: 4h 22m 3s. Rate: 7.2 symbols/min [2025-10-16T18:04:55.406522] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:04:55.447864] [DEBUG] [LOCAL ] CMC: Loaded 45483 existing records from primary storage. [2025-10-16T18:04:55.448237] [INFO ] [MAIN ] CMC: Loaded 45483 existing records. [2025-10-16T18:04:55.633838] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:04:55.634041] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-16T18:04:55.634091] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-16T18:04:55.634353] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-16T18:04:55.634411] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-16T18:04:55.968910] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-16T18:04:55.998515] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:04:56.036170] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:04:56.220001] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T18:04:56.742924] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-16T18:04:57.444385] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:04:57.542823] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-16T18:04:58.342847] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-16T18:04:58.537585] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:04:58.761986] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T18:04:59.142786] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-16T18:04:59.432048] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:04:59.942861] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-16T18:05:00.495560] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:05:00.742811] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-16T18:05:01.159586] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:05:01.542877] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-16T18:05:02.342802] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-16T18:05:02.623265] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T18:05:02.988546] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-16T18:05:03.142862] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-16T18:05:03.942839] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-16T18:05:04.036291] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:05:04.742874] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-16T18:05:05.044737] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T18:05:05.552066] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-16T18:05:05.557498] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:05:06.342851] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-16T18:05:06.593604] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T18:05:07.148028] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-16T18:05:07.170853] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:05:07.942894] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-16T18:05:08.078393] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:05:08.742891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-16T18:05:09.030159] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T18:05:09.036435] [INFO ] [REMOTE ] CMBT: Full fetch complete (32891 records). [2025-10-16T18:05:09.036526] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-16T18:05:09.395122] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-16T18:05:09.395201] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-16T18:05:09.395765] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-16T18:05:09.395827] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-16T18:05:09.396596] [DEBUG] [LOCAL ] CMBT: Trimmed 32891 records to 26529 (keeping 200 days of data) [2025-10-16T18:05:09.542790] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-16T18:05:09.548936] [DEBUG] [LOCAL ] CMBT: Primary data saved (26529 records). [2025-10-16T18:05:09.549083] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-16T18:05:09.549942] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMBT took 24.6s. Estimated remaining: 4h 22m 20s. Rate: 7.2 symbols/min [2025-10-16T18:05:09.719965] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:09.727400] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-10-16T18:05:09.727626] [INFO ] [MAIN ] CMCM: Loaded 4788 existing records. [2025-10-16T18:05:09.917871] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:09.933178] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-16T18:05:09.961038] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-16T18:05:09.964463] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T18:05:09.978075] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-16T18:05:09.979318] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-16T18:05:10.364811] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:10.375749] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-16T18:05:10.381952] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:05:11.142806] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-16T18:05:11.211732] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T18:05:11.942894] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-16T18:05:11.976932] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:05:12.742940] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-16T18:05:12.901413] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:05:13.542795] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-16T18:05:13.610405] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:05:14.113953] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:05:14.143021] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:05:14.342830] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-16T18:05:15.142863] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-16T18:05:15.942871] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-16T18:05:16.018232] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:05:16.280885] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T18:05:16.742795] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-16T18:05:16.969684] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:05:17.542818] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-16T18:05:18.342869] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-16T18:05:18.689301] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T18:05:18.695937] [INFO ] [REMOTE ] CMA: Full fetch complete (73420 records). [2025-10-16T18:05:18.696047] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-16T18:05:18.871088] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T18:05:19.115937] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-16T18:05:19.116032] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-16T18:05:19.116927] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-16T18:05:19.117008] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-16T18:05:19.142960] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-16T18:05:19.144531] [DEBUG] [LOCAL ] CMA: Trimmed 73420 records to 50512 (keeping 200 days of data) [2025-10-16T18:05:19.146467] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:05:19.458200] [DEBUG] [LOCAL ] CMA: Primary data saved (50512 records). [2025-10-16T18:05:19.458332] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-16T18:05:19.458959] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 38.0s. Estimated remaining: 4h 22m 18s. Rate: 7.2 symbols/min [2025-10-16T18:05:19.627503] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:19.627710] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-16T18:05:19.627759] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-16T18:05:19.627862] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-16T18:05:19.627903] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-16T18:05:19.627943] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-16T18:05:19.627974] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-16T18:05:19.953107] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-16T18:05:19.974186] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:20.742803] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-16T18:05:20.965109] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:05:20.965509] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-16T18:05:20.994196] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:05:20.994442] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-16T18:05:20.994506] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:05:20.994593] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-16T18:05:20.994731] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-16T18:05:20.994801] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-16T18:05:21.003085] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-16T18:05:21.006220] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMDB took 1.5s. Estimated remaining: 4h 21m 42s. Rate: 7.2 symbols/min [2025-10-16T18:05:21.034737] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:05:21.300310] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:21.387265] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-16T18:05:21.387691] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-16T18:05:21.543215] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-16T18:05:21.681403] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:21.684033] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:05:21.684441] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-16T18:05:21.684576] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-16T18:05:21.693774] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-16T18:05:21.694582] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-16T18:05:21.712022] [INFO ] [REMOTE ] CM: Full fetch complete (69834 records). [2025-10-16T18:05:21.724240] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-16T18:05:22.325200] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T18:05:22.347006] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-16T18:05:22.483582] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:22.529903] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-16T18:05:22.529995] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-16T18:05:22.530945] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-16T18:05:22.531014] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-16T18:05:22.532489] [DEBUG] [LOCAL ] CM: Trimmed 69834 records to 49077 (keeping 200 days of data) [2025-10-16T18:05:22.836630] [DEBUG] [LOCAL ] CM: Primary data saved (49077 records). [2025-10-16T18:05:22.836819] [INFO ] [MAIN ] CM: Full history saved. [2025-10-16T18:05:22.837274] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CM took 43.0s. Estimated remaining: 4h 21m 8s. Rate: 7.3 symbols/min [2025-10-16T18:05:23.011990] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:23.052585] [DEBUG] [LOCAL ] CMI: Loaded 41687 existing records from primary storage. [2025-10-16T18:05:23.052919] [INFO ] [MAIN ] CMI: Loaded 41687 existing records. [2025-10-16T18:05:23.150611] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-16T18:05:23.233677] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:23.233896] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-16T18:05:23.233945] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-16T18:05:23.234170] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-16T18:05:23.234228] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-16T18:05:23.591513] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:23.668605] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:05:23.942896] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-16T18:05:24.250910] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:05:24.742906] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-16T18:05:25.542834] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-16T18:05:26.103251] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:05:26.234474] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:05:26.342832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-16T18:05:26.373964] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:05:26.380158] [INFO ] [REMOTE ] CMC: Full fetch complete (67127 records). [2025-10-16T18:05:26.380264] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-16T18:05:26.753634] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-16T18:05:26.753742] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-16T18:05:26.754548] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-16T18:05:26.754589] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-16T18:05:26.755848] [DEBUG] [LOCAL ] CMC: Trimmed 67127 records to 45871 (keeping 200 days of data) [2025-10-16T18:05:27.028960] [DEBUG] [LOCAL ] CMC: Primary data saved (45871 records). [2025-10-16T18:05:27.029128] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-16T18:05:27.029228] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 31.8s. Estimated remaining: 4h 20m 44s. Rate: 7.3 symbols/min [2025-10-16T18:05:27.147997] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-16T18:05:27.198333] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:27.231973] [DEBUG] [LOCAL ] CMP: Loaded 35832 existing records from primary storage. [2025-10-16T18:05:27.232264] [INFO ] [MAIN ] CMP: Loaded 35832 existing records. [2025-10-16T18:05:27.411242] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:27.411446] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-16T18:05:27.411493] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-16T18:05:27.411712] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-16T18:05:27.411769] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-16T18:05:27.780507] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:05:27.784559] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:27.942861] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-16T18:05:28.344892] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T18:05:28.742814] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-16T18:05:29.151524] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T18:05:29.542831] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-16T18:05:29.920513] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:05:30.342878] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-16T18:05:31.142805] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-16T18:05:31.467135] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-16T18:05:31.690914] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:05:31.703192] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T18:05:31.942827] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-16T18:05:32.487203] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:05:32.742824] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-16T18:05:33.542829] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-16T18:05:34.342820] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-16T18:05:34.936699] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-16T18:05:34.987108] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T18:05:35.142829] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-16T18:05:35.762515] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:05:35.942782] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-16T18:05:36.561968] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:05:36.742820] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-16T18:05:37.360898] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:05:37.542813] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-16T18:05:38.342785] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-16T18:05:38.391334] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T18:05:38.408316] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:05:39.142813] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-16T18:05:39.645450] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:05:39.942806] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-16T18:05:40.742787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-16T18:05:40.863083] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:05:41.402714] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:05:41.403953] [INFO ] [REMOTE ] CMCM: Full fetch complete (6915 records). [2025-10-16T18:05:41.404024] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-16T18:05:41.404416] [FATAL] [VALIDATOR ] CMCM: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:05:41.404514] [FATAL] [MAIN ] CMCM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:05:41.404586] [WARN ] [MAIN ] CMCM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:05:41.404707] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-16T18:05:41.404786] [DEBUG] [LOCAL ] CMCM: No primary data file found to delete. [2025-10-16T18:05:41.404822] [INFO ] [LOCAL ] CMCM: Starting deletion of derivative data. [2025-10-16T18:05:41.404950] [DEBUG] [LOCAL ] CMCM: Deleted derivative data file. [2025-10-16T18:05:41.405034] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMCM took 31.9s. Estimated remaining: 4h 20m 60s. Rate: 7.3 symbols/min [2025-10-16T18:05:41.549711] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-16T18:05:41.574301] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:05:41.614274] [DEBUG] [LOCAL ] CMPO: Loaded 38834 existing records from primary storage. [2025-10-16T18:05:41.614544] [INFO ] [MAIN ] CMPO: Loaded 38834 existing records. [2025-10-16T18:05:41.786348] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:05:41.786588] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-16T18:05:41.786634] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-16T18:05:41.786902] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-16T18:05:41.786957] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-16T18:05:42.131303] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:05:42.342771] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-16T18:05:42.523333] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-16T18:05:43.142853] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-16T18:05:43.216456] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:05:43.741133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:05:43.942805] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-16T18:05:44.742838] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-16T18:05:45.095209] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T18:05:45.362394] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:05:45.542836] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-16T18:05:45.931380] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T18:05:46.342833] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-16T18:05:47.142785] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-16T18:05:47.590841] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T18:05:47.659783] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T18:05:47.942841] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-16T18:05:48.742796] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-16T18:05:48.883791] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:05:49.542845] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-16T18:05:50.182431] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T18:05:50.216401] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T18:05:50.342837] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-16T18:05:50.905575] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T18:05:51.142816] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-16T18:05:51.942826] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-16T18:05:52.568883] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:05:52.735547] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T18:05:52.746175] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-16T18:05:53.113759] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T18:05:53.542819] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-16T18:05:54.342790] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-16T18:05:54.462184] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T18:05:54.934740] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:05:55.142810] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-16T18:05:55.942823] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-16T18:05:56.483522] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T18:05:56.742854] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-16T18:05:56.915529] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T18:05:56.991272] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T18:05:56.997730] [INFO ] [REMOTE ] CMI: Full fetch complete (60828 records). [2025-10-16T18:05:56.997881] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-16T18:05:57.405265] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-16T18:05:57.405414] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-16T18:05:57.406562] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-16T18:05:57.406630] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-16T18:05:57.408432] [DEBUG] [LOCAL ] CMI: Trimmed 60828 records to 42011 (keeping 200 days of data) [2025-10-16T18:05:57.542947] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-16T18:05:57.700617] [DEBUG] [LOCAL ] CMI: Primary data saved (42011 records). [2025-10-16T18:05:57.700843] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-16T18:05:57.701402] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMI took 34.9s. Estimated remaining: 4h 21m 23s. Rate: 7.2 symbols/min [2025-10-16T18:05:58.261505] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:05:58.268754] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-16T18:05:58.269008] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-16T18:05:58.352320] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-16T18:05:58.497751] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:05:58.729811] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-16T18:05:58.729954] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-16T18:05:58.730943] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-16T18:05:58.731007] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-16T18:05:58.732600] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54111 (keeping 200 days of data) [2025-10-16T18:05:59.054801] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-16T18:05:59.054951] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-16T18:05:59.055577] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMG took 38.0s. Estimated remaining: 4h 20m 48s. Rate: 7.3 symbols/min [2025-10-16T18:05:59.142877] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-16T18:05:59.956339] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:05:59.964440] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-16T18:06:00.687778] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:06:00.742781] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-16T18:06:01.648713] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:06:01.658120] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-16T18:06:02.094410] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T18:06:02.342884] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-16T18:06:03.052535] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:06:03.142842] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-16T18:06:03.670197] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:06:03.942933] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-16T18:06:04.320085] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:06:04.324563] [INFO ] [REMOTE ] CMPO: Full fetch complete (58547 records). [2025-10-16T18:06:04.324731] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-16T18:06:04.704858] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-16T18:06:04.704949] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-16T18:06:04.705703] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-16T18:06:04.705763] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-16T18:06:04.708786] [DEBUG] [LOCAL ] CMPO: Trimmed 58547 records to 39076 (keeping 200 days of data) [2025-10-16T18:06:04.929834] [DEBUG] [LOCAL ] CMPO: Primary data saved (39076 records). [2025-10-16T18:06:04.929950] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-16T18:06:04.930560] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMPO took 23.5s. Estimated remaining: 4h 20m 30s. Rate: 7.3 symbols/min [2025-10-16T18:06:05.216181] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:06:05.220152] [INFO ] [REMOTE ] CMP: Full fetch complete (51755 records). [2025-10-16T18:06:05.220236] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-16T18:06:05.607910] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-16T18:06:05.608005] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-16T18:06:05.608804] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-16T18:06:05.608881] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-16T18:06:05.609896] [DEBUG] [LOCAL ] CMP: Trimmed 51755 records to 36020 (keeping 200 days of data) [2025-10-16T18:06:05.811335] [DEBUG] [LOCAL ] CMP: Primary data saved (36020 records). [2025-10-16T18:06:05.811464] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-16T18:06:05.811540] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMP took 38.8s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-16T18:06:06.450120] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.496824] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.493774] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.508298] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-16T18:06:06.531852] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:06.532441] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-16T18:06:06.533175] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-16T18:06:06.533248] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-16T18:06:06.533566] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-16T18:06:06.533619] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-16T18:06:06.650790] [DEBUG] [LOCAL ] CMSC: Loaded 4881 existing records from primary storage. [2025-10-16T18:06:06.654638] [INFO ] [MAIN ] CMSC: Loaded 4881 existing records. [2025-10-16T18:06:06.824044] [DEBUG] [LOCAL ] CMRE: Loaded 35851 existing records from primary storage. [2025-10-16T18:06:06.929399] [INFO ] [MAIN ] CMRE: Loaded 35851 existing records. [2025-10-16T18:06:07.228158] [DEBUG] [LOCAL ] CMS: Loaded 52615 existing records from primary storage. [2025-10-16T18:06:07.256240] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.337690] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.372731] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-16T18:06:07.337367] [INFO ] [MAIN ] CMS: Loaded 52615 existing records. [2025-10-16T18:06:07.404200] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-16T18:06:07.413167] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-16T18:06:07.413015] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:07.413634] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-16T18:06:07.403868] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.452182] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.484831] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-16T18:06:07.518677] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-16T18:06:07.531965] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-16T18:06:07.885567] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:07.925072] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-16T18:06:07.974470] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-16T18:06:08.037036] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-16T18:06:08.037275] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-16T18:06:08.336162] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:06:08.429789] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-16T18:06:08.566517] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.581219] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-16T18:06:08.570517] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.635843] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-16T18:06:08.842825] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:08.843226] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-16T18:06:09.112693] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:06:09.114392] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-16T18:06:09.190989] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:06:09.542886] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-16T18:06:09.702686] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:06:10.069519] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:06:10.141258] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:06:10.342804] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-16T18:06:10.705060] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:06:10.719558] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-16T18:06:11.142813] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-16T18:06:11.664237] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T18:06:11.942811] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-16T18:06:12.742899] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-16T18:06:13.077547] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:06:13.542905] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-16T18:06:14.342823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-16T18:06:14.418718] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:06:14.494248] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T18:06:14.908315] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:06:15.142837] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-16T18:06:15.942819] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-16T18:06:16.598541] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:06:16.742817] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-16T18:06:17.520984] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:06:17.542795] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-16T18:06:17.956785] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T18:06:18.342854] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-16T18:06:18.997386] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:06:19.142836] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-16T18:06:19.324574] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:06:19.942822] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-16T18:06:20.659530] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T18:06:20.740602] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:06:20.747575] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-16T18:06:21.379098] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:06:21.542835] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-16T18:06:22.342817] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-16T18:06:23.142810] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-16T18:06:23.170795] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:06:23.448549] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T18:06:23.622441] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:06:23.942809] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-16T18:06:24.591088] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T18:06:24.742854] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-16T18:06:25.542822] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-16T18:06:26.099966] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:06:26.334847] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T18:06:26.345226] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-16T18:06:26.669833] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-16T18:06:27.142823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-16T18:06:27.861138] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T18:06:27.942864] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-16T18:06:28.516705] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T18:06:28.742835] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-16T18:06:29.542827] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-16T18:06:30.151431] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T18:06:30.166542] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T18:06:30.342812] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-16T18:06:31.142814] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-16T18:06:31.942787] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-16T18:06:32.162849] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:06:32.386147] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:06:32.401120] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:06:32.742806] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-16T18:06:33.474001] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:06:33.475078] [INFO ] [REMOTE ] CMSC: Full fetch complete (7107 records). [2025-10-16T18:06:33.475146] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-16T18:06:33.548029] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-16T18:06:33.829802] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-16T18:06:33.829876] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-16T18:06:33.830074] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-16T18:06:33.830115] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-16T18:06:33.830497] [DEBUG] [LOCAL ] CMSC: Trimmed 7107 records to 4906 (keeping 200 days of data) [2025-10-16T18:06:33.859947] [DEBUG] [LOCAL ] CMSC: Primary data saved (4906 records). [2025-10-16T18:06:33.860067] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-16T18:06:33.860160] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSC took 28.0s. Estimated remaining: 4h 21m 2s. Rate: 7.2 symbols/min [2025-10-16T18:06:34.030252] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:34.040144] [DEBUG] [LOCAL ] CMSD: Loaded 7835 existing records from primary storage. [2025-10-16T18:06:34.040350] [INFO ] [MAIN ] CMSD: Loaded 7835 existing records. [2025-10-16T18:06:34.215861] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:34.216083] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-16T18:06:34.216134] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-16T18:06:34.216319] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-16T18:06:34.216376] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-16T18:06:34.355117] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-16T18:06:34.578452] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:35.000080] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T18:06:35.019551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:06:35.020869] [INFO ] [REMOTE ] CMSA: Full fetch complete (5061 records). [2025-10-16T18:06:35.020955] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-16T18:06:35.147928] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-16T18:06:35.388087] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-16T18:06:35.388201] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-16T18:06:35.388382] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-16T18:06:35.388422] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-16T18:06:35.388818] [DEBUG] [LOCAL ] CMSA: Trimmed 5061 records to 3562 (keeping 200 days of data) [2025-10-16T18:06:35.410265] [DEBUG] [LOCAL ] CMSA: Primary data saved (3562 records). [2025-10-16T18:06:35.410338] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-16T18:06:35.410400] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 29.6s. Estimated remaining: 4h 20m 27s. Rate: 7.2 symbols/min [2025-10-16T18:06:35.575684] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:35.610860] [DEBUG] [LOCAL ] CMTG: Loaded 35854 existing records from primary storage. [2025-10-16T18:06:35.611126] [INFO ] [MAIN ] CMTG: Loaded 35854 existing records. [2025-10-16T18:06:35.784354] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:35.784550] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-16T18:06:35.784597] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-16T18:06:35.784832] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-16T18:06:35.784889] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-16T18:06:35.945105] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-16T18:06:36.136007] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:36.742845] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-16T18:06:37.092909] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:06:37.127848] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T18:06:37.542869] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-16T18:06:38.023229] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:06:38.342867] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-16T18:06:38.556977] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T18:06:39.142825] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-16T18:06:39.643495] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:06:39.942879] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-16T18:06:40.742807] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-16T18:06:40.864794] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:06:41.342061] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:06:41.542792] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-16T18:06:42.151273] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:06:42.342850] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-16T18:06:43.069595] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T18:06:43.076316] [INFO ] [REMOTE ] CMS: Full fetch complete (76218 records). [2025-10-16T18:06:43.076449] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-16T18:06:43.150425] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-16T18:06:43.488967] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-16T18:06:43.489069] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-16T18:06:43.490112] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-16T18:06:43.490178] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-16T18:06:43.491790] [DEBUG] [LOCAL ] CMS: Trimmed 76218 records to 52994 (keeping 200 days of data) [2025-10-16T18:06:43.648479] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:06:43.861126] [DEBUG] [LOCAL ] CMS: Primary data saved (52994 records). [2025-10-16T18:06:43.861289] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-16T18:06:43.862024] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 38.0s. Estimated remaining: 4h 20m 20s. Rate: 7.2 symbols/min [2025-10-16T18:06:43.951053] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-16T18:06:44.036146] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:44.046330] [DEBUG] [LOCAL ] CMU: Loaded 6330 existing records from primary storage. [2025-10-16T18:06:44.046560] [INFO ] [MAIN ] CMU: Loaded 6330 existing records. [2025-10-16T18:06:44.219166] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:44.219420] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-16T18:06:44.219473] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-16T18:06:44.219613] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-16T18:06:44.219691] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-16T18:06:44.654119] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:44.742890] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-16T18:06:44.924966] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:06:44.930569] [INFO ] [REMOTE ] CMRE: Full fetch complete (51194 records). [2025-10-16T18:06:44.930715] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-16T18:06:45.308419] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T18:06:45.404936] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-16T18:06:45.405015] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-16T18:06:45.405882] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-16T18:06:45.405949] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-16T18:06:45.407161] [DEBUG] [LOCAL ] CMRE: Trimmed 51194 records to 36175 (keeping 200 days of data) [2025-10-16T18:06:45.543253] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-16T18:06:45.545732] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:06:45.662937] [DEBUG] [LOCAL ] CMRE: Primary data saved (36175 records). [2025-10-16T18:06:45.663091] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-16T18:06:45.663560] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMRE took 39.9s. Estimated remaining: 4h 19m 46s. Rate: 7.3 symbols/min [2025-10-16T18:06:45.833040] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:06:45.865363] [DEBUG] [LOCAL ] CNA: Loaded 32932 existing records from primary storage. [2025-10-16T18:06:45.865706] [INFO ] [MAIN ] CNA: Loaded 32932 existing records. [2025-10-16T18:06:46.040091] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:06:46.040298] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-16T18:06:46.040345] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-16T18:06:46.040563] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-16T18:06:46.040688] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-16T18:06:46.166496] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-16T18:06:46.348027] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-16T18:06:46.399511] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:06:46.944414] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:06:47.142870] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-16T18:06:47.942853] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-16T18:06:48.457878] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:06:48.742834] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-16T18:06:49.198300] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:06:49.346909] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:06:49.542823] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-16T18:06:50.337315] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T18:06:50.342761] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-16T18:06:50.851861] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-16T18:06:51.142852] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-16T18:06:51.942829] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-16T18:06:52.339399] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:06:52.385392] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:06:52.742840] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-16T18:06:53.374726] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T18:06:53.542813] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-16T18:06:54.342812] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-16T18:06:54.374373] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:06:54.942452] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:06:55.142819] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-16T18:06:55.942817] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-16T18:06:56.565372] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:06:56.742784] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-16T18:06:57.333104] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T18:06:57.542863] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-16T18:06:58.024675] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-16T18:06:58.227980] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T18:06:58.342814] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-16T18:06:59.057172] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:06:59.142830] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-16T18:06:59.761868] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T18:06:59.942858] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-16T18:07:00.742795] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-16T18:07:00.877275] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:07:01.406301] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-16T18:07:01.542834] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-16T18:07:02.342831] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-16T18:07:03.022146] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:07:03.056237] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T18:07:03.142881] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-16T18:07:03.912736] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T18:07:03.942773] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-16T18:07:04.734531] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:07:04.736099] [INFO ] [REMOTE ] CMSD: Full fetch complete (11795 records). [2025-10-16T18:07:04.736181] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-16T18:07:04.748055] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-16T18:07:05.117279] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-16T18:07:05.117409] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-16T18:07:05.118073] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-16T18:07:05.118145] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-16T18:07:05.119246] [DEBUG] [LOCAL ] CMSD: Trimmed 11795 records to 7871 (keeping 200 days of data) [2025-10-16T18:07:05.174786] [DEBUG] [LOCAL ] CMSD: Primary data saved (7871 records). [2025-10-16T18:07:05.175001] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-16T18:07:05.175140] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMSD took 31.3s. Estimated remaining: 4h 20m 22s. Rate: 7.2 symbols/min [2025-10-16T18:07:05.360795] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:05.424984] [DEBUG] [LOCAL ] CNC: Loaded 53770 existing records from primary storage. [2025-10-16T18:07:05.425553] [INFO ] [MAIN ] CNC: Loaded 53770 existing records. [2025-10-16T18:07:05.543599] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-16T18:07:05.544711] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:07:05.673831] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:05.674168] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-16T18:07:05.674235] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-16T18:07:05.674766] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-16T18:07:05.674836] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-16T18:07:06.187864] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:06.342936] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-16T18:07:07.010727] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:07:07.142850] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-16T18:07:07.569861] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:07:07.778537] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T18:07:07.942801] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-16T18:07:08.610859] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T18:07:08.611905] [INFO ] [REMOTE ] CMU: Full fetch complete (9536 records). [2025-10-16T18:07:08.611973] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-16T18:07:08.747963] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-16T18:07:09.008913] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-16T18:07:09.009000] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-16T18:07:09.009229] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-16T18:07:09.009268] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-16T18:07:09.009842] [DEBUG] [LOCAL ] CMU: Trimmed 9536 records to 6366 (keeping 200 days of data) [2025-10-16T18:07:09.047970] [DEBUG] [LOCAL ] CMU: Primary data saved (6366 records). [2025-10-16T18:07:09.048121] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-16T18:07:09.048206] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 25.2s. Estimated remaining: 4h 19m 56s. Rate: 7.2 symbols/min [2025-10-16T18:07:09.226325] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:09.226525] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-16T18:07:09.226563] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-16T18:07:09.226709] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-16T18:07:09.226762] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-16T18:07:09.226806] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-16T18:07:09.226861] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-16T18:07:09.548055] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-16T18:07:09.589198] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:10.207544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:07:10.342827] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-16T18:07:11.080038] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:07:11.148398] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-16T18:07:11.162061] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:07:11.942780] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-16T18:07:12.653024] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T18:07:12.727281] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T18:07:12.742830] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-16T18:07:13.542815] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-16T18:07:14.106010] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:07:14.110453] [INFO ] [REMOTE ] CMTG: Full fetch complete (53421 records). [2025-10-16T18:07:14.110615] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-16T18:07:14.354629] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-16T18:07:14.525175] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-16T18:07:14.525264] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-16T18:07:14.526059] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-16T18:07:14.526124] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-16T18:07:14.527370] [DEBUG] [LOCAL ] CMTG: Trimmed 53421 records to 36073 (keeping 200 days of data) [2025-10-16T18:07:14.728474] [DEBUG] [LOCAL ] CMTG: Primary data saved (36073 records). [2025-10-16T18:07:14.728944] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-16T18:07:14.729227] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CMTG took 39.3s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-16T18:07:14.906979] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:07:14.933455] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:15.000792] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-16T18:07:15.001340] [INFO ] [MAIN ] CNH: Loaded 53552 existing records. [2025-10-16T18:07:15.055794] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T18:07:15.148019] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-16T18:07:15.219539] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:15.220015] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-16T18:07:15.220073] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-16T18:07:15.220480] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-16T18:07:15.220538] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-16T18:07:15.641409] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:15.942844] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-16T18:07:16.287054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:07:16.308740] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T18:07:16.742812] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-16T18:07:17.542855] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-16T18:07:18.103281] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:07:18.107572] [INFO ] [REMOTE ] CNA: Full fetch complete (46057 records). [2025-10-16T18:07:18.107724] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-16T18:07:18.348071] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-16T18:07:18.499734] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-16T18:07:18.499878] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-16T18:07:18.500670] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-16T18:07:18.500738] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-16T18:07:18.502053] [DEBUG] [LOCAL ] CNA: Trimmed 46057 records to 33156 (keeping 200 days of data) [2025-10-16T18:07:18.700435] [DEBUG] [LOCAL ] CNA: Primary data saved (33156 records). [2025-10-16T18:07:18.700591] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-16T18:07:18.701056] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNA took 33.0s. Estimated remaining: 4h 19m 13s. Rate: 7.3 symbols/min [2025-10-16T18:07:18.868557] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:18.919860] [DEBUG] [LOCAL ] CNI: Loaded 51698 existing records from primary storage. [2025-10-16T18:07:18.920186] [INFO ] [MAIN ] CNI: Loaded 51698 existing records. [2025-10-16T18:07:19.138130] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:19.138410] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-16T18:07:19.138463] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-16T18:07:19.138933] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-16T18:07:19.138991] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-16T18:07:19.170293] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-16T18:07:19.502534] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:19.532485] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T18:07:19.903241] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:07:19.942821] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-16T18:07:20.148310] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T18:07:20.509752] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:07:20.742862] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-16T18:07:21.542867] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-16T18:07:22.342800] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-16T18:07:22.448354] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:07:22.844758] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:07:23.142859] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-16T18:07:23.942845] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-16T18:07:24.162163] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-16T18:07:24.742779] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-16T18:07:24.846797] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:07:25.546194] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-16T18:07:25.548976] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:07:26.309449] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:07:26.342768] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-16T18:07:26.599043] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:07:27.142794] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-16T18:07:27.942825] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-16T18:07:27.953993] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T18:07:28.103282] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T18:07:28.742829] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-16T18:07:29.539050] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T18:07:29.548161] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-16T18:07:30.310460] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:07:30.342841] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-16T18:07:30.362832] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:07:31.142874] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-16T18:07:31.942855] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-16T18:07:32.186165] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:07:32.708431] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:07:32.742769] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-16T18:07:32.853589] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:07:33.542867] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-16T18:07:34.344041] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-16T18:07:34.349464] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:07:34.449076] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T18:07:35.142863] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-16T18:07:35.942892] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-16T18:07:36.277863] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T18:07:36.279703] [INFO ] [REMOTE ] CNF: Full fetch complete (13090 records). [2025-10-16T18:07:36.279868] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-16T18:07:36.421487] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-16T18:07:36.706722] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-16T18:07:36.706802] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-16T18:07:36.707086] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-16T18:07:36.707124] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-16T18:07:36.707605] [DEBUG] [LOCAL ] CNF: Trimmed 13090 records to 10646 (keeping 200 days of data) [2025-10-16T18:07:36.748870] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-16T18:07:36.766980] [DEBUG] [LOCAL ] CNF: Primary data saved (10646 records). [2025-10-16T18:07:36.767118] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-16T18:07:36.767190] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNF took 27.7s. Estimated remaining: 4h 19m 42s. Rate: 7.2 symbols/min [2025-10-16T18:07:36.934440] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:36.934631] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-16T18:07:36.934705] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-16T18:07:36.934821] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-16T18:07:36.934863] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-16T18:07:36.934904] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-16T18:07:36.934940] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-16T18:07:37.288414] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:37.547902] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-16T18:07:37.567334] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:07:38.342851] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-16T18:07:38.525382] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:07:39.004011] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:07:39.142796] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-16T18:07:39.628222] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:07:39.942814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-16T18:07:40.742951] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-16T18:07:41.512462] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:07:41.542767] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-16T18:07:41.716167] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-16T18:07:42.208712] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:07:42.342816] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-16T18:07:42.803015] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T18:07:43.142876] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-16T18:07:43.942803] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-16T18:07:44.003662] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:07:44.586929] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:07:44.742814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-16T18:07:45.542848] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-16T18:07:45.933070] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:07:46.342934] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-16T18:07:46.518494] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T18:07:47.119464] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:07:47.142779] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-16T18:07:47.767339] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:07:47.942819] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-16T18:07:48.742863] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-16T18:07:49.033051] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:07:49.542795] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-16T18:07:49.578764] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:07:50.342870] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-16T18:07:50.471759] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:07:50.478080] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-16T18:07:50.478204] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-16T18:07:50.478966] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:07:50.479062] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:07:50.479106] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:07:50.479145] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-16T18:07:50.479225] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-16T18:07:50.479271] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-16T18:07:50.479405] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-16T18:07:50.479493] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNH took 35.8s. Estimated remaining: 4h 19m 55s. Rate: 7.2 symbols/min [2025-10-16T18:07:50.651352] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:50.701373] [DEBUG] [LOCAL ] CNM: Loaded 51035 existing records from primary storage. [2025-10-16T18:07:50.701722] [INFO ] [MAIN ] CNM: Loaded 51035 existing records. [2025-10-16T18:07:50.873191] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:50.873438] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-16T18:07:50.873486] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-16T18:07:50.873931] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-16T18:07:50.873986] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-16T18:07:51.152521] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-16T18:07:51.248737] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:51.280696] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:07:51.942851] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-16T18:07:52.723868] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-16T18:07:52.742762] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-16T18:07:52.798534] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:07:53.542847] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-16T18:07:53.770376] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T18:07:53.776881] [INFO ] [REMOTE ] CNI: Full fetch complete (74842 records). [2025-10-16T18:07:53.777008] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-16T18:07:54.166425] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-16T18:07:54.166504] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-16T18:07:54.167394] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-16T18:07:54.167457] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-16T18:07:54.169019] [DEBUG] [LOCAL ] CNI: Trimmed 74842 records to 52078 (keeping 200 days of data) [2025-10-16T18:07:54.358178] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-16T18:07:54.509213] [DEBUG] [LOCAL ] CNI: Primary data saved (52078 records). [2025-10-16T18:07:54.509391] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-16T18:07:54.509902] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNI took 35.8s. Estimated remaining: 4h 19m 30s. Rate: 7.2 symbols/min [2025-10-16T18:07:54.679239] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:54.714255] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T18:07:54.749875] [DEBUG] [LOCAL ] CNMD: Loaded 32127 existing records from primary storage. [2025-10-16T18:07:54.750140] [INFO ] [MAIN ] CNMD: Loaded 32127 existing records. [2025-10-16T18:07:54.926456] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:54.926795] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-16T18:07:54.926868] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-16T18:07:54.927241] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-16T18:07:54.927307] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-16T18:07:55.110162] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:07:55.151888] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-16T18:07:55.423759] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:55.942828] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-16T18:07:55.999232] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:07:56.226055] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T18:07:56.232849] [INFO ] [REMOTE ] CNC: Full fetch complete (77847 records). [2025-10-16T18:07:56.232973] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-16T18:07:56.617731] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-16T18:07:56.617804] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-16T18:07:56.618705] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-16T18:07:56.618767] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-16T18:07:56.620193] [DEBUG] [LOCAL ] CNC: Trimmed 77847 records to 54160 (keeping 200 days of data) [2025-10-16T18:07:56.783968] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-16T18:07:56.944388] [DEBUG] [LOCAL ] CNC: Primary data saved (54160 records). [2025-10-16T18:07:56.944535] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-16T18:07:56.945215] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNC took 51.8s. Estimated remaining: 4h 18m 60s. Rate: 7.2 symbols/min [2025-10-16T18:07:57.119373] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:07:57.158573] [DEBUG] [LOCAL ] CNNE: Loaded 35946 existing records from primary storage. [2025-10-16T18:07:57.158889] [INFO ] [MAIN ] CNNE: Loaded 35946 existing records. [2025-10-16T18:07:57.339810] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:07:57.340088] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-16T18:07:57.340218] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-16T18:07:57.345786] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-16T18:07:57.354864] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-16T18:07:57.398528] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:07:57.548579] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-16T18:07:57.728613] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:07:58.236115] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:07:58.342836] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-16T18:07:58.975205] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T18:07:59.142886] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-16T18:07:59.526675] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:07:59.942824] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-16T18:08:00.742818] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-16T18:08:00.878187] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:08:01.375927] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:08:01.542784] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-16T18:08:01.836862] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:08:02.342802] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-16T18:08:02.679573] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T18:08:03.142857] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-16T18:08:03.943044] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-16T18:08:03.948955] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T18:08:04.637466] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:08:04.742799] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-16T18:08:05.118254] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:08:05.542888] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-16T18:08:05.865682] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:08:06.342789] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-16T18:08:06.917274] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:08:07.142854] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-16T18:08:07.416258] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:08:07.942808] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-16T18:08:08.742814] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-16T18:08:08.868106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:08:09.282676] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:08:09.542829] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-16T18:08:10.284134] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:08:10.342784] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-16T18:08:11.092113] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:08:11.142774] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-16T18:08:11.612599] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T18:08:11.942861] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-16T18:08:12.612181] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T18:08:12.742871] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-16T18:08:13.241263] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:08:13.542806] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-16T18:08:14.342841] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-16T18:08:14.456692] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T18:08:14.463405] [INFO ] [REMOTE ] CNK: Full fetch complete (76153 records). [2025-10-16T18:08:14.463515] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-16T18:08:14.855860] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-16T18:08:14.855974] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-16T18:08:14.856907] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-16T18:08:14.856982] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-16T18:08:14.858633] [DEBUG] [LOCAL ] CNK: Trimmed 76153 records to 53289 (keeping 200 days of data) [2025-10-16T18:08:14.988776] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:08:15.143793] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-16T18:08:15.233341] [DEBUG] [LOCAL ] CNK: Primary data saved (53289 records). [2025-10-16T18:08:15.233501] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-16T18:08:15.233578] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNK took 38.5s. Estimated remaining: 4h 19m 29s. Rate: 7.2 symbols/min [2025-10-16T18:08:15.404853] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:15.441672] [DEBUG] [LOCAL ] CNO: Loaded 40648 existing records from primary storage. [2025-10-16T18:08:15.442022] [INFO ] [MAIN ] CNO: Loaded 40648 existing records. [2025-10-16T18:08:15.620336] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:15.620581] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-16T18:08:15.620681] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-16T18:08:15.621027] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-16T18:08:15.621165] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-16T18:08:15.893513] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T18:08:15.943630] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-16T18:08:16.030557] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:16.742789] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-16T18:08:17.022139] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:08:17.163522] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:08:17.542811] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-16T18:08:18.136024] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:08:18.342809] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-16T18:08:18.683455] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:08:19.142807] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-16T18:08:19.905807] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:08:19.942771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-16T18:08:20.266879] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:08:20.742821] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-16T18:08:21.542810] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-16T18:08:21.615600] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:08:21.620363] [INFO ] [REMOTE ] CNNE: Full fetch complete (50560 records). [2025-10-16T18:08:21.620463] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-16T18:08:22.000719] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-16T18:08:22.000824] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-16T18:08:22.001630] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-16T18:08:22.001768] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-16T18:08:22.019793] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:08:22.026309] [DEBUG] [LOCAL ] CNNE: Trimmed 50560 records to 36234 (keeping 200 days of data) [2025-10-16T18:08:22.268043] [DEBUG] [LOCAL ] CNNE: Primary data saved (36234 records). [2025-10-16T18:08:22.268252] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-16T18:08:22.268395] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNNE took 25.3s. Estimated remaining: 4h 19m 16s. Rate: 7.2 symbols/min [2025-10-16T18:08:22.347945] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-16T18:08:22.463601] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:22.515574] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-16T18:08:22.515932] [INFO ] [MAIN ] CNP: Loaded 53480 existing records. [2025-10-16T18:08:22.724626] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:22.724853] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-16T18:08:22.724901] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-16T18:08:22.725092] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-16T18:08:22.725131] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-16T18:08:23.141269] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:23.150406] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-16T18:08:23.167739] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:08:23.423416] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T18:08:23.427686] [INFO ] [REMOTE ] CNMD: Full fetch complete (47223 records). [2025-10-16T18:08:23.427781] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-16T18:08:23.835145] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-16T18:08:23.835241] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-16T18:08:23.836001] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-16T18:08:23.836067] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-16T18:08:23.837563] [DEBUG] [LOCAL ] CNMD: Trimmed 47223 records to 32319 (keeping 200 days of data) [2025-10-16T18:08:23.943730] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-16T18:08:24.035629] [DEBUG] [LOCAL ] CNMD: Primary data saved (32319 records). [2025-10-16T18:08:24.035791] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-16T18:08:24.036159] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNMD took 29.5s. Estimated remaining: 4h 18m 43s. Rate: 7.2 symbols/min [2025-10-16T18:08:24.199176] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:24.248691] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-16T18:08:24.249064] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-10-16T18:08:24.431880] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:24.432051] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-16T18:08:24.432099] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-16T18:08:24.432306] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-16T18:08:24.432363] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-16T18:08:24.743698] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-16T18:08:24.804611] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:24.839772] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:08:25.542784] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-16T18:08:25.703590] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:08:26.195494] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:08:26.342803] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-16T18:08:27.139538] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:08:27.150099] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-16T18:08:27.572871] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:08:27.942856] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-16T18:08:28.742811] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-16T18:08:29.084880] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:08:29.542794] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-16T18:08:29.574824] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:08:30.003088] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:08:30.342815] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-16T18:08:31.142794] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-16T18:08:31.309797] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:08:31.576000] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:08:31.942821] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-16T18:08:32.128338] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:08:32.742871] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-16T18:08:33.542779] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-16T18:08:33.752154] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:08:33.869846] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T18:08:34.342864] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-16T18:08:35.142791] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-16T18:08:35.312617] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:08:35.942810] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-16T18:08:36.047561] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T18:08:36.707285] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T18:08:36.742804] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-16T18:08:37.542781] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-16T18:08:37.633272] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:08:38.304400] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:08:38.342777] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-16T18:08:38.898003] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:08:39.142819] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-16T18:08:39.859794] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:08:39.865130] [INFO ] [REMOTE ] CNO: Full fetch complete (60834 records). [2025-10-16T18:08:39.865275] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-16T18:08:39.947939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-16T18:08:40.247344] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-16T18:08:40.247428] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-16T18:08:40.248250] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-16T18:08:40.248317] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-16T18:08:40.249571] [DEBUG] [LOCAL ] CNO: Trimmed 60834 records to 40958 (keeping 200 days of data) [2025-10-16T18:08:40.493158] [DEBUG] [LOCAL ] CNO: Primary data saved (40958 records). [2025-10-16T18:08:40.493313] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-16T18:08:40.493406] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 25.3s. Estimated remaining: 4h 19m 6s. Rate: 7.2 symbols/min [2025-10-16T18:08:40.658473] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:40.658710] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-16T18:08:40.658759] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-16T18:08:40.658893] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-16T18:08:40.658961] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-16T18:08:40.659021] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-16T18:08:40.659065] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-16T18:08:40.748784] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-16T18:08:41.025329] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:41.056817] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T18:08:41.542852] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-16T18:08:41.803502] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:08:41.803834] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-16T18:08:41.804041] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:08:41.804133] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-16T18:08:41.832311] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:08:41.832966] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-16T18:08:41.834104] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:08:41.834207] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-16T18:08:41.844806] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-16T18:08:41.845233] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-16T18:08:41.845636] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNR took 1.4s. Estimated remaining: 4h 18m 31s. Rate: 7.2 symbols/min [2025-10-16T18:08:42.022964] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:42.045113] [DEBUG] [LOCAL ] CNS: Loaded 21154 existing records from primary storage. [2025-10-16T18:08:42.045366] [INFO ] [MAIN ] CNS: Loaded 21154 existing records. [2025-10-16T18:08:42.232455] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:42.232760] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-16T18:08:42.232931] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-16T18:08:42.233194] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-16T18:08:42.233320] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-16T18:08:42.347148] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-16T18:08:42.566585] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:08:42.656019] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:43.142814] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-16T18:08:43.942779] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-16T18:08:44.180796] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T18:08:44.373713] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:08:44.742816] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-16T18:08:45.529784] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:08:45.542778] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-16T18:08:46.342851] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-16T18:08:46.437707] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T18:08:47.142812] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-16T18:08:47.180044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:08:47.903105] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:08:47.910616] [INFO ] [REMOTE ] CNM: Full fetch complete (73758 records). [2025-10-16T18:08:47.910824] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-16T18:08:47.950368] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-16T18:08:48.360342] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-16T18:08:48.360426] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-16T18:08:48.361364] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-16T18:08:48.361439] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-16T18:08:48.362871] [DEBUG] [LOCAL ] CNM: Trimmed 73758 records to 51414 (keeping 200 days of data) [2025-10-16T18:08:48.669016] [DEBUG] [LOCAL ] CNM: Primary data saved (51414 records). [2025-10-16T18:08:48.669160] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-16T18:08:48.670004] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNM took 58.2s. Estimated remaining: 4h 18m 18s. Rate: 7.2 symbols/min [2025-10-16T18:08:48.745265] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-16T18:08:48.847753] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:08:48.898035] [DEBUG] [LOCAL ] CNX: Loaded 51367 existing records from primary storage. [2025-10-16T18:08:48.898576] [INFO ] [MAIN ] CNX: Loaded 51367 existing records. [2025-10-16T18:08:49.112403] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:08:49.115486] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-16T18:08:49.115324] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T18:08:49.115685] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-16T18:08:49.126517] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-16T18:08:49.126578] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-16T18:08:49.484757] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:08:49.542774] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-16T18:08:49.568682] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T18:08:49.860815] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T18:08:50.342839] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-16T18:08:50.954440] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:08:50.997822] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T18:08:51.142816] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-16T18:08:51.942848] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-16T18:08:52.376563] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T18:08:52.742857] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-16T18:08:53.430239] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T18:08:53.542833] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-16T18:08:53.888738] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:08:54.343016] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-16T18:08:55.144138] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-16T18:08:55.149951] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T18:08:55.443504] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:08:55.942811] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-16T18:08:56.742829] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-16T18:08:57.102191] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T18:08:57.431723] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T18:08:57.542791] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-16T18:08:57.638332] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:08:58.342813] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-16T18:08:59.142814] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-16T18:08:59.359572] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:08:59.947939] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-16T18:08:59.964865] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:09:00.660540] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T18:09:00.742792] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-16T18:09:01.155631] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T18:09:01.542814] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-16T18:09:02.342787] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-16T18:09:02.451843] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:09:02.753033] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:09:03.142782] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-16T18:09:03.942798] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-16T18:09:04.166155] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T18:09:04.173200] [INFO ] [REMOTE ] CNP: Full fetch complete (77548 records). [2025-10-16T18:09:04.173350] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-16T18:09:04.615064] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-16T18:09:04.615182] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-16T18:09:04.616437] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-16T18:09:04.616533] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-16T18:09:04.618286] [DEBUG] [LOCAL ] CNP: Trimmed 77548 records to 53869 (keeping 200 days of data) [2025-10-16T18:09:04.748704] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-16T18:09:04.895038] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:09:05.014109] [DEBUG] [LOCAL ] CNP: Primary data saved (53869 records). [2025-10-16T18:09:05.014252] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-16T18:09:05.014971] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNP took 42.7s. Estimated remaining: 4h 18m 40s. Rate: 7.2 symbols/min [2025-10-16T18:09:05.184737] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:05.223420] [DEBUG] [LOCAL ] CODI: Loaded 41441 existing records from primary storage. [2025-10-16T18:09:05.223775] [INFO ] [MAIN ] CODI: Loaded 41441 existing records. [2025-10-16T18:09:05.407615] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:05.407860] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-16T18:09:05.407923] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-16T18:09:05.408293] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-16T18:09:05.408349] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-16T18:09:05.550406] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-16T18:09:05.772157] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:05.799408] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T18:09:06.021676] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T18:09:06.342875] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-16T18:09:07.142864] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-16T18:09:07.681418] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-16T18:09:07.688358] [INFO ] [REMOTE ] CNQ: Full fetch complete (77739 records). [2025-10-16T18:09:07.688492] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-16T18:09:07.950229] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-16T18:09:08.122315] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-16T18:09:08.122444] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-16T18:09:08.123505] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-16T18:09:08.123588] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-16T18:09:08.125155] [DEBUG] [LOCAL ] CNQ: Trimmed 77739 records to 53972 (keeping 200 days of data) [2025-10-16T18:09:08.398536] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T18:09:08.398156] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:09:08.416223] [INFO ] [REMOTE ] CNS: Full fetch complete (30884 records). [2025-10-16T18:09:08.424920] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-16T18:09:08.744188] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-16T18:09:08.935227] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-16T18:09:08.937535] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-16T18:09:08.939520] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-16T18:09:08.941580] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-16T18:09:08.945667] [DEBUG] [LOCAL ] CNS: Trimmed 30884 records to 21369 (keeping 200 days of data) [2025-10-16T18:09:09.022986] [DEBUG] [LOCAL ] CNQ: Primary data saved (53972 records). [2025-10-16T18:09:09.032942] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-16T18:09:09.061852] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T18:09:09.060772] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNQ took 45.0s. Estimated remaining: 4h 18m 15s. Rate: 7.2 symbols/min [2025-10-16T18:09:09.257780] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:09.289682] [DEBUG] [LOCAL ] CNS: Primary data saved (21369 records). [2025-10-16T18:09:09.289823] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-16T18:09:09.289900] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNS took 27.4s. Estimated remaining: 4h 17m 37s. Rate: 7.3 symbols/min [2025-10-16T18:09:09.477121] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:09.493049] [DEBUG] [LOCAL ] COF: Loaded 53622 existing records from primary storage. [2025-10-16T18:09:09.493450] [INFO ] [MAIN ] COF: Loaded 53622 existing records. [2025-10-16T18:09:09.555774] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-16T18:09:09.680599] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:09.681166] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-16T18:09:09.681237] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-16T18:09:09.681728] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-16T18:09:09.681797] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-16T18:09:09.953315] [DEBUG] [LOCAL ] COHR: Loaded 53381 existing records from primary storage. [2025-10-16T18:09:09.979815] [INFO ] [MAIN ] COHR: Loaded 53381 existing records. [2025-10-16T18:09:10.223801] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:10.265898] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:10.266255] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-16T18:09:10.266405] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-16T18:09:10.266674] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-16T18:09:10.266734] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-16T18:09:10.347889] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-16T18:09:10.657215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:09:10.704948] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T18:09:10.734858] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:11.142809] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-16T18:09:11.942807] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-16T18:09:12.052074] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:09:12.156803] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:09:12.742813] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-16T18:09:13.542836] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-16T18:09:13.666999] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:09:14.342820] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-16T18:09:14.473858] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T18:09:15.142887] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-16T18:09:15.474667] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:09:15.660898] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:09:15.942815] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-16T18:09:16.742844] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-16T18:09:17.068098] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-16T18:09:17.542792] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-16T18:09:17.758758] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:09:17.788215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T18:09:18.342813] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-16T18:09:19.142780] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-16T18:09:19.488628] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T18:09:19.942835] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-16T18:09:20.365045] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-16T18:09:20.742850] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-16T18:09:20.954141] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T18:09:20.960902] [INFO ] [REMOTE ] CNX: Full fetch complete (74939 records). [2025-10-16T18:09:20.961053] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-16T18:09:21.344244] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-16T18:09:21.344327] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-16T18:09:21.345236] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-16T18:09:21.345300] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-16T18:09:21.346719] [DEBUG] [LOCAL ] CNX: Trimmed 74939 records to 51742 (keeping 200 days of data) [2025-10-16T18:09:21.543274] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-16T18:09:21.646215] [DEBUG] [LOCAL ] CNX: Primary data saved (51742 records). [2025-10-16T18:09:21.646347] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-16T18:09:21.647048] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CNX took 33.0s. Estimated remaining: 4h 17m 44s. Rate: 7.2 symbols/min [2025-10-16T18:09:21.821108] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:21.874186] [DEBUG] [LOCAL ] COLD: Loaded 52391 existing records from primary storage. [2025-10-16T18:09:21.874501] [INFO ] [MAIN ] COLD: Loaded 52391 existing records. [2025-10-16T18:09:22.054280] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:22.054801] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-16T18:09:22.055060] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-16T18:09:22.055400] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-16T18:09:22.055530] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-16T18:09:22.212755] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-16T18:09:22.342893] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-16T18:09:22.412755] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:09:22.491812] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:23.142834] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-16T18:09:23.383283] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T18:09:23.950574] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-16T18:09:23.956395] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:09:24.456479] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:09:24.742872] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-16T18:09:25.542837] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-16T18:09:25.696261] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:09:26.342796] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-16T18:09:26.422321] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:09:27.142820] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-16T18:09:27.224008] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:09:27.942803] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-16T18:09:28.006768] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:09:28.742843] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-16T18:09:28.981153] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:09:29.125147] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T18:09:29.542805] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-16T18:09:30.342771] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-16T18:09:30.556391] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T18:09:30.836165] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:09:31.142865] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-16T18:09:31.942840] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-16T18:09:32.025313] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:09:32.277037] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:09:32.742814] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-16T18:09:33.542795] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-16T18:09:34.002853] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:09:34.342795] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-16T18:09:34.395805] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:09:34.401804] [INFO ] [REMOTE ] CODI: Full fetch complete (52860 records). [2025-10-16T18:09:34.401913] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-16T18:09:34.787214] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-16T18:09:34.787319] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-16T18:09:34.788139] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-16T18:09:34.788222] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-16T18:09:34.789597] [DEBUG] [LOCAL ] CODI: Trimmed 52860 records to 41807 (keeping 200 days of data) [2025-10-16T18:09:35.058979] [DEBUG] [LOCAL ] CODI: Primary data saved (41807 records). [2025-10-16T18:09:35.059757] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-16T18:09:35.059881] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 30.0s. Estimated remaining: 4h 17m 55s. Rate: 7.2 symbols/min [2025-10-16T18:09:35.061177] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:09:35.147102] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-16T18:09:35.253743] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:35.303551] [DEBUG] [LOCAL ] COMP: Loaded 53406 existing records from primary storage. [2025-10-16T18:09:35.303967] [INFO ] [MAIN ] COMP: Loaded 53406 existing records. [2025-10-16T18:09:35.476094] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:35.476334] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-16T18:09:35.476406] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-16T18:09:35.476834] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-16T18:09:35.476891] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-16T18:09:35.822487] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:35.942789] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-16T18:09:36.455323] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T18:09:36.742809] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-16T18:09:37.542849] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-16T18:09:37.601322] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-16T18:09:37.679764] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:09:38.342794] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-16T18:09:38.449368] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T18:09:38.878865] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:09:39.142884] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-16T18:09:39.949096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-16T18:09:39.959569] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:09:40.742820] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-16T18:09:41.453390] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-16T18:09:41.460305] [INFO ] [REMOTE ] COHR: Full fetch complete (77056 records). [2025-10-16T18:09:41.460453] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-16T18:09:41.461466] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:09:41.461619] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:09:41.461815] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:09:41.461931] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-16T18:09:41.462001] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-16T18:09:41.462105] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-16T18:09:41.462275] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-16T18:09:41.462848] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COHR took 32.2s. Estimated remaining: 4h 17m 39s. Rate: 7.2 symbols/min [2025-10-16T18:09:41.553696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-16T18:09:41.645192] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:41.675531] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:09:41.728730] [DEBUG] [LOCAL ] CON: Loaded 38935 existing records from primary storage. [2025-10-16T18:09:41.729086] [INFO ] [MAIN ] CON: Loaded 38935 existing records. [2025-10-16T18:09:41.905451] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:41.905681] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-16T18:09:41.905739] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-16T18:09:41.905971] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-16T18:09:41.906008] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-16T18:09:42.263178] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:42.342795] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-16T18:09:42.677300] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:09:42.965604] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:09:43.142814] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-16T18:09:43.942808] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-16T18:09:44.006570] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:09:44.356772] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-16T18:09:44.364332] [INFO ] [REMOTE ] COF: Full fetch complete (77647 records). [2025-10-16T18:09:44.364472] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-16T18:09:44.759474] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-16T18:09:44.755383] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-16T18:09:44.759913] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-16T18:09:44.762425] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-16T18:09:44.762635] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-16T18:09:44.795066] [DEBUG] [LOCAL ] COF: Trimmed 77647 records to 54012 (keeping 200 days of data) [2025-10-16T18:09:44.796668] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:09:45.146728] [DEBUG] [LOCAL ] COF: Primary data saved (54012 records). [2025-10-16T18:09:45.146879] [INFO ] [MAIN ] COF: Full history saved. [2025-10-16T18:09:45.147237] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COF took 36.1s. Estimated remaining: 4h 17m 14s. Rate: 7.2 symbols/min [2025-10-16T18:09:45.312016] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:09:45.339979] [DEBUG] [LOCAL ] COOK: Loaded 24994 existing records from primary storage. [2025-10-16T18:09:45.340278] [INFO ] [MAIN ] COOK: Loaded 24994 existing records. [2025-10-16T18:09:45.525537] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:09:45.525841] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-16T18:09:45.525900] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-16T18:09:45.526133] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-16T18:09:45.526188] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-16T18:09:45.548052] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-16T18:09:45.880485] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:09:45.911631] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:09:46.342820] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-16T18:09:46.953254] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:09:47.142843] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-16T18:09:47.647260] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T18:09:47.942815] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-16T18:09:48.346456] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:09:48.742812] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-16T18:09:49.205546] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T18:09:49.542859] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-16T18:09:50.342806] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-16T18:09:50.579586] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:09:50.812579] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:09:51.142850] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-16T18:09:51.942848] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-16T18:09:52.372605] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-16T18:09:52.742830] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-16T18:09:53.116744] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T18:09:53.247402] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-16T18:09:53.340276] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:09:53.542821] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-16T18:09:54.342898] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-16T18:09:55.142822] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-16T18:09:55.283822] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:09:55.866867] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:09:55.932809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:09:55.942772] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-16T18:09:56.742859] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-16T18:09:57.464208] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:09:57.531507] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T18:09:57.542761] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-16T18:09:58.342831] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-16T18:09:58.954948] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T18:09:59.142874] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-16T18:09:59.942848] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-16T18:10:00.094005] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:10:00.128132] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:10:00.742810] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-16T18:10:01.542872] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-16T18:10:02.301135] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-16T18:10:02.308071] [INFO ] [REMOTE ] COLD: Full fetch complete (74737 records). [2025-10-16T18:10:02.308226] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-16T18:10:02.352335] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-16T18:10:02.716309] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-16T18:10:02.721723] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-16T18:10:02.731362] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-16T18:10:02.731520] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-16T18:10:02.733461] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T18:10:02.740223] [DEBUG] [LOCAL ] COLD: Trimmed 74737 records to 52781 (keeping 200 days of data) [2025-10-16T18:10:03.021728] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-16T18:10:03.116906] [DEBUG] [LOCAL ] COLD: Primary data saved (52781 records). [2025-10-16T18:10:03.117087] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-16T18:10:03.117784] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COLD took 41.5s. Estimated remaining: 4h 17m 42s. Rate: 7.2 symbols/min [2025-10-16T18:10:03.148462] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-16T18:10:03.290185] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:03.344357] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-16T18:10:03.344701] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-16T18:10:03.519333] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:03.519534] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-16T18:10:03.519580] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-16T18:10:03.519783] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-16T18:10:03.519839] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-16T18:10:03.870964] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:03.942779] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-16T18:10:04.111763] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:10:04.182109] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:10:04.742822] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-16T18:10:05.542794] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-16T18:10:05.704109] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:10:06.342854] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-16T18:10:06.443131] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T18:10:07.015903] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:10:07.021998] [INFO ] [REMOTE ] CON: Full fetch complete (56944 records). [2025-10-16T18:10:07.022126] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-16T18:10:07.144530] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-16T18:10:07.398024] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:10:07.491572] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-16T18:10:07.491677] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-16T18:10:07.492433] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-16T18:10:07.492475] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-16T18:10:07.493506] [DEBUG] [LOCAL ] CON: Trimmed 56944 records to 39243 (keeping 200 days of data) [2025-10-16T18:10:07.722316] [DEBUG] [LOCAL ] CON: Primary data saved (39243 records). [2025-10-16T18:10:07.722448] [INFO ] [MAIN ] CON: Full history saved. [2025-10-16T18:10:07.722525] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. CON took 26.3s. Estimated remaining: 4h 17m 20s. Rate: 7.2 symbols/min [2025-10-16T18:10:07.913440] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:07.942817] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-16T18:10:07.957492] [DEBUG] [LOCAL ] COR: Loaded 46611 existing records from primary storage. [2025-10-16T18:10:07.958021] [INFO ] [MAIN ] COR: Loaded 46611 existing records. [2025-10-16T18:10:08.128554] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:08.128744] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-16T18:10:08.128813] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-16T18:10:08.129171] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-16T18:10:08.129215] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-16T18:10:08.465015] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:08.742814] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-16T18:10:09.171479] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T18:10:09.542854] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-16T18:10:09.814793] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T18:10:10.274085] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:10:10.342808] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-16T18:10:11.148064] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-16T18:10:11.162471] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:10:11.942790] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-16T18:10:12.196504] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T18:10:12.742793] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-16T18:10:12.990417] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:10:13.542849] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-16T18:10:13.875793] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:10:14.233310] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-16T18:10:14.342819] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-16T18:10:15.142786] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-16T18:10:15.533300] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T18:10:15.902745] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:10:15.942778] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-16T18:10:16.742787] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-16T18:10:17.106309] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:10:17.118114] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:10:17.126059] [INFO ] [REMOTE ] COOK: Full fetch complete (33194 records). [2025-10-16T18:10:17.126246] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-16T18:10:17.126550] [INFO ] [REMOTE ] COMP: Full fetch complete (77392 records). [2025-10-16T18:10:17.170016] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-16T18:10:17.546711] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-16T18:10:17.819382] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-16T18:10:17.824614] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-16T18:10:17.842799] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-16T18:10:17.852598] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-16T18:10:17.902970] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-16T18:10:17.903201] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-16T18:10:17.903131] [DEBUG] [LOCAL ] COOK: Trimmed 33194 records to 25126 (keeping 200 days of data) [2025-10-16T18:10:17.904374] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-16T18:10:17.904468] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-16T18:10:17.947184] [DEBUG] [LOCAL ] COMP: Trimmed 77392 records to 53796 (keeping 200 days of data) [2025-10-16T18:10:18.143978] [DEBUG] [LOCAL ] COOK: Primary data saved (25126 records). [2025-10-16T18:10:18.144609] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-16T18:10:18.144964] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COOK took 33.0s. Estimated remaining: 4h 17m 19s. Rate: 7.2 symbols/min [2025-10-16T18:10:18.372154] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:18.533738] [DEBUG] [LOCAL ] COTY: Loaded 53271 existing records from primary storage. [2025-10-16T18:10:18.539794] [INFO ] [MAIN ] COTY: Loaded 53271 existing records. [2025-10-16T18:10:18.669592] [DEBUG] [LOCAL ] COMP: Primary data saved (53796 records). [2025-10-16T18:10:18.729992] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-16T18:10:18.763805] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:18.773384] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COMP took 43.7s. Estimated remaining: 4h 16m 43s. Rate: 7.2 symbols/min [2025-10-16T18:10:18.778976] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-16T18:10:18.806009] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-16T18:10:18.834212] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:10:18.843117] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-16T18:10:18.865963] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-16T18:10:18.896741] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-16T18:10:19.125764] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:19.327768] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:19.328298] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-16T18:10:19.373347] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:10:19.400516] [DEBUG] [LOCAL ] COUR: Loaded 49310 existing records from primary storage. [2025-10-16T18:10:19.400897] [INFO ] [MAIN ] COUR: Loaded 49310 existing records. [2025-10-16T18:10:19.603849] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:19.604097] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-16T18:10:19.604161] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-16T18:10:19.604564] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-16T18:10:19.604621] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-16T18:10:19.947982] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-16T18:10:20.028412] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:20.742783] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-16T18:10:21.031703] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-16T18:10:21.212505] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T18:10:21.542822] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-16T18:10:21.636794] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:10:22.052254] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:10:22.342840] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-16T18:10:23.142828] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-16T18:10:23.613489] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T18:10:23.942875] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-16T18:10:24.214632] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T18:10:24.742815] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-16T18:10:24.806605] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:10:25.542832] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-16T18:10:25.828369] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T18:10:26.342793] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-16T18:10:26.561441] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:10:27.142867] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-16T18:10:27.238676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T18:10:27.942879] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-16T18:10:28.017104] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:10:28.746372] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-16T18:10:28.751153] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:10:29.477937] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:10:29.542777] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-16T18:10:30.342878] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-16T18:10:30.414198] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:10:31.142847] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-16T18:10:31.395221] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:10:31.942792] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-16T18:10:32.399637] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:10:32.623143] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T18:10:32.742845] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-16T18:10:33.542800] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-16T18:10:33.648167] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T18:10:34.295902] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T18:10:34.342775] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-16T18:10:35.142814] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-16T18:10:35.272733] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:10:35.889222] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T18:10:35.942797] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-16T18:10:36.549724] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:10:36.742854] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-16T18:10:37.259583] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:10:37.265453] [INFO ] [REMOTE ] COR: Full fetch complete (68592 records). [2025-10-16T18:10:37.265632] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-16T18:10:37.548030] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-16T18:10:37.690860] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-16T18:10:37.690988] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-16T18:10:37.692479] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-16T18:10:37.692554] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-16T18:10:37.694503] [DEBUG] [LOCAL ] COR: Trimmed 68592 records to 46937 (keeping 200 days of data) [2025-10-16T18:10:38.014939] [DEBUG] [LOCAL ] COR: Primary data saved (46937 records). [2025-10-16T18:10:38.015156] [INFO ] [MAIN ] COR: Full history saved. [2025-10-16T18:10:38.016174] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COR took 30.3s. Estimated remaining: 4h 17m 15s. Rate: 7.2 symbols/min [2025-10-16T18:10:38.206832] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:38.267492] [DEBUG] [LOCAL ] CP: Loaded 53238 existing records from primary storage. [2025-10-16T18:10:38.267958] [INFO ] [MAIN ] CP: Loaded 53238 existing records. [2025-10-16T18:10:38.358245] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-16T18:10:38.465365] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:38.465702] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-16T18:10:38.465938] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-16T18:10:38.485993] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-16T18:10:38.486767] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-16T18:10:38.488244] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:10:38.564626] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-16T18:10:38.576198] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-16T18:10:38.728616] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T18:10:39.187548] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-16T18:10:39.205798] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:39.304866] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-16T18:10:39.304947] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-16T18:10:39.305900] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-16T18:10:39.305964] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-16T18:10:39.307399] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54117 (keeping 200 days of data) [2025-10-16T18:10:39.631864] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-16T18:10:39.632148] [INFO ] [MAIN ] COP: Full history saved. [2025-10-16T18:10:39.633001] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COP took 36.5s. Estimated remaining: 4h 16m 42s. Rate: 7.2 symbols/min [2025-10-16T18:10:39.797924] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:39.827361] [DEBUG] [LOCAL ] CPA: Loaded 28423 existing records from primary storage. [2025-10-16T18:10:39.827677] [INFO ] [MAIN ] CPA: Loaded 28423 existing records. [2025-10-16T18:10:39.947928] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-16T18:10:40.013268] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:40.013741] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-16T18:10:40.013823] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-16T18:10:40.014050] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-16T18:10:40.014108] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-16T18:10:40.368920] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:40.397177] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T18:10:40.504421] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:10:40.742819] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-16T18:10:41.519941] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:10:41.542769] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-16T18:10:42.342808] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-16T18:10:42.414576] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T18:10:43.097621] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:10:43.142778] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-16T18:10:43.466232] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:10:43.942867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-16T18:10:44.742840] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-16T18:10:44.827224] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:10:45.542842] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-16T18:10:45.679434] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:10:46.342797] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-16T18:10:46.405320] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:10:47.142782] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-16T18:10:47.669524] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-16T18:10:47.715405] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T18:10:47.942846] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-16T18:10:48.742818] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-16T18:10:48.962905] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T18:10:49.086938] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T18:10:49.542834] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-16T18:10:50.342891] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-16T18:10:50.563616] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:10:51.142910] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-16T18:10:51.415339] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T18:10:51.673327] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:10:51.942799] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-16T18:10:52.742809] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-16T18:10:53.542908] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-16T18:10:54.290615] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T18:10:54.342815] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-16T18:10:54.982883] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:10:55.142803] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-16T18:10:55.942313] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:10:55.949676] [INFO ] [REMOTE ] COTY: Full fetch complete (77290 records). [2025-10-16T18:10:55.949812] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-16T18:10:56.379271] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-16T18:10:56.379398] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-16T18:10:56.380594] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-16T18:10:56.380751] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-16T18:10:56.382365] [DEBUG] [LOCAL ] COTY: Trimmed 77290 records to 53658 (keeping 200 days of data) [2025-10-16T18:10:56.525393] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (5.38 seconds). [2025-10-16T18:10:56.526572] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T18:10:56.571850] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-16T18:10:56.745436] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-16T18:10:56.770608] [DEBUG] [LOCAL ] COTY: Primary data saved (53658 records). [2025-10-16T18:10:56.770776] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-16T18:10:56.770873] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COTY took 38.6s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-16T18:10:56.943871] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:56.944052] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-16T18:10:56.944089] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-16T18:10:56.944200] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-16T18:10:56.944241] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-16T18:10:56.944280] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-16T18:10:56.944313] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-16T18:10:57.351220] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (5.41 seconds). [2025-10-16T18:10:57.383030] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:57.390099] [INFO ] [REMOTE ] COUR: Full fetch complete (71042 records). [2025-10-16T18:10:57.390250] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-16T18:10:57.547966] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-16T18:10:57.811605] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-16T18:10:57.811810] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-16T18:10:57.812691] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-16T18:10:57.812915] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-16T18:10:57.832954] [DEBUG] [LOCAL ] COUR: Trimmed 71042 records to 49681 (keeping 200 days of data) [2025-10-16T18:10:57.835249] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T18:10:58.176973] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:10:58.183615] [DEBUG] [LOCAL ] COUR: Primary data saved (49681 records). [2025-10-16T18:10:58.183969] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-16T18:10:58.194278] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COUR took 39.4s. Estimated remaining: 4h 16m 33s. Rate: 7.2 symbols/min [2025-10-16T18:10:58.304441] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-16T18:10:58.351773] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-16T18:10:58.379688] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:10:58.411885] [DEBUG] [LOCAL ] CPAY: Loaded 30434 existing records from primary storage. [2025-10-16T18:10:58.412201] [INFO ] [MAIN ] CPAY: Loaded 30434 existing records. [2025-10-16T18:10:58.592741] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:10:58.593004] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-16T18:10:58.593056] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-16T18:10:58.593397] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-16T18:10:58.593453] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-16T18:10:58.778469] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:10:58.971937] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:10:59.142815] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-16T18:10:59.445059] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:10:59.942896] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-16T18:11:00.742855] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-16T18:11:01.097472] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T18:11:01.360976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:11:01.542891] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-16T18:11:02.342835] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-16T18:11:02.766165] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T18:11:03.055546] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:11:03.142808] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-16T18:11:03.942818] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-16T18:11:04.540211] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:11:04.742800] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-16T18:11:05.398753] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:11:05.542796] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-16T18:11:06.337142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:11:06.346185] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-16T18:11:06.943366] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:11:07.142822] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-16T18:11:07.672215] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:11:07.942827] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-16T18:11:08.339702] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T18:11:08.509921] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:11:08.742821] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-16T18:11:09.542832] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-16T18:11:10.342875] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-16T18:11:10.566098] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:11:10.631341] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T18:11:10.765048] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T18:11:11.142829] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-16T18:11:11.942801] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-16T18:11:12.742790] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-16T18:11:12.865068] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:11:12.871882] [INFO ] [REMOTE ] CP: Full fetch complete (77299 records). [2025-10-16T18:11:12.872036] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-16T18:11:13.264483] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-16T18:11:13.264584] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-16T18:11:13.265718] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-16T18:11:13.265846] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-16T18:11:13.267490] [DEBUG] [LOCAL ] CP: Trimmed 77299 records to 53628 (keeping 200 days of data) [2025-10-16T18:11:13.380944] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:11:13.570612] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-16T18:11:13.618468] [DEBUG] [LOCAL ] CP: Primary data saved (53628 records). [2025-10-16T18:11:13.618586] [INFO ] [MAIN ] CP: Full history saved. [2025-10-16T18:11:13.619321] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CP took 35.6s. Estimated remaining: 4h 16m 50s. Rate: 7.2 symbols/min [2025-10-16T18:11:13.784024] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:13.801249] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-16T18:11:13.801440] [INFO ] [MAIN ] CPF: Loaded 15271 existing records. [2025-10-16T18:11:14.008180] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:14.008383] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-16T18:11:14.008456] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-16T18:11:14.008910] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-16T18:11:14.009027] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-16T18:11:14.092372] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:11:14.122053] [INFO ] [REMOTE ] CPA: Full fetch complete (41436 records). [2025-10-16T18:11:14.122396] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-16T18:11:14.353323] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-16T18:11:14.749801] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:14.760435] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-16T18:11:14.760808] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-16T18:11:14.761945] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-16T18:11:14.762083] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-16T18:11:14.763271] [DEBUG] [LOCAL ] CPA: Trimmed 41436 records to 28578 (keeping 200 days of data) [2025-10-16T18:11:14.959994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T18:11:14.963793] [DEBUG] [LOCAL ] CPA: Primary data saved (28578 records). [2025-10-16T18:11:14.971749] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-16T18:11:14.974936] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T18:11:14.974826] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPA took 35.3s. Estimated remaining: 4h 16m 17s. Rate: 7.2 symbols/min [2025-10-16T18:11:15.148558] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:15.148711] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-16T18:11:15.165132] [DEBUG] [LOCAL ] CPK: Loaded 13940 existing records from primary storage. [2025-10-16T18:11:15.165386] [INFO ] [MAIN ] CPK: Loaded 13940 existing records. [2025-10-16T18:11:15.341951] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:15.342170] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-16T18:11:15.342245] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-16T18:11:15.342560] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-16T18:11:15.342603] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-16T18:11:15.698912] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:15.942858] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-16T18:11:16.298778] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:11:16.611171] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:11:16.742875] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-16T18:11:17.164824] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-16T18:11:17.542894] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-16T18:11:18.342815] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-16T18:11:18.832707] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:11:19.142826] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-16T18:11:19.540393] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:11:19.942781] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-16T18:11:20.127130] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:11:20.742844] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-16T18:11:20.998989] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:11:21.268233] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:11:21.269106] [INFO ] [REMOTE ] CPAC: Full fetch complete (1808 records). [2025-10-16T18:11:21.269174] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-16T18:11:21.448211] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:11:21.448412] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:11:21.448481] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:11:21.448532] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-16T18:11:21.448589] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-16T18:11:21.448626] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-16T18:11:21.448712] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-16T18:11:21.448781] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPAC took 24.7s. Estimated remaining: 4h 16m 2s. Rate: 7.2 symbols/min [2025-10-16T18:11:21.550580] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-16T18:11:21.623184] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:21.671748] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-16T18:11:21.672067] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-16T18:11:21.847566] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:21.847772] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-16T18:11:21.847820] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-16T18:11:21.848569] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-16T18:11:21.848625] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-16T18:11:22.195268] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:22.342782] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-16T18:11:22.669150] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:11:23.142864] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-16T18:11:23.767255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T18:11:23.942819] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-16T18:11:24.323254] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T18:11:24.742789] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-16T18:11:24.803179] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T18:11:25.542859] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-16T18:11:26.342795] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-16T18:11:26.557805] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:11:26.743613] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T18:11:27.040801] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T18:11:27.142807] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-16T18:11:27.865744] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:11:27.942797] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-16T18:11:28.742872] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-16T18:11:29.542847] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-16T18:11:29.970198] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T18:11:30.005793] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-16T18:11:30.342831] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-16T18:11:30.734552] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:11:31.142815] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-16T18:11:31.942824] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-16T18:11:32.272450] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:11:32.445563] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-16T18:11:32.682738] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:11:32.742810] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-16T18:11:33.542808] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-16T18:11:33.652082] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:11:34.342808] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-16T18:11:35.142791] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-16T18:11:35.212105] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:11:35.697364] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T18:11:35.942833] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-16T18:11:36.391413] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T18:11:36.742848] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-16T18:11:37.542818] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-16T18:11:38.110295] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:11:38.114738] [INFO ] [REMOTE ] CPAY: Full fetch complete (44918 records). [2025-10-16T18:11:38.114914] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-16T18:11:38.269783] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-16T18:11:38.343591] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-16T18:11:38.459794] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:11:38.579672] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-16T18:11:38.579780] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-16T18:11:38.580625] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-16T18:11:38.580710] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-16T18:11:38.581715] [DEBUG] [LOCAL ] CPAY: Trimmed 44918 records to 30724 (keeping 200 days of data) [2025-10-16T18:11:38.784898] [DEBUG] [LOCAL ] CPAY: Primary data saved (30724 records). [2025-10-16T18:11:38.785040] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-16T18:11:38.785124] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAY took 40.6s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-16T18:11:39.143005] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-16T18:11:39.222390] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T18:11:39.942811] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-16T18:11:40.674227] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T18:11:40.742798] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-16T18:11:40.831503] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:11:41.388339] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:11:41.542808] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-16T18:11:42.342793] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-16T18:11:42.645806] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:11:42.648430] [INFO ] [REMOTE ] CPK: Full fetch complete (18501 records). [2025-10-16T18:11:42.648502] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-16T18:11:43.009861] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-16T18:11:43.009935] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-16T18:11:43.010309] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-16T18:11:43.010347] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-16T18:11:43.010904] [DEBUG] [LOCAL ] CPK: Trimmed 18501 records to 14061 (keeping 200 days of data) [2025-10-16T18:11:43.098176] [DEBUG] [LOCAL ] CPK: Primary data saved (14061 records). [2025-10-16T18:11:43.098308] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-16T18:11:43.098383] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 28.1s. Estimated remaining: 4h 16m 3s. Rate: 7.2 symbols/min [2025-10-16T18:11:43.142889] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-16T18:11:44.098969] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:11:44.104214] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-16T18:11:44.557974] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-16T18:11:44.742830] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-16T18:11:45.033384] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T18:11:45.542876] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-16T18:11:46.216995] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:11:46.342834] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-16T18:11:46.818541] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-16T18:11:47.142781] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-16T18:11:47.313230] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:11:47.315857] [INFO ] [REMOTE ] CPF: Full fetch complete (23633 records). [2025-10-16T18:11:47.315928] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-16T18:11:47.673556] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-16T18:11:47.673723] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-16T18:11:47.674268] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-16T18:11:47.674329] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-16T18:11:47.675044] [DEBUG] [LOCAL ] CPF: Trimmed 23633 records to 15396 (keeping 200 days of data) [2025-10-16T18:11:47.764773] [DEBUG] [LOCAL ] CPF: Primary data saved (15396 records). [2025-10-16T18:11:47.764904] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-16T18:11:47.764979] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPF took 34.1s. Estimated remaining: 4h 15m 42s. Rate: 7.2 symbols/min [2025-10-16T18:11:49.228693] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-16T18:11:49.240220] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-16T18:11:51.637618] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-16T18:11:51.644438] [INFO ] [REMOTE ] CPNG: Full fetch complete (77780 records). [2025-10-16T18:11:51.644561] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-16T18:11:52.031257] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-16T18:11:52.031342] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-16T18:11:52.032263] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-16T18:11:52.032326] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-16T18:11:52.033858] [DEBUG] [LOCAL ] CPNG: Trimmed 77780 records to 54069 (keeping 200 days of data) [2025-10-16T18:11:52.353847] [DEBUG] [LOCAL ] CPNG: Primary data saved (54069 records). [2025-10-16T18:11:52.354018] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-16T18:11:52.354115] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 30.9s. Estimated remaining: 4h 15m 21s. Rate: 7.2 symbols/min [2025-10-16T18:11:52.993363] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.083154] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.087336] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.107154] [DEBUG] [LOCAL ] CPT: No existing data file found in primary storage. [2025-10-16T18:11:53.116563] [WARN ] [MAIN ] CPT: No existing data found, performing full refresh instead. [2025-10-16T18:11:53.118677] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:11:53.122894] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-16T18:11:53.123949] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-16T18:11:53.124109] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-10-16T18:11:53.124160] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-16T18:11:53.234243] [DEBUG] [LOCAL ] CPS: Loaded 25220 existing records from primary storage. [2025-10-16T18:11:53.252873] [INFO ] [MAIN ] CPS: Loaded 25220 existing records. [2025-10-16T18:11:53.267373] [DEBUG] [LOCAL ] CQP: Loaded 18825 existing records from primary storage. [2025-10-16T18:11:53.310080] [INFO ] [MAIN ] CQP: Loaded 18825 existing records. [2025-10-16T18:11:53.720230] [DEBUG] [LOCAL ] CPRI: Loaded 52475 existing records from primary storage. [2025-10-16T18:11:53.877144] [INFO ] [MAIN ] CPRI: Loaded 52475 existing records. [2025-10-16T18:11:53.866101] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:53.985091] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-16T18:11:53.999187] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-16T18:11:53.967851] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:54.016373] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-16T18:11:54.017028] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-16T18:11:54.016838] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-16T18:11:54.020902] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:54.080456] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-16T18:11:54.119765] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-16T18:11:54.140625] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-16T18:11:54.153383] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-16T18:11:54.357211] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:11:54.403115] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-16T18:11:54.460155] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-16T18:11:54.495520] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-16T18:11:54.567720] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-16T18:11:55.118519] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.182499] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-16T18:11:55.173318] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.195367] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-16T18:11:55.358090] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:11:55.358614] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-16T18:11:55.496039] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:11:55.504098] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-16T18:11:56.346174] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T18:11:56.350583] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-16T18:11:56.364047] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T18:11:56.368527] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-16T18:11:56.711143] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:11:56.720048] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-16T18:11:56.955002] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:11:56.965593] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-16T18:11:57.372188] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T18:11:57.377262] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-16T18:11:57.461306] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:11:57.467271] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-16T18:11:58.213814] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:11:58.222441] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-16T18:11:58.293349] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:11:58.318440] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:11:58.336709] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T18:11:58.342754] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-16T18:11:59.142791] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-16T18:11:59.372199] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:11:59.532702] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:11:59.942872] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-16T18:12:00.742846] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-16T18:12:00.839484] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:12:01.361537] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:12:01.542805] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-16T18:12:02.342864] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-16T18:12:02.587011] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:12:02.870944] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:12:03.142838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-16T18:12:03.346778] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:12:03.942823] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-16T18:12:04.433547] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:12:04.742813] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-16T18:12:04.810979] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:12:05.542848] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-16T18:12:06.342851] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-16T18:12:06.510724] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T18:12:06.667853] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:12:07.142882] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-16T18:12:07.942816] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-16T18:12:08.070776] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:12:08.236876] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:12:08.742858] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-16T18:12:09.327211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:12:09.542866] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-16T18:12:10.036101] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:12:10.342826] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-16T18:12:10.710347] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:12:11.142871] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-16T18:12:11.942899] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-16T18:12:11.975745] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T18:12:12.112197] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:12:12.622457] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-16T18:12:12.742829] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-16T18:12:13.542771] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-16T18:12:13.612560] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:12:14.342881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-16T18:12:14.687606] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:12:15.142821] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-16T18:12:15.878985] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:12:15.942786] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-16T18:12:16.654360] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T18:12:16.742877] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-16T18:12:17.542827] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-16T18:12:17.600545] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:12:18.347356] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-16T18:12:18.365300] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:12:18.661268] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:12:19.142867] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-16T18:12:19.942789] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-16T18:12:20.272083] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:12:20.343802] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:12:20.349505] [INFO ] [REMOTE ] CPT: Full fetch complete (64487 records). [2025-10-16T18:12:20.349681] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-16T18:12:20.743569] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-16T18:12:20.807790] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-16T18:12:20.807943] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-16T18:12:20.808994] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-16T18:12:20.809098] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-16T18:12:20.817446] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:12:20.820681] [DEBUG] [LOCAL ] CPT: Trimmed 64487 records to 44888 (keeping 200 days of data) [2025-10-16T18:12:20.821316] [INFO ] [REMOTE ] CPS: Full fetch complete (36191 records). [2025-10-16T18:12:20.821423] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-16T18:12:20.822769] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:12:20.822920] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:12:20.823009] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:12:20.823100] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-16T18:12:20.823198] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-16T18:12:20.823280] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-16T18:12:20.823525] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-16T18:12:20.823675] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CPS took 28.5s. Estimated remaining: 4h 16m 24s. Rate: 7.2 symbols/min [2025-10-16T18:12:21.100451] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:21.135797] [DEBUG] [LOCAL ] CR: Loaded 24087 existing records from primary storage. [2025-10-16T18:12:21.136797] [INFO ] [MAIN ] CR: Loaded 24087 existing records. [2025-10-16T18:12:21.352551] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:21.355558] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-16T18:12:21.355626] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-16T18:12:21.356209] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-16T18:12:21.356297] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-16T18:12:21.560126] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-16T18:12:21.715603] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:12:21.757000] [INFO ] [REMOTE ] CQP: Full fetch complete (29818 records). [2025-10-16T18:12:21.768475] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-16T18:12:21.784189] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:12:21.792052] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:12:21.792378] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:12:21.809813] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-16T18:12:21.857582] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-16T18:12:21.895028] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-16T18:12:21.892394] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:21.906210] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-16T18:12:21.907150] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CQP took 29.5s. Estimated remaining: 4h 15m 50s. Rate: 7.2 symbols/min [2025-10-16T18:12:21.991097] [DEBUG] [LOCAL ] CPT: Primary data saved (44888 records). [2025-10-16T18:12:22.010667] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-16T18:12:22.013233] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPT took 29.6s. Estimated remaining: 4h 15m 13s. Rate: 7.2 symbols/min [2025-10-16T18:12:22.195865] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:22.261513] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:22.265306] [DEBUG] [LOCAL ] CRBD: Loaded 8927 existing records from primary storage. [2025-10-16T18:12:22.265739] [INFO ] [MAIN ] CRBD: Loaded 8927 existing records. [2025-10-16T18:12:22.348695] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-16T18:12:22.486550] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:22.486847] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-16T18:12:22.486897] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-16T18:12:22.487352] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-16T18:12:22.500985] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-16T18:12:22.658134] [DEBUG] [LOCAL ] CRBG: Loaded 52586 existing records from primary storage. [2025-10-16T18:12:22.673935] [INFO ] [MAIN ] CRBG: Loaded 52586 existing records. [2025-10-16T18:12:23.065346] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:23.098681] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-16T18:12:23.100028] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-16T18:12:23.117475] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-16T18:12:23.117592] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-16T18:12:23.158397] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:23.176680] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-16T18:12:23.497179] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:23.527451] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:12:23.546779] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-16T18:12:23.942884] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-16T18:12:24.129042] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:12:24.742891] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-16T18:12:25.552455] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-16T18:12:25.572077] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:12:26.335313] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T18:12:26.345359] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-16T18:12:26.387873] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:12:27.142861] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-16T18:12:27.762551] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T18:12:27.769569] [INFO ] [REMOTE ] CPRI: Full fetch complete (76209 records). [2025-10-16T18:12:27.769757] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-16T18:12:27.963775] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-16T18:12:28.181990] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-16T18:12:28.182077] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-16T18:12:28.183001] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-16T18:12:28.183069] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-16T18:12:28.184530] [DEBUG] [LOCAL ] CPRI: Trimmed 76209 records to 52846 (keeping 200 days of data) [2025-10-16T18:12:28.492465] [DEBUG] [LOCAL ] CPRI: Primary data saved (52846 records). [2025-10-16T18:12:28.492670] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-16T18:12:28.492793] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPRI took 36.1s. Estimated remaining: 4h 14m 58s. Rate: 7.2 symbols/min [2025-10-16T18:12:28.668562] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:28.709303] [DEBUG] [LOCAL ] CRC: Loaded 44068 existing records from primary storage. [2025-10-16T18:12:28.709604] [INFO ] [MAIN ] CRC: Loaded 44068 existing records. [2025-10-16T18:12:28.751977] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-16T18:12:28.898232] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:28.898489] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-16T18:12:28.898723] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-16T18:12:28.908386] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-16T18:12:28.913774] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-16T18:12:28.970913] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-16T18:12:29.281173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T18:12:29.334328] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:29.474621] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T18:12:29.542798] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-16T18:12:30.342825] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-16T18:12:31.111253] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:12:31.142776] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-16T18:12:31.188232] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T18:12:31.942806] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-16T18:12:32.345807] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:12:32.742825] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-16T18:12:33.231173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T18:12:33.542810] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-16T18:12:34.157950] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:12:34.342814] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-16T18:12:34.382024] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:12:35.142836] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-16T18:12:35.793488] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:12:35.942797] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-16T18:12:36.742802] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-16T18:12:36.913128] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T18:12:36.974785] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:12:37.286406] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T18:12:37.542859] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-16T18:12:38.256668] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T18:12:38.342804] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-16T18:12:39.142830] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-16T18:12:39.409052] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:12:39.942854] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-16T18:12:40.732608] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:12:40.730944] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:12:40.745617] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-16T18:12:41.542866] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-16T18:12:42.342838] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-16T18:12:42.374407] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:12:43.147954] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-16T18:12:43.166813] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:12:43.195541] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:12:43.942840] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-16T18:12:43.962752] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:12:44.585850] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T18:12:44.742861] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-16T18:12:45.542865] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-16T18:12:46.153539] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:12:46.342854] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-16T18:12:46.535632] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:12:47.140341] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:12:47.142855] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-16T18:12:47.942880] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-16T18:12:48.609301] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T18:12:48.742820] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-16T18:12:49.490861] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T18:12:49.542796] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-16T18:12:49.772897] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T18:12:50.010849] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T18:12:50.012312] [INFO ] [REMOTE ] CRBD: Full fetch complete (13383 records). [2025-10-16T18:12:50.012379] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-16T18:12:50.348039] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-16T18:12:50.387908] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-16T18:12:50.388013] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-16T18:12:50.388417] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-16T18:12:50.388480] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-16T18:12:50.389079] [DEBUG] [LOCAL ] CRBD: Trimmed 13383 records to 8956 (keeping 200 days of data) [2025-10-16T18:12:50.442915] [DEBUG] [LOCAL ] CRBD: Primary data saved (8956 records). [2025-10-16T18:12:50.443024] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-16T18:12:50.443100] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 28.5s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-16T18:12:50.612270] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:50.612425] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-16T18:12:50.612462] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-16T18:12:50.612613] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-16T18:12:50.612679] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-16T18:12:50.612739] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-16T18:12:50.612784] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-16T18:12:50.980832] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:51.142812] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-16T18:12:51.942882] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-16T18:12:52.192932] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:12:52.326749] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:12:52.742816] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-16T18:12:53.542839] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-16T18:12:53.596212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:12:53.729131] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:12:53.729392] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-16T18:12:53.729473] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:12:53.729522] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-16T18:12:53.729559] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:12:53.729623] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-16T18:12:53.729720] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-16T18:12:53.729764] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-16T18:12:53.729804] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-16T18:12:53.729849] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRCL took 3.3s. Estimated remaining: 4h 15m 12s. Rate: 7.2 symbols/min [2025-10-16T18:12:53.897161] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:12:53.945219] [DEBUG] [LOCAL ] CRGY: Loaded 52507 existing records from primary storage. [2025-10-16T18:12:53.945550] [INFO ] [MAIN ] CRGY: Loaded 52507 existing records. [2025-10-16T18:12:54.136574] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:12:54.136831] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-16T18:12:54.136920] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-16T18:12:54.137197] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-16T18:12:54.137253] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-16T18:12:54.348276] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-16T18:12:54.500224] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:12:54.529842] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:12:55.142813] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-16T18:12:55.942786] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-16T18:12:55.988425] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:12:56.742785] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-16T18:12:56.851562] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T18:12:57.139073] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T18:12:57.542806] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-16T18:12:58.311022] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T18:12:58.342774] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-16T18:12:59.142788] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-16T18:12:59.294916] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:12:59.301882] [INFO ] [REMOTE ] CRBG: Full fetch complete (76027 records). [2025-10-16T18:12:59.302006] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-16T18:12:59.710092] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-16T18:12:59.710271] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-16T18:12:59.711426] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-16T18:12:59.711544] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-16T18:12:59.713149] [DEBUG] [LOCAL ] CRBG: Trimmed 76027 records to 52976 (keeping 200 days of data) [2025-10-16T18:12:59.946297] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-16T18:13:00.062076] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:13:00.090791] [DEBUG] [LOCAL ] CRBG: Primary data saved (52976 records). [2025-10-16T18:13:00.091488] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-16T18:13:00.091612] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRBG took 38.1s. Estimated remaining: 4h 14m 57s. Rate: 7.2 symbols/min [2025-10-16T18:13:00.259413] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:00.259590] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-16T18:13:00.259628] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-16T18:13:00.259760] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-16T18:13:00.259801] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-16T18:13:00.259841] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-16T18:13:00.259873] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-16T18:13:00.621222] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:00.742803] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-16T18:13:00.787224] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:13:01.289340] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T18:13:01.293220] [INFO ] [REMOTE ] CR: Full fetch complete (34738 records). [2025-10-16T18:13:01.293345] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-16T18:13:01.551550] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-16T18:13:01.663784] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-16T18:13:01.663865] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-16T18:13:01.664428] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-16T18:13:01.664470] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-16T18:13:01.665934] [DEBUG] [LOCAL ] CR: Trimmed 34738 records to 24311 (keeping 200 days of data) [2025-10-16T18:13:01.832384] [DEBUG] [LOCAL ] CR: Primary data saved (24311 records). [2025-10-16T18:13:01.832596] [INFO ] [MAIN ] CR: Full history saved. [2025-10-16T18:13:01.832936] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CR took 41.0s. Estimated remaining: 4h 14m 25s. Rate: 7.2 symbols/min [2025-10-16T18:13:02.029359] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:02.080140] [DEBUG] [LOCAL ] CRI: Loaded 49669 existing records from primary storage. [2025-10-16T18:13:02.080612] [INFO ] [MAIN ] CRI: Loaded 49669 existing records. [2025-10-16T18:13:02.270194] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:02.270559] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-16T18:13:02.270625] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-16T18:13:02.272228] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-16T18:13:02.272293] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-16T18:13:02.345436] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-16T18:13:02.665726] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:02.755791] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T18:13:03.142900] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-16T18:13:03.179182] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T18:13:03.864731] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:13:03.871719] [INFO ] [REMOTE ] CRC: Full fetch complete (62903 records). [2025-10-16T18:13:03.871839] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-16T18:13:03.947989] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-16T18:13:04.254056] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-16T18:13:04.254150] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-16T18:13:04.255323] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-16T18:13:04.255392] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-16T18:13:04.256854] [DEBUG] [LOCAL ] CRC: Trimmed 62903 records to 44395 (keeping 200 days of data) [2025-10-16T18:13:04.525176] [DEBUG] [LOCAL ] CRC: Primary data saved (44395 records). [2025-10-16T18:13:04.525318] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-16T18:13:04.525409] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRC took 36.0s. Estimated remaining: 4h 13m 58s. Rate: 7.2 symbols/min [2025-10-16T18:13:04.695870] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:04.744938] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-16T18:13:04.748306] [DEBUG] [LOCAL ] CRK: Loaded 52246 existing records from primary storage. [2025-10-16T18:13:04.748774] [INFO ] [MAIN ] CRK: Loaded 52246 existing records. [2025-10-16T18:13:04.930710] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:04.931025] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-16T18:13:04.931075] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-16T18:13:04.954790] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-16T18:13:04.954882] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-16T18:13:05.058025] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T18:13:05.326508] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:05.548020] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-16T18:13:05.560954] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:13:06.122495] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:13:06.342885] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-16T18:13:07.142841] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-16T18:13:07.336765] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T18:13:07.942808] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-16T18:13:08.080333] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T18:13:08.383159] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:13:08.742807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-16T18:13:09.531588] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:13:09.542763] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-16T18:13:10.335506] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:13:10.344206] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-16T18:13:11.077686] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:13:11.142796] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-16T18:13:11.723969] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:13:11.942806] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-16T18:13:12.742792] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-16T18:13:12.780751] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:13:13.542817] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-16T18:13:13.848673] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T18:13:14.028018] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T18:13:14.342871] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-16T18:13:15.142818] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-16T18:13:15.217077] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T18:13:15.795478] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:13:15.942809] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-16T18:13:16.742840] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-16T18:13:16.778095] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:13:17.542813] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-16T18:13:17.842337] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:13:18.350717] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-16T18:13:18.370603] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:13:19.026635] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:13:19.142825] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-16T18:13:19.942792] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-16T18:13:20.260800] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T18:13:20.742810] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-16T18:13:20.902206] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:13:21.542809] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-16T18:13:21.613357] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T18:13:22.040028] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:13:22.342803] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-16T18:13:22.888982] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:13:23.142800] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-16T18:13:23.942831] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-16T18:13:24.037591] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:13:24.514486] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T18:13:24.742818] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-16T18:13:25.490790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T18:13:25.542826] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-16T18:13:26.342824] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-16T18:13:26.525217] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:13:26.829596] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:13:27.142831] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-16T18:13:27.942839] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-16T18:13:28.596042] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-16T18:13:28.742788] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-16T18:13:28.971705] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T18:13:29.542774] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-16T18:13:29.651266] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:13:30.342842] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-16T18:13:30.793055] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-16T18:13:31.142788] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-16T18:13:31.208790] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:13:31.216869] [INFO ] [REMOTE ] CRGY: Full fetch complete (76146 records). [2025-10-16T18:13:31.217010] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-16T18:13:31.610258] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-16T18:13:31.610370] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-16T18:13:31.611455] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-16T18:13:31.611617] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-16T18:13:31.613382] [DEBUG] [LOCAL ] CRGY: Trimmed 76146 records to 52897 (keeping 200 days of data) [2025-10-16T18:13:31.737476] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:13:31.942799] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-16T18:13:31.965748] [DEBUG] [LOCAL ] CRGY: Primary data saved (52897 records). [2025-10-16T18:13:31.965844] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-16T18:13:31.965918] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 38.2s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-16T18:13:32.131803] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:32.175880] [DEBUG] [LOCAL ] CRL: Loaded 42812 existing records from primary storage. [2025-10-16T18:13:32.176208] [INFO ] [MAIN ] CRL: Loaded 42812 existing records. [2025-10-16T18:13:32.349124] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:32.349334] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-16T18:13:32.349411] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-16T18:13:32.349695] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-16T18:13:32.349755] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-16T18:13:32.707081] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:32.735024] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T18:13:32.745205] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-16T18:13:33.542843] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-16T18:13:33.907455] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T18:13:34.342789] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-16T18:13:34.360184] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:13:34.366152] [INFO ] [REMOTE ] CRI: Full fetch complete (70982 records). [2025-10-16T18:13:34.366268] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-16T18:13:34.755356] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-16T18:13:34.755450] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-16T18:13:34.756374] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-16T18:13:34.756441] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-16T18:13:34.757865] [DEBUG] [LOCAL ] CRI: Trimmed 70982 records to 50021 (keeping 200 days of data) [2025-10-16T18:13:35.010140] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:13:35.030408] [INFO ] [REMOTE ] CRK: Full fetch complete (75834 records). [2025-10-16T18:13:35.032844] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-16T18:13:35.164211] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-16T18:13:35.221558] [DEBUG] [LOCAL ] CRI: Primary data saved (50021 records). [2025-10-16T18:13:35.232013] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-16T18:13:35.243057] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRI took 33.4s. Estimated remaining: 4h 14m 30s. Rate: 7.2 symbols/min [2025-10-16T18:13:35.593592] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:35.593809] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-10-16T18:13:35.593881] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-10-16T18:13:35.604664] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-16T18:13:35.615007] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-16T18:13:35.632453] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-16T18:13:35.642075] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-16T18:13:35.800436] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-16T18:13:35.800579] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-16T18:13:35.801586] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-16T18:13:35.801995] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-16T18:13:35.941436] [DEBUG] [LOCAL ] CRK: Trimmed 75834 records to 52635 (keeping 200 days of data) [2025-10-16T18:13:36.259507] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:36.268969] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-16T18:13:36.410949] [DEBUG] [LOCAL ] CRK: Primary data saved (52635 records). [2025-10-16T18:13:36.426514] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-16T18:13:36.429492] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 31.9s. Estimated remaining: 4h 13m 57s. Rate: 7.2 symbols/min [2025-10-16T18:13:36.498085] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-16T18:13:36.542965] [INFO ] [REMOTE ] CRH: Full fetch complete (77538 records). [2025-10-16T18:13:36.548827] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-16T18:13:36.635601] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:36.859141] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:13:36.901419] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-16T18:13:37.006442] [DEBUG] [LOCAL ] CRS: Loaded 43214 existing records from primary storage. [2025-10-16T18:13:37.039410] [INFO ] [MAIN ] CRS: Loaded 43214 existing records. [2025-10-16T18:13:37.158833] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-16T18:13:37.170176] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-16T18:13:37.196069] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-16T18:13:37.196427] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-16T18:13:37.260534] [DEBUG] [LOCAL ] CRH: Trimmed 77538 records to 53831 (keeping 200 days of data) [2025-10-16T18:13:37.283447] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:37.284287] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-16T18:13:37.284376] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-16T18:13:37.285332] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-16T18:13:37.285393] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-16T18:13:37.758369] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:37.759924] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-16T18:13:37.982546] [DEBUG] [LOCAL ] CRH: Primary data saved (53831 records). [2025-10-16T18:13:37.982710] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-16T18:13:37.982792] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRH took 37.9s. Estimated remaining: 4h 13m 26s. Rate: 7.2 symbols/min [2025-10-16T18:13:38.147778] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:38.154019] [DEBUG] [LOCAL ] CRT: Loaded 4885 existing records from primary storage. [2025-10-16T18:13:38.154211] [INFO ] [MAIN ] CRT: Loaded 4885 existing records. [2025-10-16T18:13:38.330998] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:38.331366] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-16T18:13:38.331548] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-16T18:13:38.331927] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-16T18:13:38.331991] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-16T18:13:38.694450] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:38.711229] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-16T18:13:38.724574] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:13:38.772667] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-16T18:13:38.905686] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:13:39.142837] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-16T18:13:39.311156] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:13:39.942902] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-16T18:13:40.461980] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T18:13:40.499812] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T18:13:40.742810] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-16T18:13:41.332892] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:13:41.542833] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-16T18:13:41.653859] [DEBUG] [REMOTE ] CRL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-16T18:13:41.654121] [WARN ] [REMOTE ] CRL: No data returned for month 2025-03 [2025-10-16T18:13:41.654207] [FATAL] [REMOTE ] CRL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:13:41.654288] [FATAL] [MAIN ] CRL: Failed to fetch primary data. [2025-10-16T18:13:41.654324] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:13:41.654361] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-16T18:13:41.654432] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-16T18:13:41.654469] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-10-16T18:13:41.654625] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-10-16T18:13:41.654736] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRL took 9.7s. Estimated remaining: 4h 13m 2s. Rate: 7.3 symbols/min [2025-10-16T18:13:41.828670] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:41.866819] [DEBUG] [LOCAL ] CSAN: Loaded 42170 existing records from primary storage. [2025-10-16T18:13:41.867099] [INFO ] [MAIN ] CSAN: Loaded 42170 existing records. [2025-10-16T18:13:42.046314] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:42.046537] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-16T18:13:42.046586] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-16T18:13:42.047115] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-16T18:13:42.047172] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-16T18:13:42.348010] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-16T18:13:42.400761] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:43.142845] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-16T18:13:43.735801] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T18:13:43.942883] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-16T18:13:44.551775] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-16T18:13:44.742964] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-16T18:13:45.325367] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:13:45.426802] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T18:13:45.542785] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-16T18:13:46.001930] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T18:13:46.342834] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-16T18:13:47.012362] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-16T18:13:47.142846] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-16T18:13:47.731694] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:13:47.942834] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-16T18:13:48.742856] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-16T18:13:49.031976] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:13:49.326915] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:13:49.542819] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-16T18:13:50.342797] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-16T18:13:51.049817] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:13:51.142787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-16T18:13:51.751507] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T18:13:51.752734] [INFO ] [REMOTE ] CRT: Full fetch complete (7350 records). [2025-10-16T18:13:51.752829] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-16T18:13:51.753276] [FATAL] [VALIDATOR ] CRT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:13:51.753377] [FATAL] [MAIN ] CRT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:13:51.753453] [WARN ] [MAIN ] CRT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:13:51.753527] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-16T18:13:51.753591] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-16T18:13:51.753690] [INFO ] [LOCAL ] CRT: Starting deletion of derivative data. [2025-10-16T18:13:51.753822] [DEBUG] [LOCAL ] CRT: Deleted derivative data file. [2025-10-16T18:13:51.753918] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRT took 13.8s. Estimated remaining: 4h 12m 60s. Rate: 7.2 symbols/min [2025-10-16T18:13:51.952726] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-16T18:13:51.956125] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:13:51.989948] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-16T18:13:52.024053] [DEBUG] [LOCAL ] CSL: Loaded 31478 existing records from primary storage. [2025-10-16T18:13:52.024309] [INFO ] [MAIN ] CSL: Loaded 31478 existing records. [2025-10-16T18:13:52.199906] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:13:52.200127] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-16T18:13:52.200183] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-16T18:13:52.200842] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-16T18:13:52.200899] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-16T18:13:52.579323] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:13:52.742853] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-16T18:13:53.351112] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:13:53.542835] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-16T18:13:54.342881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-16T18:13:54.677679] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:13:54.970708] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-16T18:13:55.142819] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-16T18:13:55.863980] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:13:55.942813] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-16T18:13:56.335091] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:13:56.742804] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-16T18:13:57.481629] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:13:57.542826] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-16T18:13:57.718680] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:13:58.342851] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-16T18:13:58.924936] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:13:59.142826] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-16T18:13:59.857939] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:13:59.942859] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-16T18:14:00.742848] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-16T18:14:01.542859] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-16T18:14:01.602415] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:14:01.845008] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-16T18:14:01.954336] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:14:02.342809] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-16T18:14:02.779679] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:14:03.142797] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-16T18:14:03.942846] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-16T18:14:04.750633] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-16T18:14:04.770952] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-16T18:14:04.816670] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:14:05.113336] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:14:05.542852] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-16T18:14:06.342842] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-16T18:14:06.723891] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:14:07.142842] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-16T18:14:07.716594] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T18:14:07.942782] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-16T18:14:08.534317] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.99 seconds). [2025-10-16T18:14:08.687165] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T18:14:08.742797] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-16T18:14:09.542862] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-16T18:14:09.678772] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:14:10.342820] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-16T18:14:10.653210] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:14:11.142805] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-16T18:14:11.352594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-16T18:14:11.938669] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:14:11.947968] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-16T18:14:11.991011] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T18:14:12.742810] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-16T18:14:13.542825] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-16T18:14:14.342793] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:14:14.342998] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-16T18:14:14.518623] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-16T18:14:14.589977] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:14:15.142815] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-16T18:14:15.370618] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-16T18:14:15.942838] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-16T18:14:16.505988] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:14:16.512172] [INFO ] [REMOTE ] CSAN: Full fetch complete (60440 records). [2025-10-16T18:14:16.512305] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-16T18:14:16.749100] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-16T18:14:16.897396] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-16T18:14:16.897481] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-16T18:14:16.898307] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-16T18:14:16.898369] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-16T18:14:16.899569] [DEBUG] [LOCAL ] CSAN: Trimmed 60440 records to 42492 (keeping 200 days of data) [2025-10-16T18:14:17.133898] [DEBUG] [LOCAL ] CSAN: Primary data saved (42492 records). [2025-10-16T18:14:17.134032] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-16T18:14:17.134109] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CSAN took 35.5s. Estimated remaining: 4h 13m 50s. Rate: 7.2 symbols/min [2025-10-16T18:14:17.302484] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:17.316079] [DEBUG] [LOCAL ] CSR: Loaded 13403 existing records from primary storage. [2025-10-16T18:14:17.316364] [INFO ] [MAIN ] CSR: Loaded 13403 existing records. [2025-10-16T18:14:17.493435] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:17.493728] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-16T18:14:17.493803] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-16T18:14:17.494291] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-16T18:14:17.494355] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-16T18:14:17.555434] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-16T18:14:17.666376] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T18:14:17.882595] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:18.237843] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T18:14:18.342790] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-16T18:14:19.142801] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-16T18:14:19.942846] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-16T18:14:19.977402] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T18:14:20.064765] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-16T18:14:20.085529] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T18:14:20.742855] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-16T18:14:21.305234] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:14:21.542862] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-16T18:14:22.193314] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:14:22.198564] [INFO ] [REMOTE ] CRS: Full fetch complete (62322 records). [2025-10-16T18:14:22.198734] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-16T18:14:22.199483] [FATAL] [VALIDATOR ] CRS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:14:22.199569] [FATAL] [MAIN ] CRS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:14:22.199611] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:14:22.199675] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-16T18:14:22.199752] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-16T18:14:22.199789] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-10-16T18:14:22.199975] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-10-16T18:14:22.200064] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CRS took 45.8s. Estimated remaining: 4h 13m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:22.374356] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:22.349585] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-16T18:14:22.419030] [DEBUG] [LOCAL ] CSTM: Loaded 47572 existing records from primary storage. [2025-10-16T18:14:22.419376] [INFO ] [MAIN ] CSTM: Loaded 47572 existing records. [2025-10-16T18:14:22.597079] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:22.597293] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-16T18:14:22.597355] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-16T18:14:22.598064] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-16T18:14:22.598122] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-16T18:14:22.876471] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T18:14:22.902780] [INFO ] [REMOTE ] CSL: Full fetch complete (45623 records). [2025-10-16T18:14:22.918856] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-16T18:14:23.023767] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:23.160664] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-16T18:14:23.289444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:14:23.381475] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-16T18:14:23.381564] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-16T18:14:23.382433] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-16T18:14:23.382501] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-16T18:14:23.383735] [DEBUG] [LOCAL ] CSL: Trimmed 45623 records to 31764 (keeping 200 days of data) [2025-10-16T18:14:23.582334] [DEBUG] [LOCAL ] CSL: Primary data saved (31764 records). [2025-10-16T18:14:23.582474] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-16T18:14:23.582551] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSL took 31.8s. Estimated remaining: 4h 12m 59s. Rate: 7.2 symbols/min [2025-10-16T18:14:23.755183] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:23.773511] [DEBUG] [LOCAL ] CSV: Loaded 12707 existing records from primary storage. [2025-10-16T18:14:23.773801] [INFO ] [MAIN ] CSV: Loaded 12707 existing records. [2025-10-16T18:14:23.947634] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-16T18:14:23.958149] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:23.959427] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-16T18:14:23.959478] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-16T18:14:23.959871] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-16T18:14:23.959930] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-16T18:14:24.321126] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:24.742860] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-16T18:14:24.881779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:14:24.952179] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:14:24.959097] [INFO ] [REMOTE ] CRM: Full fetch complete (77944 records). [2025-10-16T18:14:24.959245] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-16T18:14:25.385787] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-16T18:14:25.386401] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-16T18:14:25.386707] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T18:14:25.387958] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-16T18:14:25.390875] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-16T18:14:25.392590] [DEBUG] [LOCAL ] CRM: Trimmed 77944 records to 54160 (keeping 200 days of data) [2025-10-16T18:14:25.582509] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-16T18:14:25.757143] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-16T18:14:25.757293] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-16T18:14:25.757370] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CRM took 50.5s. Estimated remaining: 4h 12m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:25.925779] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:25.925936] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-16T18:14:25.925975] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-16T18:14:25.926084] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-16T18:14:25.926126] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-16T18:14:25.926169] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-16T18:14:25.926202] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-16T18:14:26.309211] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:26.310246] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T18:14:26.342794] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-16T18:14:27.142826] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-16T18:14:27.302711] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T18:14:27.308085] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:14:27.308416] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-16T18:14:27.308516] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:14:27.308573] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-16T18:14:27.308628] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:14:27.308732] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-16T18:14:27.308860] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-16T18:14:27.308948] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-16T18:14:27.309043] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-16T18:14:27.309121] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSW took 1.6s. Estimated remaining: 4h 11m 58s. Rate: 7.3 symbols/min [2025-10-16T18:14:27.488137] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:27.496906] [DEBUG] [LOCAL ] CTBB: Loaded 6784 existing records from primary storage. [2025-10-16T18:14:27.497167] [INFO ] [MAIN ] CTBB: Loaded 6784 existing records. [2025-10-16T18:14:27.679083] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:27.679337] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-16T18:14:27.679392] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-16T18:14:27.679683] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-16T18:14:27.679743] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-16T18:14:27.951078] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-16T18:14:28.035507] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:28.742827] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-16T18:14:29.542853] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-16T18:14:29.672674] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:14:29.691552] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:14:30.346807] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-16T18:14:30.347982] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:14:31.142829] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-16T18:14:31.335559] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:14:31.942815] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-16T18:14:32.317440] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:14:32.648119] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:14:32.742821] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-16T18:14:33.455781] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:14:33.542799] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-16T18:14:34.342838] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-16T18:14:34.394717] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:14:34.956481] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:14:35.142815] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-16T18:14:35.942840] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-16T18:14:36.056065] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:14:36.742858] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-16T18:14:37.332102] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:14:37.542883] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-16T18:14:37.677386] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:14:38.066542] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T18:14:38.342846] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-16T18:14:39.142909] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-16T18:14:39.280212] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:14:39.283959] [INFO ] [REMOTE ] CSR: Full fetch complete (17984 records). [2025-10-16T18:14:39.284070] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-16T18:14:39.649615] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-16T18:14:39.649720] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-16T18:14:39.650124] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-16T18:14:39.650164] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-16T18:14:39.650763] [DEBUG] [LOCAL ] CSR: Trimmed 17984 records to 13529 (keeping 200 days of data) [2025-10-16T18:14:39.737021] [DEBUG] [LOCAL ] CSR: Primary data saved (13529 records). [2025-10-16T18:14:39.737191] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-16T18:14:39.737285] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSR took 22.6s. Estimated remaining: 4h 12m 4s. Rate: 7.3 symbols/min [2025-10-16T18:14:39.915623] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:39.922328] [DEBUG] [LOCAL ] CTDD: Loaded 5471 existing records from primary storage. [2025-10-16T18:14:39.922557] [INFO ] [MAIN ] CTDD: Loaded 5471 existing records. [2025-10-16T18:14:39.952685] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-16T18:14:40.113349] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T18:14:40.117697] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:14:40.121000] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-16T18:14:40.121069] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-16T18:14:40.121319] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-16T18:14:40.121377] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-16T18:14:40.484038] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:40.742830] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-16T18:14:40.772196] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T18:14:41.459878] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T18:14:41.542853] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-16T18:14:42.342792] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-16T18:14:42.476977] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:14:42.995517] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T18:14:43.142824] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-16T18:14:43.942803] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-16T18:14:44.127345] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:14:44.742785] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-16T18:14:45.542773] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-16T18:14:45.595464] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:14:45.633962] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T18:14:46.245134] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-16T18:14:46.342835] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-16T18:14:47.142810] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-16T18:14:47.239703] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T18:14:47.942805] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-16T18:14:48.529729] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:14:48.742883] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-16T18:14:48.795779] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:14:49.213888] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T18:14:49.542853] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-16T18:14:50.258199] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:14:50.342821] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-16T18:14:51.142823] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-16T18:14:51.519343] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:14:51.898049] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T18:14:51.942827] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-16T18:14:52.742819] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-16T18:14:52.908853] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:14:53.166734] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T18:14:53.542833] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-16T18:14:54.343096] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-16T18:14:54.420837] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:14:54.821467] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T18:14:55.142837] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-16T18:14:55.942820] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-16T18:14:56.019052] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T18:14:56.559076] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:14:56.742806] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-16T18:14:57.522816] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T18:14:57.524714] [INFO ] [REMOTE ] CSV: Full fetch complete (19181 records). [2025-10-16T18:14:57.524795] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-16T18:14:57.547925] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-16T18:14:57.895558] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-16T18:14:57.895635] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-16T18:14:57.896137] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-16T18:14:57.896199] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-16T18:14:57.896754] [DEBUG] [LOCAL ] CSV: Trimmed 19181 records to 12746 (keeping 200 days of data) [2025-10-16T18:14:57.972623] [DEBUG] [LOCAL ] CSV: Primary data saved (12746 records). [2025-10-16T18:14:57.972778] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-16T18:14:57.972855] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSV took 34.4s. Estimated remaining: 4h 12m 30s. Rate: 7.2 symbols/min [2025-10-16T18:14:58.143626] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:14:58.143803] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-16T18:14:58.143845] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-16T18:14:58.143962] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-16T18:14:58.144004] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-16T18:14:58.144046] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-16T18:14:58.144079] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-16T18:14:58.352170] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-16T18:14:58.420829] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:14:58.514123] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:14:59.142852] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-16T18:14:59.799106] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:14:59.861144] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:14:59.862348] [INFO ] [REMOTE ] CTBB: Full fetch complete (10283 records). [2025-10-16T18:14:59.862415] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-16T18:14:59.948089] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-16T18:15:00.245431] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-16T18:15:00.245505] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-16T18:15:00.245797] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-16T18:15:00.245862] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-16T18:15:00.246289] [DEBUG] [LOCAL ] CTBB: Trimmed 10283 records to 6801 (keeping 200 days of data) [2025-10-16T18:15:00.286112] [DEBUG] [LOCAL ] CTBB: Primary data saved (6801 records). [2025-10-16T18:15:00.286210] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-16T18:15:00.286287] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTBB took 33.0s. Estimated remaining: 4h 12m 1s. Rate: 7.2 symbols/min [2025-10-16T18:15:00.454931] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:00.476373] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-16T18:15:00.487936] [DEBUG] [LOCAL ] CTO: Loaded 27682 existing records from primary storage. [2025-10-16T18:15:00.488216] [INFO ] [MAIN ] CTO: Loaded 27682 existing records. [2025-10-16T18:15:00.674592] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:00.674864] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-16T18:15:00.674921] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-16T18:15:00.675533] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-16T18:15:00.675627] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-16T18:15:00.748103] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-16T18:15:01.046045] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:01.542816] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-16T18:15:01.770344] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:15:01.770667] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-16T18:15:01.770757] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:15:01.770811] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-16T18:15:01.770871] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:15:01.770943] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-16T18:15:01.771005] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-16T18:15:01.771041] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-16T18:15:01.771080] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-16T18:15:01.771126] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTEV took 3.8s. Estimated remaining: 4h 11m 30s. Rate: 7.3 symbols/min [2025-10-16T18:15:01.940738] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:01.972731] [DEBUG] [LOCAL ] CTOS: Loaded 37188 existing records from primary storage. [2025-10-16T18:15:01.972996] [INFO ] [MAIN ] CTOS: Loaded 37188 existing records. [2025-10-16T18:15:02.148416] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:02.148734] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-16T18:15:02.148792] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-16T18:15:02.149417] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-16T18:15:02.149477] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-16T18:15:02.347947] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-16T18:15:02.539586] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:02.630728] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:15:03.142811] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-16T18:15:03.843903] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T18:15:03.942798] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-16T18:15:04.562719] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T18:15:04.742829] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-16T18:15:05.181333] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-16T18:15:05.239222] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-16T18:15:05.542806] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-16T18:15:06.342838] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-16T18:15:07.142800] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-16T18:15:07.230506] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:15:07.543847] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:15:07.942842] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-16T18:15:08.311412] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T18:15:08.742911] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-16T18:15:09.389421] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:15:09.542820] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-16T18:15:10.025959] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T18:15:10.342812] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-16T18:15:10.445933] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T18:15:11.142825] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-16T18:15:11.560171] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:15:11.834215] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T18:15:11.942821] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-16T18:15:12.742835] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-16T18:15:13.114768] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-16T18:15:13.542821] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-16T18:15:14.162540] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:15:14.198511] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:15:14.342865] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-16T18:15:15.142837] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-16T18:15:15.942823] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-16T18:15:16.087584] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:15:16.409036] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:15:16.742861] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-16T18:15:17.295520] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T18:15:17.296822] [INFO ] [REMOTE ] CTDD: Full fetch complete (8092 records). [2025-10-16T18:15:17.296899] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-16T18:15:17.547214] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-16T18:15:17.689635] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-16T18:15:17.689745] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-16T18:15:17.690000] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-16T18:15:17.690038] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-16T18:15:17.690430] [DEBUG] [LOCAL ] CTDD: Trimmed 8092 records to 5483 (keeping 200 days of data) [2025-10-16T18:15:17.725137] [DEBUG] [LOCAL ] CTDD: Primary data saved (5483 records). [2025-10-16T18:15:17.725291] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-16T18:15:17.725378] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTDD took 38.0s. Estimated remaining: 4h 11m 48s. Rate: 7.2 symbols/min [2025-10-16T18:15:17.881172] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-16T18:15:17.935859] [INFO ] [REMOTE ] CSTM: Full fetch complete (69509 records). [2025-10-16T18:15:17.937445] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:17.937946] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-16T18:15:18.333348] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-16T18:15:18.344952] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-10-16T18:15:18.344736] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-16T18:15:18.523417] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-16T18:15:18.543984] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-16T18:15:18.545225] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-16T18:15:18.545624] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-16T18:15:18.635959] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:18.636539] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-16T18:15:18.636466] [DEBUG] [LOCAL ] CSTM: Trimmed 69509 records to 47940 (keeping 200 days of data) [2025-10-16T18:15:18.636683] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-16T18:15:18.637964] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-16T18:15:18.638029] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-16T18:15:19.191175] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T18:15:19.292246] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-16T18:15:19.298572] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:19.374283] [DEBUG] [LOCAL ] CSTM: Primary data saved (47940 records). [2025-10-16T18:15:19.374502] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-16T18:15:19.374611] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CSTM took 57.2s. Estimated remaining: 4h 11m 17s. Rate: 7.3 symbols/min [2025-10-16T18:15:19.565361] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:19.621827] [DEBUG] [LOCAL ] CTRE: Loaded 49482 existing records from primary storage. [2025-10-16T18:15:19.622379] [INFO ] [MAIN ] CTRE: Loaded 49482 existing records. [2025-10-16T18:15:19.828768] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:19.854384] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-16T18:15:19.854575] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-16T18:15:19.856291] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-16T18:15:19.856222] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:15:19.856478] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-16T18:15:19.949023] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-16T18:15:20.261083] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:20.503261] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:15:20.742831] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-16T18:15:21.090530] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:15:21.542815] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-16T18:15:22.342843] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-16T18:15:22.398032] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:15:22.584183] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:15:23.142853] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-16T18:15:23.623037] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:15:23.942808] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-16T18:15:24.742783] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-16T18:15:24.875380] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:15:25.542860] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-16T18:15:26.128509] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:15:26.133293] [INFO ] [REMOTE ] CTO: Full fetch complete (41613 records). [2025-10-16T18:15:26.133426] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-16T18:15:26.347945] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-16T18:15:26.559523] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-16T18:15:26.559869] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-16T18:15:26.562373] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:15:26.563368] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-16T18:15:26.576600] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-16T18:15:26.578568] [DEBUG] [LOCAL ] CTO: Trimmed 41613 records to 27883 (keeping 200 days of data) [2025-10-16T18:15:26.753255] [DEBUG] [LOCAL ] CTO: Primary data saved (27883 records). [2025-10-16T18:15:26.753404] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-16T18:15:26.753485] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTO took 26.5s. Estimated remaining: 4h 11m 6s. Rate: 7.3 symbols/min [2025-10-16T18:15:26.927910] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:26.928282] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-16T18:15:26.928388] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-16T18:15:26.928613] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-16T18:15:26.928751] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-16T18:15:26.928866] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-16T18:15:26.928928] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-16T18:15:27.149856] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-16T18:15:27.310587] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:27.340707] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:15:27.620010] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T18:15:27.942847] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-16T18:15:28.742799] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-16T18:15:28.967696] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T18:15:29.542914] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-16T18:15:29.725177] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T18:15:30.193737] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:15:30.342835] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-16T18:15:31.142857] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-16T18:15:31.231102] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:15:31.942827] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-16T18:15:32.179209] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T18:15:32.407577] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T18:15:32.413127] [INFO ] [REMOTE ] CTOS: Full fetch complete (53623 records). [2025-10-16T18:15:32.413276] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-16T18:15:32.414154] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:15:32.414264] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:15:32.414336] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:15:32.414435] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-16T18:15:32.414515] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-16T18:15:32.414552] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-16T18:15:32.414706] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-16T18:15:32.414795] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 30.6s. Estimated remaining: 4h 10m 49s. Rate: 7.3 symbols/min [2025-10-16T18:15:32.590670] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:32.609861] [DEBUG] [LOCAL ] CTS: Loaded 19649 existing records from primary storage. [2025-10-16T18:15:32.610199] [INFO ] [MAIN ] CTS: Loaded 19649 existing records. [2025-10-16T18:15:32.747910] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-16T18:15:32.788438] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:32.789528] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-16T18:15:32.789601] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-16T18:15:32.790252] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-16T18:15:32.790313] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-16T18:15:33.141095] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:33.542800] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-16T18:15:34.022972] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-16T18:15:34.052777] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:15:34.342822] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-16T18:15:35.142800] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-16T18:15:35.395899] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T18:15:35.660232] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T18:15:35.942816] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-16T18:15:36.097125] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:15:36.742780] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-16T18:15:36.989277] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:15:37.482159] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T18:15:37.542841] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-16T18:15:38.342854] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-16T18:15:39.126247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T18:15:39.142806] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-16T18:15:39.370571] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:15:39.942859] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-16T18:15:40.435422] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:15:40.557691] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:15:40.742806] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-16T18:15:41.542838] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-16T18:15:42.012153] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:15:42.342887] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-16T18:15:43.142810] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-16T18:15:43.440806] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:15:43.590183] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:15:43.942821] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-16T18:15:44.742851] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-16T18:15:44.896725] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:15:45.247413] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:15:45.474756] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:15:45.542822] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-16T18:15:46.342844] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-16T18:15:47.142790] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-16T18:15:47.289042] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T18:15:47.414190] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T18:15:47.942863] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-16T18:15:48.153062] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:15:48.742804] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-16T18:15:49.542841] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-16T18:15:49.605420] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:15:50.342983] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-16T18:15:50.553740] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:15:50.598426] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:15:51.142886] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-16T18:15:51.926970] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T18:15:51.934201] [INFO ] [REMOTE ] CTRE: Full fetch complete (71022 records). [2025-10-16T18:15:51.934463] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-16T18:15:51.935777] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:15:51.935890] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:15:51.935963] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:15:51.936054] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-16T18:15:51.936135] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-16T18:15:51.936181] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-16T18:15:51.936336] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-16T18:15:51.937593] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRE took 32.6s. Estimated remaining: 4h 11m 18s. Rate: 7.2 symbols/min [2025-10-16T18:15:51.950691] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-16T18:15:52.130135] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:52.196113] [DEBUG] [LOCAL ] CTVA: Loaded 53298 existing records from primary storage. [2025-10-16T18:15:52.196612] [INFO ] [MAIN ] CTVA: Loaded 53298 existing records. [2025-10-16T18:15:52.360996] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:15:52.426665] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:15:52.426983] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-16T18:15:52.427037] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-16T18:15:52.428033] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-16T18:15:52.428097] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-16T18:15:52.749889] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-16T18:15:52.848146] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:53.418869] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:15:53.542855] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-16T18:15:54.337842] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:15:54.348137] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-16T18:15:54.430599] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:15:55.142819] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-16T18:15:55.942841] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-16T18:15:56.065849] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:15:56.278286] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T18:15:56.742825] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-16T18:15:57.545567] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-16T18:15:57.553278] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:15:57.814402] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T18:15:57.818727] [INFO ] [REMOTE ] CTS: Full fetch complete (27097 records). [2025-10-16T18:15:57.818861] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-16T18:15:58.202470] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-16T18:15:58.202553] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-16T18:15:58.203108] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-16T18:15:58.203171] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-16T18:15:58.204003] [DEBUG] [LOCAL ] CTS: Trimmed 27097 records to 19832 (keeping 200 days of data) [2025-10-16T18:15:58.334081] [DEBUG] [LOCAL ] CTS: Primary data saved (19832 records). [2025-10-16T18:15:58.334202] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-16T18:15:58.334280] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTS took 25.9s. Estimated remaining: 4h 11m 3s. Rate: 7.2 symbols/min [2025-10-16T18:15:58.347928] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-16T18:15:58.504936] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:15:58.505127] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-16T18:15:58.505164] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-16T18:15:58.505275] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-16T18:15:58.505316] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-16T18:15:58.505356] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-16T18:15:58.505387] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-16T18:15:58.863618] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:15:58.885596] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:15:59.142880] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-16T18:15:59.468376] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T18:15:59.942806] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-16T18:16:00.121102] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:16:00.742866] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-16T18:16:01.527584] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:16:01.542772] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-16T18:16:01.854381] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T18:16:02.342859] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-16T18:16:02.432407] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:16:02.608548] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-16T18:16:03.142844] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-16T18:16:03.942792] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-16T18:16:04.742794] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-16T18:16:05.012916] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T18:16:05.121732] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T18:16:05.129109] [INFO ] [REMOTE ] CTRA: Full fetch complete (77821 records). [2025-10-16T18:16:05.129282] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-16T18:16:05.542910] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-16T18:16:05.544448] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-16T18:16:05.544661] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-16T18:16:05.545710] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-16T18:16:05.545888] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-16T18:16:05.547591] [DEBUG] [LOCAL ] CTRA: Trimmed 77821 records to 54038 (keeping 200 days of data) [2025-10-16T18:16:05.670872] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:16:05.914869] [DEBUG] [LOCAL ] CTRA: Primary data saved (54038 records). [2025-10-16T18:16:05.915008] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-16T18:16:05.915087] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRA took 48.2s. Estimated remaining: 4h 10m 53s. Rate: 7.2 symbols/min [2025-10-16T18:16:06.007620] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T18:16:06.085202] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:06.130672] [DEBUG] [LOCAL ] CUBE: Loaded 50909 existing records from primary storage. [2025-10-16T18:16:06.131009] [INFO ] [MAIN ] CUBE: Loaded 50909 existing records. [2025-10-16T18:16:06.303673] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:06.303902] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-16T18:16:06.303957] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-16T18:16:06.304908] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-16T18:16:06.304965] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-16T18:16:06.347976] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-16T18:16:06.692926] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:07.142871] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-16T18:16:07.472291] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T18:16:07.942797] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-16T18:16:08.292812] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T18:16:08.742837] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-16T18:16:09.542816] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-16T18:16:09.672567] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:16:10.304433] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T18:16:10.342778] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-16T18:16:11.005144] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:16:11.142784] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-16T18:16:11.942788] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-16T18:16:12.053686] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:16:12.359271] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T18:16:12.742790] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-16T18:16:12.804538] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:16:12.811549] [INFO ] [REMOTE ] CTRI: Full fetch complete (53266 records). [2025-10-16T18:16:12.811747] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-16T18:16:12.812446] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:16:12.812548] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:12.812591] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:12.812629] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-16T18:16:12.812750] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-16T18:16:12.812810] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-16T18:16:12.812858] [DEBUG] [LOCAL ] CTRI: No derivative data file found to delete. [2025-10-16T18:16:12.812914] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTRI took 46.1s. Estimated remaining: 4h 10m 40s. Rate: 7.2 symbols/min [2025-10-16T18:16:13.014477] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:13.040681] [DEBUG] [LOCAL ] CUBI: Loaded 27163 existing records from primary storage. [2025-10-16T18:16:13.040946] [INFO ] [MAIN ] CUBI: Loaded 27163 existing records. [2025-10-16T18:16:13.116915] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T18:16:13.239272] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:13.239535] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-16T18:16:13.239585] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-16T18:16:13.240059] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-16T18:16:13.240115] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-16T18:16:13.547947] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-16T18:16:13.585964] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:14.342886] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-16T18:16:14.705816] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:16:15.142810] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-16T18:16:15.260356] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:16:15.942820] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-16T18:16:16.288590] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:16:16.742835] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-16T18:16:16.968395] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T18:16:17.120209] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T18:16:17.120983] [INFO ] [REMOTE ] CUBB: Full fetch complete (965 records). [2025-10-16T18:16:17.121054] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-16T18:16:17.303425] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T18:16:17.303634] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:17.303726] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:17.303799] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-16T18:16:17.303863] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-16T18:16:17.303900] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-16T18:16:17.303990] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-16T18:16:17.304063] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CUBB took 19.0s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-16T18:16:17.478286] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:17.524679] [DEBUG] [LOCAL ] CUK: Loaded 51046 existing records from primary storage. [2025-10-16T18:16:17.525004] [INFO ] [MAIN ] CUK: Loaded 51046 existing records. [2025-10-16T18:16:17.553196] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-16T18:16:17.701172] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:17.701402] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-16T18:16:17.701449] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-16T18:16:17.702249] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-16T18:16:17.702309] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-16T18:16:18.046704] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:18.342866] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-16T18:16:19.142789] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-16T18:16:19.270618] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:16:19.582731] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:16:19.942801] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-16T18:16:20.742812] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-16T18:16:20.832577] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:16:21.542822] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-16T18:16:21.655569] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T18:16:21.920528] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T18:16:22.342812] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-16T18:16:23.142843] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-16T18:16:23.266726] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:16:23.369767] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:16:23.942840] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-16T18:16:24.742824] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-16T18:16:25.152404] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:16:25.542813] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-16T18:16:25.601478] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:16:26.266873] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:16:26.342789] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-16T18:16:27.142856] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-16T18:16:27.362372] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:16:27.942793] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-16T18:16:28.056891] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:16:28.630473] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:16:28.742782] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-16T18:16:29.045552] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:16:29.542813] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-16T18:16:30.342879] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-16T18:16:30.742634] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:16:31.142783] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-16T18:16:31.178262] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T18:16:31.184767] [INFO ] [REMOTE ] CTVA: Full fetch complete (76821 records). [2025-10-16T18:16:31.184903] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-16T18:16:31.186539] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:16:31.186629] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:16:31.186723] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:16:31.186793] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-16T18:16:31.186854] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-16T18:16:31.186888] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-16T18:16:31.187041] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-16T18:16:31.188017] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTVA took 39.3s. Estimated remaining: 4h 10m 29s. Rate: 7.2 symbols/min [2025-10-16T18:16:31.360829] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:31.361095] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-16T18:16:31.361150] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-16T18:16:31.361267] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-16T18:16:31.361321] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-16T18:16:31.361373] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-16T18:16:31.361406] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-16T18:16:31.729753] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:31.942855] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-16T18:16:32.184084] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:16:32.742789] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-16T18:16:32.934763] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:16:33.090548] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-16T18:16:33.542806] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-16T18:16:34.269595] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T18:16:34.342772] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-16T18:16:34.588314] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:16:35.142801] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-16T18:16:35.921196] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:16:35.942776] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-16T18:16:36.216327] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T18:16:36.742823] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-16T18:16:37.279604] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:16:37.542830] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-16T18:16:37.684546] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:16:38.250084] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:16:38.342829] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-16T18:16:39.142886] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-16T18:16:39.399987] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:16:39.942873] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-16T18:16:40.705348] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:16:40.742770] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-16T18:16:41.212589] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T18:16:41.542842] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-16T18:16:42.342836] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-16T18:16:42.439572] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T18:16:42.520742] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:16:42.524243] [INFO ] [REMOTE ] CUBI: Full fetch complete (39206 records). [2025-10-16T18:16:42.524346] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-16T18:16:42.794235] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T18:16:42.901787] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-16T18:16:42.901878] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-16T18:16:42.902489] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-16T18:16:42.902528] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-16T18:16:42.903442] [DEBUG] [LOCAL ] CUBI: Trimmed 39206 records to 27422 (keeping 200 days of data) [2025-10-16T18:16:43.056763] [DEBUG] [LOCAL ] CUBI: Primary data saved (27422 records). [2025-10-16T18:16:43.056893] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-16T18:16:43.056972] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBI took 30.2s. Estimated remaining: 4h 10m 33s. Rate: 7.2 symbols/min [2025-10-16T18:16:43.147950] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-16T18:16:43.239238] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:43.271278] [DEBUG] [LOCAL ] CURB: Loaded 32854 existing records from primary storage. [2025-10-16T18:16:43.271544] [INFO ] [MAIN ] CURB: Loaded 32854 existing records. [2025-10-16T18:16:43.447012] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:43.447238] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-16T18:16:43.447284] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-16T18:16:43.447483] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-16T18:16:43.447539] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-16T18:16:43.789943] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:43.942822] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-16T18:16:44.341690] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:16:44.742796] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-16T18:16:45.075274] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:16:45.082002] [INFO ] [REMOTE ] CUBE: Full fetch complete (73240 records). [2025-10-16T18:16:45.082125] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-16T18:16:45.497270] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-16T18:16:45.497400] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-16T18:16:45.498325] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-16T18:16:45.498391] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-16T18:16:45.500032] [DEBUG] [LOCAL ] CUBE: Trimmed 73240 records to 51290 (keeping 200 days of data) [2025-10-16T18:16:45.553992] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-16T18:16:45.814856] [DEBUG] [LOCAL ] CUBE: Primary data saved (51290 records). [2025-10-16T18:16:45.814994] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-16T18:16:45.815074] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUBE took 39.9s. Estimated remaining: 4h 10m 7s. Rate: 7.2 symbols/min [2025-10-16T18:16:45.986024] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:16:46.014960] [DEBUG] [LOCAL ] CURV: Loaded 26989 existing records from primary storage. [2025-10-16T18:16:46.015284] [INFO ] [MAIN ] CURV: Loaded 26989 existing records. [2025-10-16T18:16:46.208084] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:16:46.213782] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-16T18:16:46.214102] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-16T18:16:46.214037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T18:16:46.216488] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-16T18:16:46.218753] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-16T18:16:46.347918] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-16T18:16:46.589716] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:16:46.635577] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:16:47.073111] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:16:47.142799] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-16T18:16:47.942802] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-16T18:16:48.343188] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T18:16:48.639477] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:16:48.742814] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-16T18:16:49.542831] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-16T18:16:50.342802] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-16T18:16:50.366254] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:16:51.142840] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-16T18:16:51.441365] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:16:51.782042] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T18:16:51.942787] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-16T18:16:52.043207] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T18:16:52.397005] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-16T18:16:52.742796] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-16T18:16:53.126746] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T18:16:53.542837] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-16T18:16:54.342837] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-16T18:16:54.773691] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T18:16:55.142838] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-16T18:16:55.345494] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:16:55.353142] [INFO ] [REMOTE ] CUK: Full fetch complete (74298 records). [2025-10-16T18:16:55.353398] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-16T18:16:55.750232] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-16T18:16:55.750310] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-16T18:16:55.751269] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-16T18:16:55.751335] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-16T18:16:55.752793] [DEBUG] [LOCAL ] CUK: Trimmed 74298 records to 51433 (keeping 200 days of data) [2025-10-16T18:16:55.952384] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-16T18:16:56.056926] [DEBUG] [LOCAL ] CUK: Primary data saved (51433 records). [2025-10-16T18:16:56.057086] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-16T18:16:56.057809] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUK took 38.8s. Estimated remaining: 4h 10m 5s. Rate: 7.2 symbols/min [2025-10-16T18:16:56.366491] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:16:56.541227] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T18:16:56.742844] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-16T18:16:57.542807] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-16T18:16:57.773181] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:16:58.342796] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-16T18:16:58.918365] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T18:16:59.142784] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-16T18:16:59.460322] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:16:59.652379] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T18:16:59.653310] [INFO ] [REMOTE ] CULP: Full fetch complete (4573 records). [2025-10-16T18:16:59.653381] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-16T18:16:59.947910] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-16T18:17:00.015943] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-16T18:17:00.016017] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-16T18:17:00.016167] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-16T18:17:00.016208] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-16T18:17:00.016557] [DEBUG] [LOCAL ] CULP: Trimmed 4573 records to 2930 (keeping 200 days of data) [2025-10-16T18:17:00.032870] [DEBUG] [LOCAL ] CULP: Primary data saved (2930 records). [2025-10-16T18:17:00.032952] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-16T18:17:00.033017] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CULP took 28.8s. Estimated remaining: 4h 9m 42s. Rate: 7.3 symbols/min [2025-10-16T18:17:00.742864] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-16T18:17:00.962869] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:17:01.542892] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-16T18:17:02.265881] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:17:02.342785] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-16T18:17:02.512434] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T18:17:03.142817] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-16T18:17:03.520041] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:17:03.942919] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-16T18:17:04.008892] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:17:04.742925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-16T18:17:05.297928] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T18:17:05.542862] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-16T18:17:05.766204] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T18:17:06.342924] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-16T18:17:06.905366] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T18:17:07.142784] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-16T18:17:07.430161] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T18:17:07.942825] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-16T18:17:08.580992] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:17:08.742830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-16T18:17:08.923413] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T18:17:09.542875] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-16T18:17:10.148777] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:17:10.342830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-16T18:17:10.916256] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T18:17:10.920393] [INFO ] [REMOTE ] CURV: Full fetch complete (38707 records). [2025-10-16T18:17:10.920484] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-16T18:17:10.921053] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:17:10.921136] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:17:10.921179] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:17:10.921245] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-16T18:17:10.921306] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-16T18:17:10.921352] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-10-16T18:17:10.921525] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-10-16T18:17:10.921669] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURV took 25.1s. Estimated remaining: 4h 9m 43s. Rate: 7.2 symbols/min [2025-10-16T18:17:11.535120] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:17:11.540389] [INFO ] [REMOTE ] CURB: Full fetch complete (47331 records). [2025-10-16T18:17:11.540521] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-16T18:17:11.957578] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-16T18:17:11.957682] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-16T18:17:11.958400] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-16T18:17:11.958442] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-16T18:17:11.959449] [DEBUG] [LOCAL ] CURB: Trimmed 47331 records to 33087 (keeping 200 days of data) [2025-10-16T18:17:12.157614] [DEBUG] [LOCAL ] CURB: Primary data saved (33087 records). [2025-10-16T18:17:12.157794] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-16T18:17:12.157880] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 29.1s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-16T18:17:12.898816] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.906903] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.905106] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.917835] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-16T18:17:12.933125] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-16T18:17:12.939900] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-16T18:17:12.939428] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:12.940150] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-16T18:17:12.940436] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-16T18:17:12.940630] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-16T18:17:13.033140] [DEBUG] [LOCAL ] CVEO: Loaded 15382 existing records from primary storage. [2025-10-16T18:17:13.056467] [INFO ] [MAIN ] CVEO: Loaded 15382 existing records. [2025-10-16T18:17:13.326938] [DEBUG] [LOCAL ] CVI: Loaded 46660 existing records from primary storage. [2025-10-16T18:17:13.462409] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:13.456862] [INFO ] [MAIN ] CVI: Loaded 46660 existing records. [2025-10-16T18:17:13.479794] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-16T18:17:13.540627] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-16T18:17:13.579847] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-16T18:17:13.574469] [DEBUG] [LOCAL ] CUZ: Loaded 49639 existing records from primary storage. [2025-10-16T18:17:13.579958] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-16T18:17:13.642288] [INFO ] [MAIN ] CUZ: Loaded 49639 existing records. [2025-10-16T18:17:13.839857] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:13.966003] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:13.902338] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-16T18:17:14.015616] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-16T18:17:14.081736] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-16T18:17:14.173686] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-16T18:17:14.190227] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-16T18:17:14.173608] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:14.205525] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-16T18:17:14.205702] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-16T18:17:14.255852] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-16T18:17:14.291764] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-16T18:17:14.543324] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:14.574012] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-16T18:17:15.115598] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:15.126815] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-16T18:17:15.147982] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:15.148270] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-16T18:17:15.408618] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:17:15.411835] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-16T18:17:15.921847] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T18:17:15.932723] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-16T18:17:16.155078] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T18:17:16.157324] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-16T18:17:16.384604] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:17:16.750497] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-16T18:17:16.755426] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:17:16.960053] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:17:17.334000] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:17:17.542810] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-16T18:17:18.344183] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-16T18:17:18.346566] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:17:18.518737] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:17:19.142858] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-16T18:17:19.942795] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-16T18:17:20.144060] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T18:17:20.655027] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:17:20.687379] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:17:20.742822] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-16T18:17:21.542831] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-16T18:17:22.214264] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:17:22.342810] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-16T18:17:23.034049] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:17:23.142783] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-16T18:17:23.830492] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:17:23.942794] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-16T18:17:24.350023] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:17:24.742831] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-16T18:17:25.542801] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-16T18:17:25.894620] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:17:26.342773] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-16T18:17:26.456198] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T18:17:26.886288] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:17:27.142810] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-16T18:17:27.942784] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-16T18:17:28.259717] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T18:17:28.742808] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-16T18:17:28.852853] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:17:29.267467] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:17:29.542832] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-16T18:17:30.342791] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-16T18:17:30.558972] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:17:30.607020] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:17:31.142832] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-16T18:17:31.743693] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:17:31.942825] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-16T18:17:32.742783] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-16T18:17:33.094164] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:17:33.189103] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T18:17:33.542811] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-16T18:17:34.228072] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:17:34.342784] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-16T18:17:34.498303] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:17:35.142805] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-16T18:17:35.583445] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T18:17:35.942812] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-16T18:17:36.742803] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-16T18:17:36.867843] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:17:37.343070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:17:37.542781] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-16T18:17:37.651364] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T18:17:38.342884] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-16T18:17:39.132148] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:17:39.142839] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-16T18:17:39.799257] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:17:39.942800] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-16T18:17:40.724554] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T18:17:40.742781] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-16T18:17:40.928929] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:17:41.542862] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-16T18:17:42.342847] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-16T18:17:42.484786] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:17:43.142873] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-16T18:17:43.238368] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:17:43.272579] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:17:43.282587] [INFO ] [REMOTE ] CVI: Full fetch complete (67274 records). [2025-10-16T18:17:43.282922] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-16T18:17:43.693268] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-16T18:17:43.693377] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-16T18:17:43.694520] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-16T18:17:43.694587] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-16T18:17:43.696410] [DEBUG] [LOCAL ] CVI: Trimmed 67274 records to 47001 (keeping 200 days of data) [2025-10-16T18:17:43.943586] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-16T18:17:43.992312] [DEBUG] [LOCAL ] CVI: Primary data saved (47001 records). [2025-10-16T18:17:43.992505] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-16T18:17:43.992602] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVI took 31.8s. Estimated remaining: 4h 10m 19s. Rate: 7.2 symbols/min [2025-10-16T18:17:44.171117] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:44.171464] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-16T18:17:44.171509] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-16T18:17:44.171707] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-16T18:17:44.171762] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-16T18:17:44.171806] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-16T18:17:44.171854] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-16T18:17:44.544700] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:44.742837] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-16T18:17:44.867960] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:17:44.870752] [INFO ] [REMOTE ] CVEO: Full fetch complete (20713 records). [2025-10-16T18:17:44.870871] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-16T18:17:44.871549] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:17:44.871680] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:17:44.871743] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:17:44.871815] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-16T18:17:44.871975] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-16T18:17:44.872036] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-16T18:17:44.872391] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-16T18:17:44.872495] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVEO took 32.7s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-16T18:17:45.061786] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:45.062058] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-16T18:17:45.062138] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-16T18:17:45.062622] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-16T18:17:45.062714] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-16T18:17:45.062773] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-16T18:17:45.062810] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-16T18:17:45.181391] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T18:17:45.508995] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:45.542777] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-16T18:17:46.130356] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:17:46.137829] [INFO ] [REMOTE ] CUZ: Full fetch complete (70920 records). [2025-10-16T18:17:46.138076] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-16T18:17:46.353795] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-16T18:17:46.563544] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-16T18:17:46.563670] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-16T18:17:46.564996] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-16T18:17:46.565064] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-16T18:17:46.566958] [DEBUG] [LOCAL ] CUZ: Trimmed 70920 records to 50005 (keeping 200 days of data) [2025-10-16T18:17:46.907263] [DEBUG] [LOCAL ] CUZ: Primary data saved (50005 records). [2025-10-16T18:17:46.907513] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-16T18:17:46.907678] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CUZ took 34.7s. Estimated remaining: 4h 9m 19s. Rate: 7.2 symbols/min [2025-10-16T18:17:47.099596] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:47.142850] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-16T18:17:47.158925] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:17:47.179352] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:17:47.199912] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-16T18:17:47.200351] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-16T18:17:47.380821] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:47.381076] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-16T18:17:47.381129] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-16T18:17:47.381395] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-16T18:17:47.381457] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-16T18:17:47.747147] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:47.942840] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-16T18:17:48.742896] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-16T18:17:49.065146] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T18:17:49.072784] [INFO ] [REMOTE ] CVE: Full fetch complete (77716 records). [2025-10-16T18:17:49.072968] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-16T18:17:49.474672] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-16T18:17:49.474803] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-16T18:17:49.476282] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-16T18:17:49.476350] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-16T18:17:49.478367] [DEBUG] [LOCAL ] CVE: Trimmed 77716 records to 53952 (keeping 200 days of data) [2025-10-16T18:17:49.547445] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-16T18:17:49.869331] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-16T18:17:49.873582] [DEBUG] [LOCAL ] CVE: Primary data saved (53952 records). [2025-10-16T18:17:49.884860] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-16T18:17:49.885017] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 37.7s. Estimated remaining: 4h 8m 53s. Rate: 7.3 symbols/min [2025-10-16T18:17:50.071595] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:17:50.138134] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-16T18:17:50.138560] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-16T18:17:50.342590] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:17:50.343337] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-16T18:17:50.343113] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-16T18:17:50.352879] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-16T18:17:50.356860] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-16T18:17:50.356940] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-16T18:17:50.357468] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T18:17:50.760464] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:17:51.082411] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-16T18:17:51.142800] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-16T18:17:51.942858] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-16T18:17:52.238397] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T18:17:52.719110] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:17:52.742834] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-16T18:17:53.057730] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T18:17:53.542830] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-16T18:17:54.342906] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-16T18:17:54.911751] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-16T18:17:55.058994] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:17:55.080617] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:17:55.142823] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-16T18:17:55.942798] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-16T18:17:56.272854] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:17:56.742867] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-16T18:17:57.542810] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-16T18:17:57.641058] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:17:57.810947] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:17:58.342848] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-16T18:17:59.142844] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-16T18:17:59.750771] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T18:17:59.942790] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-16T18:18:00.355751] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T18:18:00.742990] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-16T18:18:01.542792] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-16T18:18:01.628675] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-16T18:18:02.333961] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-16T18:18:02.345587] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-16T18:18:02.722554] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:18:02.909071] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-16T18:18:03.142881] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-16T18:18:03.942893] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-16T18:18:04.289569] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T18:18:04.531399] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:18:04.742800] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-16T18:18:05.044581] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T18:18:05.341079] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:18:05.542832] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-16T18:18:06.342855] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-16T18:18:06.373941] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T18:18:07.142814] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-16T18:18:07.942787] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-16T18:18:08.423947] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-16T18:18:08.742828] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-16T18:18:08.991556] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:18:09.109952] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T18:18:09.113050] [INFO ] [REMOTE ] CVLG: Full fetch complete (21345 records). [2025-10-16T18:18:09.113173] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-16T18:18:09.471016] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-16T18:18:09.471090] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-16T18:18:09.471537] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-16T18:18:09.471577] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-16T18:18:09.472156] [DEBUG] [LOCAL ] CVLG: Trimmed 21345 records to 15699 (keeping 200 days of data) [2025-10-16T18:18:09.555475] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-16T18:18:09.570448] [DEBUG] [LOCAL ] CVLG: Primary data saved (15699 records). [2025-10-16T18:18:09.570680] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-16T18:18:09.570832] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 25.6s. Estimated remaining: 4h 9m 22s. Rate: 7.2 symbols/min [2025-10-16T18:18:09.738503] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:09.761470] [DEBUG] [LOCAL ] CW: Loaded 22100 existing records from primary storage. [2025-10-16T18:18:09.761761] [INFO ] [MAIN ] CW: Loaded 22100 existing records. [2025-10-16T18:18:09.932990] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:09.933201] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-16T18:18:09.933249] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-16T18:18:09.933526] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-16T18:18:09.933581] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-16T18:18:10.273912] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:10.342781] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-16T18:18:10.578118] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:18:11.142878] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-16T18:18:11.332026] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T18:18:11.429343] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T18:18:11.942813] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-16T18:18:12.742821] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-16T18:18:13.401516] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:18:13.542818] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-16T18:18:13.836017] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-16T18:18:14.342787] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-16T18:18:15.142864] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-16T18:18:15.912209] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-16T18:18:15.942814] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-16T18:18:16.462951] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (3.72 seconds). [2025-10-16T18:18:16.742819] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-16T18:18:17.113877] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-16T18:18:17.139099] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:18:17.521069] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T18:18:17.542754] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-16T18:18:18.342782] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-16T18:18:18.424889] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:18:18.731434] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:18:19.142814] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-16T18:18:19.942800] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-16T18:18:20.580270] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-16T18:18:20.742776] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-16T18:18:20.813173] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T18:18:21.153975] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T18:18:21.542812] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-16T18:18:22.342787] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-16T18:18:22.436043] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:18:22.443904] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-16T18:18:22.444116] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-16T18:18:22.852822] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-16T18:18:22.853006] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-16T18:18:22.854069] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-16T18:18:22.854227] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-16T18:18:22.856124] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54084 (keeping 200 days of data) [2025-10-16T18:18:23.110630] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-16T18:18:23.144408] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-16T18:18:23.252634] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-16T18:18:23.252812] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-16T18:18:23.253579] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVS took 36.3s. Estimated remaining: 4h 9m 31s. Rate: 7.2 symbols/min [2025-10-16T18:18:23.458049] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:23.529387] [DEBUG] [LOCAL ] CWAN: Loaded 52616 existing records from primary storage. [2025-10-16T18:18:23.529863] [INFO ] [MAIN ] CWAN: Loaded 52616 existing records. [2025-10-16T18:18:23.806691] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:23.807018] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-16T18:18:23.807092] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-16T18:18:23.807504] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-16T18:18:23.807579] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-16T18:18:23.953056] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-16T18:18:24.294961] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:24.398042] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:18:24.404958] [INFO ] [REMOTE ] CVNA: Full fetch complete (76387 records). [2025-10-16T18:18:24.405139] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-16T18:18:24.406021] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:18:24.406137] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:18:24.406191] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:18:24.406474] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-16T18:18:24.406557] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-16T18:18:24.406629] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-16T18:18:24.406783] [DEBUG] [LOCAL ] CVNA: No derivative data file found to delete. [2025-10-16T18:18:24.406881] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVNA took 39.5s. Estimated remaining: 4h 8m 60s. Rate: 7.2 symbols/min [2025-10-16T18:18:24.618852] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:24.633901] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:18:24.676011] [DEBUG] [LOCAL ] CWEN: Loaded 45322 existing records from primary storage. [2025-10-16T18:18:24.676303] [INFO ] [MAIN ] CWEN: Loaded 45322 existing records. [2025-10-16T18:18:24.749956] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-16T18:18:24.853512] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:24.853756] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-16T18:18:24.853809] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-16T18:18:24.853984] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-16T18:18:24.854021] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-16T18:18:25.203971] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:25.542819] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-16T18:18:26.358551] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-16T18:18:26.361777] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-16T18:18:26.432195] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:18:26.598008] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:18:27.142860] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-16T18:18:27.730334] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:18:27.942806] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-16T18:18:28.422990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T18:18:28.742875] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-16T18:18:29.542870] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-16T18:18:30.171946] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-16T18:18:30.220065] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:18:30.342805] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-16T18:18:31.142803] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-16T18:18:31.195841] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:18:31.942795] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-16T18:18:32.742809] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-16T18:18:33.070412] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T18:18:33.243883] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-10-16T18:18:33.542817] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-16T18:18:34.342849] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-16T18:18:34.603931] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-16T18:18:35.142810] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-16T18:18:35.221411] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:18:35.229733] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-16T18:18:35.229939] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-16T18:18:35.668558] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-16T18:18:35.694754] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-16T18:18:35.699421] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-16T18:18:35.710156] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-16T18:18:35.711995] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-16T18:18:35.712094] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-16T18:18:35.713906] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 54150 (keeping 200 days of data) [2025-10-16T18:18:35.952224] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-16T18:18:36.050212] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-16T18:18:36.050345] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-16T18:18:36.051321] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVX took 46.2s. Estimated remaining: 4h 9m 2s. Rate: 7.2 symbols/min [2025-10-16T18:18:36.226306] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:36.281787] [DEBUG] [LOCAL ] CWH: Loaded 51349 existing records from primary storage. [2025-10-16T18:18:36.282298] [INFO ] [MAIN ] CWH: Loaded 51349 existing records. [2025-10-16T18:18:36.472700] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:36.473060] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-16T18:18:36.473167] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-16T18:18:36.473525] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-16T18:18:36.473598] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-16T18:18:36.645969] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:18:36.747946] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-16T18:18:36.882589] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:37.542799] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-16T18:18:37.627688] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:18:38.342783] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-16T18:18:38.466776] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:18:38.555183] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-16T18:18:38.558464] [INFO ] [REMOTE ] CW: Full fetch complete (33033 records). [2025-10-16T18:18:38.558574] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-16T18:18:38.559202] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:18:38.559292] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:18:38.559357] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:18:38.559431] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-16T18:18:38.559495] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-16T18:18:38.559532] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-10-16T18:18:38.559687] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-10-16T18:18:38.559777] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 29.0s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-16T18:18:38.761789] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:38.812352] [DEBUG] [LOCAL ] CWK: Loaded 49628 existing records from primary storage. [2025-10-16T18:18:38.812764] [INFO ] [MAIN ] CWK: Loaded 49628 existing records. [2025-10-16T18:18:39.025112] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:39.025407] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-16T18:18:39.025483] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-16T18:18:39.025806] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-16T18:18:39.025867] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-16T18:18:39.145178] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-16T18:18:39.420754] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:39.749850] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:18:39.942836] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-16T18:18:40.263580] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T18:18:40.742867] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-16T18:18:41.542791] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-16T18:18:41.706052] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:18:42.349679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-16T18:18:42.355383] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T18:18:42.994253] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:18:43.142832] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-16T18:18:43.942840] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-16T18:18:44.031299] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:18:44.233390] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:18:44.742821] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-16T18:18:45.542861] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-16T18:18:45.760405] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:18:46.055452] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:18:46.342834] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-16T18:18:47.142874] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-16T18:18:47.719143] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-16T18:18:47.942786] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-16T18:18:48.261680] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:18:48.286006] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T18:18:48.742910] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-16T18:18:49.542796] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-16T18:18:49.649094] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:18:50.084132] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:18:50.342875] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-16T18:18:50.897759] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T18:18:51.142845] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-16T18:18:51.800010] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:18:51.942821] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-16T18:18:52.742802] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-16T18:18:52.869857] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:18:53.485855] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-16T18:18:53.492677] [INFO ] [REMOTE ] CWAN: Full fetch complete (75552 records). [2025-10-16T18:18:53.492841] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-16T18:18:53.552229] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-16T18:18:53.898182] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-16T18:18:53.898272] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-16T18:18:53.899344] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-16T18:18:53.899419] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-16T18:18:53.901029] [DEBUG] [LOCAL ] CWAN: Trimmed 75552 records to 53002 (keeping 200 days of data) [2025-10-16T18:18:54.145037] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:18:54.256789] [DEBUG] [LOCAL ] CWAN: Primary data saved (53002 records). [2025-10-16T18:18:54.256928] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-16T18:18:54.257536] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 31.0s. Estimated remaining: 4h 8m 50s. Rate: 7.2 symbols/min [2025-10-16T18:18:54.350780] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-16T18:18:54.433353] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:54.463307] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-16T18:18:54.463570] [INFO ] [MAIN ] CWT: Loaded 28121 existing records. [2025-10-16T18:18:54.650859] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:18:54.651057] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-16T18:18:54.651104] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-16T18:18:54.651275] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-16T18:18:54.651315] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-16T18:18:55.023451] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:55.142860] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-16T18:18:55.527054] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:18:55.625855] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:18:55.942808] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-16T18:18:56.662617] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:18:56.669176] [INFO ] [REMOTE ] CWEN: Full fetch complete (65474 records). [2025-10-16T18:18:56.669324] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-16T18:18:56.752346] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-16T18:18:57.085330] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-16T18:18:57.085424] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-16T18:18:57.086275] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-16T18:18:57.086338] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-16T18:18:57.087574] [DEBUG] [LOCAL ] CWEN: Trimmed 65474 records to 45638 (keeping 200 days of data) [2025-10-16T18:18:57.359305] [DEBUG] [LOCAL ] CWEN: Primary data saved (45638 records). [2025-10-16T18:18:57.359430] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-16T18:18:57.359505] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 33.0s. Estimated remaining: 4h 8m 26s. Rate: 7.2 symbols/min [2025-10-16T18:18:57.544046] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:18:57.544463] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-10-16T18:18:57.544187] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-16T18:18:57.545457] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-10-16T18:18:57.545725] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-16T18:18:57.545800] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-16T18:18:57.546017] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-16T18:18:57.546090] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-16T18:18:57.903835] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-16T18:18:57.956445] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:18:58.149359] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:18:58.342843] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-16T18:18:58.402917] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T18:18:59.142840] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-16T18:18:59.833133] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:18:59.942841] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-16T18:19:00.362806] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T18:19:00.742812] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-16T18:19:01.542782] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-16T18:19:01.754130] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:19:01.786299] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:19:02.342842] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-16T18:19:03.110071] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:19:03.142849] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-16T18:19:03.942795] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-16T18:19:04.057478] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:19:04.742844] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-16T18:19:04.907853] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:19:04.969089] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:19:05.542859] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-16T18:19:06.119686] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:19:06.342838] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-16T18:19:07.142853] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-16T18:19:07.457866] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T18:19:07.928431] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T18:19:07.942767] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-16T18:19:08.742767] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-16T18:19:08.907806] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T18:19:08.914160] [INFO ] [REMOTE ] CWH: Full fetch complete (73212 records). [2025-10-16T18:19:08.914314] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-16T18:19:09.315610] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-16T18:19:09.315822] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-16T18:19:09.316815] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-16T18:19:09.316995] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-16T18:19:09.347033] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:19:09.347176] [DEBUG] [LOCAL ] CWH: Trimmed 73212 records to 51694 (keeping 200 days of data) [2025-10-16T18:19:09.564955] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-16T18:19:09.671698] [DEBUG] [LOCAL ] CWH: Primary data saved (51694 records). [2025-10-16T18:19:09.671853] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-16T18:19:09.672769] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 33.6s. Estimated remaining: 4h 8m 30s. Rate: 7.2 symbols/min [2025-10-16T18:19:09.848072] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:09.858165] [DEBUG] [LOCAL ] CXE: Loaded 6145 existing records from primary storage. [2025-10-16T18:19:09.858424] [INFO ] [MAIN ] CXE: Loaded 6145 existing records. [2025-10-16T18:19:10.031802] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:10.032073] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-16T18:19:10.032194] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-16T18:19:10.032393] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-16T18:19:10.032449] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-16T18:19:10.385816] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-16T18:19:10.412811] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:10.429040] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:19:11.142793] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-16T18:19:11.272845] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-16T18:19:11.942787] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-16T18:19:12.138567] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:19:12.145540] [INFO ] [REMOTE ] CWK: Full fetch complete (71291 records). [2025-10-16T18:19:12.145798] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-16T18:19:12.292841] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:19:12.563574] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-16T18:19:12.563675] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-16T18:19:12.564553] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-16T18:19:12.564595] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-16T18:19:12.565887] [DEBUG] [LOCAL ] CWK: Trimmed 71291 records to 49995 (keeping 200 days of data) [2025-10-16T18:19:12.759851] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-16T18:19:12.848737] [DEBUG] [LOCAL ] CWK: Primary data saved (49995 records). [2025-10-16T18:19:12.848905] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-16T18:19:12.849705] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 34.3s. Estimated remaining: 4h 8m 6s. Rate: 7.2 symbols/min [2025-10-16T18:19:13.015092] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:13.022090] [DEBUG] [LOCAL ] CXH: Loaded 4432 existing records from primary storage. [2025-10-16T18:19:13.022298] [INFO ] [MAIN ] CXH: Loaded 4432 existing records. [2025-10-16T18:19:13.197255] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:13.197496] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-16T18:19:13.197546] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-16T18:19:13.197733] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-16T18:19:13.197790] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-16T18:19:13.502558] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:19:13.549908] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-16T18:19:13.590223] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:13.680728] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:19:14.342810] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-16T18:19:14.784511] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T18:19:15.142804] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-16T18:19:15.740302] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:19:15.942869] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-16T18:19:15.985732] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T18:19:16.742956] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-16T18:19:17.542842] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-16T18:19:18.007878] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:19:18.062270] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T18:19:18.111327] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T18:19:18.342822] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-16T18:19:19.142809] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-16T18:19:19.942821] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-16T18:19:19.962420] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T18:19:20.081625] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:19:20.400489] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T18:19:20.742876] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-16T18:19:21.542829] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-16T18:19:21.571127] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T18:19:22.342842] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-16T18:19:22.836837] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:19:23.142869] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-16T18:19:23.162008] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T18:19:23.942829] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-16T18:19:24.422004] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T18:19:24.422499] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:19:24.429040] [INFO ] [REMOTE ] CWT: Full fetch complete (41075 records). [2025-10-16T18:19:24.429145] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-16T18:19:24.756179] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-16T18:19:24.809225] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-16T18:19:24.809319] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-16T18:19:24.810099] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-16T18:19:24.810166] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-16T18:19:24.811261] [DEBUG] [LOCAL ] CWT: Trimmed 41075 records to 28331 (keeping 200 days of data) [2025-10-16T18:19:24.985878] [DEBUG] [LOCAL ] CWT: Primary data saved (28331 records). [2025-10-16T18:19:24.986024] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-16T18:19:24.986151] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CWT took 30.7s. Estimated remaining: 4h 8m 9s. Rate: 7.2 symbols/min [2025-10-16T18:19:25.194550] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:25.237976] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-16T18:19:25.238283] [INFO ] [MAIN ] CXM: Loaded 47569 existing records. [2025-10-16T18:19:25.415241] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:25.415436] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-16T18:19:25.415483] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-16T18:19:25.415696] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-16T18:19:25.415795] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-16T18:19:25.545292] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-16T18:19:25.651823] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T18:19:25.820918] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:25.973088] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:19:26.342817] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-16T18:19:27.142836] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-16T18:19:27.909374] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:19:27.942826] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-16T18:19:28.742858] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-16T18:19:28.881501] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:19:29.378940] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T18:19:29.411040] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T18:19:29.542781] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-16T18:19:30.342831] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-16T18:19:30.984730] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:19:31.104222] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:19:31.142828] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-16T18:19:31.942871] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-16T18:19:32.742806] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-16T18:19:32.982545] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:19:33.150308] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:19:33.504770] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:19:33.542866] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-16T18:19:34.342818] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-16T18:19:35.127302] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:19:35.142812] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-16T18:19:35.446349] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:19:35.703728] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:19:35.942781] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-16T18:19:36.691991] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T18:19:36.742769] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-16T18:19:37.445202] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T18:19:37.542791] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-16T18:19:38.101201] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:19:38.343008] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-16T18:19:39.142821] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-16T18:19:39.717587] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T18:19:39.942802] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-16T18:19:39.988081] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:19:40.742831] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-16T18:19:41.239276] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:19:41.240573] [INFO ] [REMOTE ] CXE: Full fetch complete (11472 records). [2025-10-16T18:19:41.240665] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-16T18:19:41.545034] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-16T18:19:41.635080] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-16T18:19:41.635307] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-16T18:19:41.637005] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T18:19:41.636085] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-16T18:19:41.645979] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-16T18:19:41.647266] [DEBUG] [LOCAL ] CXE: Trimmed 11472 records to 6167 (keeping 200 days of data) [2025-10-16T18:19:41.681616] [DEBUG] [LOCAL ] CXE: Primary data saved (6167 records). [2025-10-16T18:19:41.681720] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-16T18:19:41.681801] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CXE took 32.0s. Estimated remaining: 4h 8m 27s. Rate: 7.2 symbols/min [2025-10-16T18:19:41.847754] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:41.878505] [DEBUG] [LOCAL ] CXT: Loaded 31065 existing records from primary storage. [2025-10-16T18:19:41.878800] [INFO ] [MAIN ] CXT: Loaded 31065 existing records. [2025-10-16T18:19:42.054536] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:42.054826] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-16T18:19:42.054883] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-16T18:19:42.055220] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-16T18:19:42.055287] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-16T18:19:42.159072] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T18:19:42.347970] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-16T18:19:42.407451] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:42.805539] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:19:43.142828] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-16T18:19:43.942865] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-16T18:19:44.742798] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-16T18:19:44.824123] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T18:19:45.192822] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:19:45.193602] [INFO ] [REMOTE ] CXH: Full fetch complete (5318 records). [2025-10-16T18:19:45.193819] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-16T18:19:45.194176] [FATAL] [VALIDATOR ] CXH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:19:45.194256] [FATAL] [MAIN ] CXH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:19:45.194298] [WARN ] [MAIN ] CXH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:19:45.194363] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-16T18:19:45.194423] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-16T18:19:45.194456] [INFO ] [LOCAL ] CXH: Starting deletion of derivative data. [2025-10-16T18:19:45.194608] [DEBUG] [LOCAL ] CXH: Deleted derivative data file. [2025-10-16T18:19:45.194728] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 32.3s. Estimated remaining: 4h 8m 4s. Rate: 7.2 symbols/min [2025-10-16T18:19:45.362347] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:45.406025] [DEBUG] [LOCAL ] CXW: Loaded 43921 existing records from primary storage. [2025-10-16T18:19:45.406309] [INFO ] [MAIN ] CXW: Loaded 43921 existing records. [2025-10-16T18:19:45.544608] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-16T18:19:45.586877] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:45.587160] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-16T18:19:45.587212] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-16T18:19:45.587438] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-16T18:19:45.587527] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-16T18:19:45.887895] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T18:19:45.998532] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:46.342827] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-16T18:19:47.142816] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-16T18:19:47.203445] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:19:47.826441] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:19:47.832848] [INFO ] [REMOTE ] CX: Full fetch complete (76197 records). [2025-10-16T18:19:47.833042] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-16T18:19:47.833933] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:19:47.834020] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:19:47.834088] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:19:47.834159] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-16T18:19:47.834223] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-16T18:19:47.834259] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-10-16T18:19:47.834298] [DEBUG] [LOCAL ] CX: No derivative data file found to delete. [2025-10-16T18:19:47.834353] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 50.5s. Estimated remaining: 4h 7m 38s. Rate: 7.2 symbols/min [2025-10-16T18:19:47.947924] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-16T18:19:48.001025] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:48.028518] [DEBUG] [LOCAL ] CYD: Loaded 26842 existing records from primary storage. [2025-10-16T18:19:48.028847] [INFO ] [MAIN ] CYD: Loaded 26842 existing records. [2025-10-16T18:19:48.210007] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:48.210355] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-16T18:19:48.210428] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-16T18:19:48.210744] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-16T18:19:48.225602] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-16T18:19:48.260036] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T18:19:48.581720] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:48.742821] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-16T18:19:49.478347] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:19:49.542844] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-16T18:19:50.258731] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:19:50.342770] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-16T18:19:50.961828] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:19:51.142813] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-16T18:19:51.802722] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:19:51.942811] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-16T18:19:52.206704] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T18:19:52.742868] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-16T18:19:53.542825] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-16T18:19:53.579263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T18:19:53.647751] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:19:54.146487] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:19:54.342841] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-16T18:19:55.142838] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-16T18:19:55.824954] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:19:55.830994] [INFO ] [REMOTE ] CXM: Full fetch complete (68666 records). [2025-10-16T18:19:55.831151] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-16T18:19:55.947967] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-16T18:19:56.235336] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-16T18:19:56.235429] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-16T18:19:56.236446] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-16T18:19:56.236514] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-16T18:19:56.237925] [DEBUG] [LOCAL ] CXM: Trimmed 68666 records to 47906 (keeping 200 days of data) [2025-10-16T18:19:56.339354] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:19:56.549885] [DEBUG] [LOCAL ] CXM: Primary data saved (47906 records). [2025-10-16T18:19:56.550041] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-16T18:19:56.550763] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 31.6s. Estimated remaining: 4h 7m 31s. Rate: 7.2 symbols/min [2025-10-16T18:19:56.714385] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:19:56.742830] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-16T18:19:56.759589] [DEBUG] [LOCAL ] CYH: Loaded 47734 existing records from primary storage. [2025-10-16T18:19:56.759922] [INFO ] [MAIN ] CYH: Loaded 47734 existing records. [2025-10-16T18:19:56.934948] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:19:56.935182] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-16T18:19:56.935229] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-16T18:19:56.935632] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-16T18:19:56.935727] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-16T18:19:57.298134] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:19:57.542185] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:19:57.550765] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-16T18:19:57.878042] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T18:19:58.342848] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-16T18:19:59.142810] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-16T18:19:59.304344] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:19:59.696484] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:19:59.942871] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-16T18:20:00.742862] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-16T18:20:00.836214] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:20:01.108169] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T18:20:01.542820] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-16T18:20:02.342865] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-16T18:20:02.567257] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:20:02.876679] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T18:20:03.142806] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-16T18:20:03.942829] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-16T18:20:04.380378] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T18:20:04.742819] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-16T18:20:04.775603] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T18:20:05.210098] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:20:05.542809] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-16T18:20:05.982756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:20:06.342829] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-16T18:20:06.838447] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T18:20:07.142794] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-16T18:20:07.481884] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:20:07.942815] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-16T18:20:08.742795] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-16T18:20:08.826226] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:20:08.890426] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T18:20:09.542817] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-16T18:20:09.685697] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:20:10.342836] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-16T18:20:10.953200] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T18:20:11.142848] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-16T18:20:11.942886] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-16T18:20:12.098286] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T18:20:12.455472] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T18:20:12.742810] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-16T18:20:13.494881] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:20:13.542798] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-16T18:20:14.018353] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T18:20:14.342814] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-16T18:20:15.142787] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-16T18:20:15.261415] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T18:20:15.482500] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:20:15.942855] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-16T18:20:16.742827] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-16T18:20:17.519633] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:20:17.542774] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-16T18:20:18.221217] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:20:18.342781] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-16T18:20:18.360413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-10-16T18:20:19.035433] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:20:19.142801] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-16T18:20:19.615591] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:20:19.620224] [INFO ] [REMOTE ] CXT: Full fetch complete (45733 records). [2025-10-16T18:20:19.620380] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-16T18:20:19.948009] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-16T18:20:19.998273] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-16T18:20:19.998359] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-16T18:20:19.999194] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-16T18:20:19.999257] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-16T18:20:20.000239] [DEBUG] [LOCAL ] CXT: Trimmed 45733 records to 31299 (keeping 200 days of data) [2025-10-16T18:20:20.188349] [DEBUG] [LOCAL ] CXT: Primary data saved (31299 records). [2025-10-16T18:20:20.188531] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-16T18:20:20.188631] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 38.5s. Estimated remaining: 4h 8m 10s. Rate: 7.2 symbols/min [2025-10-16T18:20:20.354669] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:20.404722] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-10-16T18:20:20.405057] [INFO ] [MAIN ] D: Loaded 53646 existing records. [2025-10-16T18:20:20.582570] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:20.582801] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-16T18:20:20.582853] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-16T18:20:20.583071] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-16T18:20:20.583129] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-16T18:20:20.752724] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-16T18:20:20.958388] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:20.983854] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:20:21.552109] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-16T18:20:21.554280] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:20:21.560599] [INFO ] [REMOTE ] CYH: Full fetch complete (69937 records). [2025-10-16T18:20:21.560749] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-16T18:20:21.948472] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-16T18:20:21.948636] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-16T18:20:21.949765] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-16T18:20:21.949887] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-16T18:20:21.951230] [DEBUG] [LOCAL ] CYH: Trimmed 69937 records to 48083 (keeping 200 days of data) [2025-10-16T18:20:22.162413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:20:22.242930] [DEBUG] [LOCAL ] CYH: Primary data saved (48083 records). [2025-10-16T18:20:22.243059] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-16T18:20:22.243810] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CYH took 25.7s. Estimated remaining: 4h 7m 43s. Rate: 7.2 symbols/min [2025-10-16T18:20:22.347189] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-16T18:20:22.416733] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:22.432018] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-10-16T18:20:22.432246] [INFO ] [MAIN ] DAC: Loaded 12616 existing records. [2025-10-16T18:20:22.605923] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:22.606158] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-16T18:20:22.606239] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-16T18:20:22.606415] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-16T18:20:22.606456] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-16T18:20:22.958436] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:23.142789] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-16T18:20:23.168882] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:20:23.268048] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:20:23.272094] [INFO ] [REMOTE ] CYD: Full fetch complete (34852 records). [2025-10-16T18:20:23.272187] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-16T18:20:23.272774] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:20:23.272861] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:20:23.272905] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:20:23.272943] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-16T18:20:23.272999] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-16T18:20:23.273035] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-16T18:20:23.273175] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-16T18:20:23.273261] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 35.4s. Estimated remaining: 4h 7m 12s. Rate: 7.2 symbols/min [2025-10-16T18:20:23.436005] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:23.485119] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-16T18:20:23.485438] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-16T18:20:23.656624] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:23.656887] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-16T18:20:23.656938] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-16T18:20:23.657123] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-16T18:20:23.657160] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-16T18:20:23.943432] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-16T18:20:24.052956] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:24.214410] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T18:20:24.742881] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-16T18:20:25.313638] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:20:25.542805] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-16T18:20:26.342835] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-16T18:20:26.394570] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:20:27.152041] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-16T18:20:27.174036] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:20:27.940123] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:20:27.945272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-16T18:20:27.947336] [INFO ] [REMOTE ] CXW: Full fetch complete (64990 records). [2025-10-16T18:20:27.947480] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-16T18:20:28.280094] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:20:28.361715] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-16T18:20:28.361818] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-16T18:20:28.362781] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-16T18:20:28.362846] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-16T18:20:28.364323] [DEBUG] [LOCAL ] CXW: Trimmed 64990 records to 44193 (keeping 200 days of data) [2025-10-16T18:20:28.613145] [DEBUG] [LOCAL ] CXW: Primary data saved (44193 records). [2025-10-16T18:20:28.613275] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-16T18:20:28.614036] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. CXW took 43.4s. Estimated remaining: 4h 6m 55s. Rate: 7.2 symbols/min [2025-10-16T18:20:28.748027] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-16T18:20:28.796583] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:28.796802] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-16T18:20:28.796844] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-16T18:20:28.796980] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-16T18:20:28.797021] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-16T18:20:28.797060] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-16T18:20:28.797091] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-16T18:20:29.156071] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:29.543162] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-16T18:20:29.825679] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T18:20:30.342808] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-16T18:20:30.927272] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-16T18:20:30.970852] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:20:31.142818] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-16T18:20:31.942803] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-16T18:20:32.192051] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:20:32.742790] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-16T18:20:33.055084] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T18:20:33.141063] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:20:33.542839] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-16T18:20:34.349527] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-16T18:20:34.369376] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:20:35.142812] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-16T18:20:35.863348] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T18:20:35.884397] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:20:35.942768] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-16T18:20:35.967153] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:20:36.631990] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T18:20:36.742804] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-16T18:20:37.542859] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-16T18:20:37.720860] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:20:38.342811] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-16T18:20:39.086616] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:20:39.142802] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-16T18:20:39.942813] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-16T18:20:40.312004] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:20:40.381142] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:20:40.742808] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-16T18:20:41.542805] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-16T18:20:42.202170] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T18:20:42.329272] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T18:20:42.350126] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-16T18:20:42.369447] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:20:43.142834] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-16T18:20:43.942867] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-16T18:20:44.445966] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-16T18:20:44.516262] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:20:44.742847] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-16T18:20:44.877939] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T18:20:45.542817] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-16T18:20:46.342793] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-16T18:20:46.621801] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T18:20:47.142894] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-16T18:20:47.723054] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-16T18:20:47.780127] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T18:20:47.935272] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T18:20:47.942790] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-16T18:20:48.742863] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-16T18:20:49.542905] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-16T18:20:49.576709] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T18:20:50.342920] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-16T18:20:50.594778] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-16T18:20:51.142826] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-16T18:20:51.661396] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T18:20:51.727208] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:20:51.942850] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-16T18:20:52.717226] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:20:52.748221] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-16T18:20:52.765231] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:20:53.542873] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-16T18:20:54.342844] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-16T18:20:54.449525] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T18:20:54.455758] [INFO ] [REMOTE ] DAN: Full fetch complete (70887 records). [2025-10-16T18:20:54.455891] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-16T18:20:54.456628] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:20:54.456756] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:20:54.456799] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:20:54.456838] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-16T18:20:54.456909] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-16T18:20:54.456965] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-16T18:20:54.457009] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-16T18:20:54.457065] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 25.8s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-16T18:20:54.627925] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:54.646720] [DEBUG] [LOCAL ] DAO: Loaded 19797 existing records from primary storage. [2025-10-16T18:20:54.646966] [INFO ] [MAIN ] DAO: Loaded 19797 existing records. [2025-10-16T18:20:54.817877] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:54.818081] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-16T18:20:54.818129] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-16T18:20:54.818308] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-16T18:20:54.818365] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-16T18:20:55.155715] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-16T18:20:55.160536] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:55.514230] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T18:20:55.935173] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T18:20:55.942802] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-16T18:20:56.432660] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T18:20:56.742813] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-16T18:20:57.408760] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:20:57.542790] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-16T18:20:57.651769] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:20:57.653976] [INFO ] [REMOTE ] DAC: Full fetch complete (19366 records). [2025-10-16T18:20:57.654059] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-16T18:20:58.026971] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-16T18:20:58.027059] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-16T18:20:58.027523] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-16T18:20:58.027564] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-16T18:20:58.028183] [DEBUG] [LOCAL ] DAC: Trimmed 19366 records to 12709 (keeping 200 days of data) [2025-10-16T18:20:58.109739] [DEBUG] [LOCAL ] DAC: Primary data saved (12709 records). [2025-10-16T18:20:58.109885] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-16T18:20:58.109980] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. DAC took 35.9s. Estimated remaining: 4h 7m 18s. Rate: 7.2 symbols/min [2025-10-16T18:20:58.303358] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:58.352405] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-16T18:20:58.370679] [DEBUG] [LOCAL ] DAR: Loaded 51991 existing records from primary storage. [2025-10-16T18:20:58.374105] [INFO ] [MAIN ] DAR: Loaded 51991 existing records. [2025-10-16T18:20:58.437937] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:20:58.496105] [INFO ] [REMOTE ] D: Full fetch complete (77813 records). [2025-10-16T18:20:58.504271] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-16T18:20:58.695498] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:20:58.720367] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-16T18:20:58.723433] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-16T18:20:58.723848] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-16T18:20:58.723915] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-16T18:20:59.152622] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-16T18:20:59.370395] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:20:59.374211] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-16T18:20:59.374288] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-16T18:20:59.375521] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-16T18:20:59.375584] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-16T18:20:59.377039] [DEBUG] [LOCAL ] D: Trimmed 77813 records to 54036 (keeping 200 days of data) [2025-10-16T18:20:59.495109] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:20:59.728815] [DEBUG] [LOCAL ] D: Primary data saved (54036 records). [2025-10-16T18:20:59.729014] [INFO ] [MAIN ] D: Full history saved. [2025-10-16T18:20:59.729970] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 39.5s. Estimated remaining: 4h 6m 49s. Rate: 7.2 symbols/min [2025-10-16T18:20:59.916297] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:20:59.942811] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-16T18:20:59.957256] [DEBUG] [LOCAL ] DAVA: Loaded 41847 existing records from primary storage. [2025-10-16T18:20:59.957522] [INFO ] [MAIN ] DAVA: Loaded 41847 existing records. [2025-10-16T18:21:00.132388] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:00.132631] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-16T18:21:00.132728] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-16T18:21:00.133156] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-16T18:21:00.133217] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-16T18:21:00.489426] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:00.742812] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-16T18:21:01.542964] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-16T18:21:01.768592] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-16T18:21:01.859575] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T18:21:01.931247] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:21:02.186958] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T18:21:02.342821] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-16T18:21:03.142815] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-16T18:21:03.729926] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:21:03.942825] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-16T18:21:04.600565] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:21:04.742834] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-16T18:21:05.281103] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:21:05.542824] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-16T18:21:06.343138] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-16T18:21:06.425702] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T18:21:06.814957] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:21:06.822067] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-16T18:21:06.822265] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-16T18:21:07.148052] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-16T18:21:07.269937] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-16T18:21:07.270029] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-16T18:21:07.271015] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-16T18:21:07.271087] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-16T18:21:07.272771] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54143 (keeping 200 days of data) [2025-10-16T18:21:07.604543] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-16T18:21:07.604722] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-16T18:21:07.604819] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAL took 44.3s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-16T18:21:07.808739] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:07.810746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:21:07.810873] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-16T18:21:07.819940] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-16T18:21:07.820583] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-16T18:21:07.820694] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-16T18:21:07.821045] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-16T18:21:07.821100] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-16T18:21:07.948021] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-16T18:21:08.186520] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:08.558340] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:21:08.742876] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-16T18:21:09.542779] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-16T18:21:09.666225] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:21:10.020340] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:21:10.342817] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-16T18:21:10.375276] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T18:21:11.142842] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-16T18:21:11.556287] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:21:11.942826] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-16T18:21:12.487241] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:21:12.742786] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-16T18:21:12.846079] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T18:21:13.542810] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-16T18:21:14.051182] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:21:14.342869] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-16T18:21:14.524182] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:21:15.142856] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-16T18:21:15.942857] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-16T18:21:16.012794] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:21:16.097521] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T18:21:16.742849] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-16T18:21:17.508896] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:21:17.542908] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-16T18:21:18.342835] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-16T18:21:18.474860] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T18:21:18.512125] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T18:21:19.142824] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-16T18:21:19.789253] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:21:19.942817] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-16T18:21:20.249063] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T18:21:20.742813] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-16T18:21:20.903957] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:21:21.542834] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-16T18:21:22.347157] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-16T18:21:22.352730] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:21:23.149938] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-16T18:21:23.168815] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:21:23.303118] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:21:23.305495] [INFO ] [REMOTE ] DAO: Full fetch complete (32174 records). [2025-10-16T18:21:23.305570] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-16T18:21:23.306082] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:23.306165] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:23.306207] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:23.306246] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-16T18:21:23.306334] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-16T18:21:23.306387] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-16T18:21:23.306554] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-16T18:21:23.306660] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 28.8s. Estimated remaining: 4h 6m 53s. Rate: 7.2 symbols/min [2025-10-16T18:21:23.503407] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:23.555928] [DEBUG] [LOCAL ] DB: Loaded 52503 existing records from primary storage. [2025-10-16T18:21:23.556232] [INFO ] [MAIN ] DB: Loaded 52503 existing records. [2025-10-16T18:21:23.732464] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:23.732755] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-16T18:21:23.732807] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-16T18:21:23.733008] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-16T18:21:23.733073] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-16T18:21:23.948031] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-16T18:21:24.101435] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:24.719426] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:21:24.742774] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-16T18:21:25.542805] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-16T18:21:25.695337] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T18:21:26.342801] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-16T18:21:26.423286] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:21:26.886021] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T18:21:27.142811] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-16T18:21:27.903816] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:21:27.942828] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-16T18:21:28.742788] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-16T18:21:28.863559] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T18:21:29.158478] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:21:29.542861] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-16T18:21:30.071194] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T18:21:30.342821] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-16T18:21:31.142848] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-16T18:21:31.293340] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:21:31.942823] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-16T18:21:32.006968] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:21:32.012822] [INFO ] [REMOTE ] DAVA: Full fetch complete (56679 records). [2025-10-16T18:21:32.012978] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-16T18:21:32.015692] [FATAL] [VALIDATOR ] DAVA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:32.015811] [FATAL] [MAIN ] DAVA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:32.015911] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:32.016006] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-16T18:21:32.016089] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-16T18:21:32.016127] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-10-16T18:21:32.016276] [DEBUG] [LOCAL ] DAVA: Deleted derivative data file. [2025-10-16T18:21:32.016367] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 32.3s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-16T18:21:32.190486] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:32.190719] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-16T18:21:32.190773] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-16T18:21:32.190853] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-16T18:21:32.190890] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-16T18:21:32.190931] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-16T18:21:32.190965] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-16T18:21:32.584687] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:32.627343] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:21:32.742815] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-16T18:21:33.256856] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:21:33.542906] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-16T18:21:34.117470] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:21:34.342843] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-16T18:21:35.142787] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-16T18:21:35.251952] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:21:35.915195] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:21:35.921847] [INFO ] [REMOTE ] DAR: Full fetch complete (74961 records). [2025-10-16T18:21:35.921976] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-16T18:21:35.953226] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-16T18:21:36.237780] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T18:21:36.332964] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-16T18:21:36.333047] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-16T18:21:36.333951] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-16T18:21:36.334014] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-16T18:21:36.335455] [DEBUG] [LOCAL ] DAR: Trimmed 74961 records to 52380 (keeping 200 days of data) [2025-10-16T18:21:36.647945] [DEBUG] [LOCAL ] DAR: Primary data saved (52380 records). [2025-10-16T18:21:36.648105] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-16T18:21:36.648762] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 38.5s. Estimated remaining: 4h 6m 27s. Rate: 7.2 symbols/min [2025-10-16T18:21:36.747885] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-16T18:21:36.821745] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:36.862043] [DEBUG] [LOCAL ] DBI: Loaded 43916 existing records from primary storage. [2025-10-16T18:21:36.862372] [INFO ] [MAIN ] DBI: Loaded 43916 existing records. [2025-10-16T18:21:37.034583] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:37.034831] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-16T18:21:37.034880] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-16T18:21:37.035069] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-16T18:21:37.035106] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-16T18:21:37.379761] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:37.542831] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-16T18:21:37.683267] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:21:38.064285] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-16T18:21:38.342829] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-16T18:21:38.517938] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T18:21:39.142797] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-16T18:21:39.942798] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-16T18:21:40.329026] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T18:21:40.406283] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:21:40.742829] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-16T18:21:41.542793] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-16T18:21:41.628348] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:21:41.667223] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T18:21:42.342804] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-16T18:21:43.142800] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-16T18:21:43.325062] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:21:43.555993] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:21:43.942868] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-16T18:21:44.522464] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T18:21:44.687677] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:21:44.742768] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-16T18:21:45.542791] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-16T18:21:45.775093] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:21:46.342864] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-16T18:21:46.972866] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:21:46.978967] [INFO ] [REMOTE ] DAY: Full fetch complete (71352 records). [2025-10-16T18:21:46.979091] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-16T18:21:46.979971] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:46.980089] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:46.980153] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:46.980237] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-16T18:21:46.980349] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-16T18:21:46.980420] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-16T18:21:46.980510] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-16T18:21:46.980606] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 39.4s. Estimated remaining: 4h 6m 25s. Rate: 7.2 symbols/min [2025-10-16T18:21:47.147898] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-16T18:21:47.187890] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:47.188160] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-16T18:21:47.188208] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-16T18:21:47.188314] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-16T18:21:47.188356] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-16T18:21:47.188399] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-16T18:21:47.188432] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-16T18:21:47.620031] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:47.634791] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:21:47.942825] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-16T18:21:48.742792] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-16T18:21:48.927963] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:21:48.957855] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:21:49.542781] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-16T18:21:49.867270] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T18:21:50.342863] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-16T18:21:51.031593] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:21:51.093804] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T18:21:51.142849] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-16T18:21:51.942819] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-16T18:21:52.742782] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-16T18:21:53.044087] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T18:21:53.303275] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T18:21:53.340777] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T18:21:53.542821] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-16T18:21:54.149054] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:21:54.342813] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-16T18:21:55.142782] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-16T18:21:55.534922] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:21:55.942785] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-16T18:21:55.959719] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T18:21:56.742836] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-16T18:21:57.092550] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:21:57.147496] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-16T18:21:57.542818] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-16T18:21:58.342785] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-16T18:21:58.499348] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:21:58.502719] [INFO ] [REMOTE ] DBD: Full fetch complete (31524 records). [2025-10-16T18:21:58.502804] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-16T18:21:58.503266] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:21:58.503375] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:21:58.503453] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:21:58.503541] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-16T18:21:58.503608] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-16T18:21:58.503667] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-16T18:21:58.503735] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-16T18:21:58.503793] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBD took 26.5s. Estimated remaining: 4h 6m 26s. Rate: 7.2 symbols/min [2025-10-16T18:21:58.683583] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:21:58.731037] [DEBUG] [LOCAL ] DBRG: Loaded 49905 existing records from primary storage. [2025-10-16T18:21:58.731335] [INFO ] [MAIN ] DBRG: Loaded 49905 existing records. [2025-10-16T18:21:58.904478] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:21:58.904723] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-16T18:21:58.904781] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-16T18:21:58.904989] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-16T18:21:58.905056] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-16T18:21:59.151553] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-16T18:21:59.254359] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:21:59.942783] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-16T18:22:00.013787] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T18:22:00.376303] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T18:22:00.742837] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-16T18:22:01.486293] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T18:22:01.542829] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-16T18:22:01.627631] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T18:22:02.342870] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-16T18:22:03.110358] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:22:03.151524] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-16T18:22:03.156931] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:22:03.780639] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:22:03.942822] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-16T18:22:04.742870] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-16T18:22:05.542792] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-16T18:22:05.764313] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:22:06.002770] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T18:22:06.342835] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-16T18:22:06.397037] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:22:06.398556] [INFO ] [REMOTE ] DBL: Full fetch complete (12719 records). [2025-10-16T18:22:06.398633] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-16T18:22:06.753068] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-16T18:22:06.753145] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-16T18:22:06.753440] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-16T18:22:06.753479] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-16T18:22:06.753996] [DEBUG] [LOCAL ] DBL: Trimmed 12719 records to 9490 (keeping 200 days of data) [2025-10-16T18:22:06.811393] [DEBUG] [LOCAL ] DBL: Primary data saved (9490 records). [2025-10-16T18:22:06.811529] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-16T18:22:06.811602] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBL took 19.8s. Estimated remaining: 4h 6m 18s. Rate: 7.2 symbols/min [2025-10-16T18:22:06.984355] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:07.019317] [DEBUG] [LOCAL ] DCI: Loaded 37027 existing records from primary storage. [2025-10-16T18:22:07.019592] [INFO ] [MAIN ] DCI: Loaded 37027 existing records. [2025-10-16T18:22:07.147970] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-16T18:22:07.203672] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:07.203934] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-16T18:22:07.204079] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-16T18:22:07.204363] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-16T18:22:07.204419] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-16T18:22:07.557665] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:07.770529] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T18:22:07.942828] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-16T18:22:08.742875] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-16T18:22:09.181515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T18:22:09.189003] [INFO ] [REMOTE ] DB: Full fetch complete (75378 records). [2025-10-16T18:22:09.189202] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-16T18:22:09.547407] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-16T18:22:09.751763] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-16T18:22:09.751954] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-16T18:22:09.753941] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-16T18:22:09.754210] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-16T18:22:09.756971] [DEBUG] [LOCAL ] DB: Trimmed 75378 records to 52892 (keeping 200 days of data) [2025-10-16T18:22:09.891684] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:22:10.262155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:22:10.285427] [DEBUG] [LOCAL ] DB: Primary data saved (52892 records). [2025-10-16T18:22:10.285572] [INFO ] [MAIN ] DB: Full history saved. [2025-10-16T18:22:10.286384] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 47.0s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-10-16T18:22:10.353625] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-16T18:22:10.463508] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:10.480291] [DEBUG] [LOCAL ] DCO: Loaded 14597 existing records from primary storage. [2025-10-16T18:22:10.480520] [INFO ] [MAIN ] DCO: Loaded 14597 existing records. [2025-10-16T18:22:10.659714] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:10.659950] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-16T18:22:10.660010] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-16T18:22:10.660207] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-16T18:22:10.660264] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-16T18:22:11.029140] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:11.142776] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-16T18:22:11.699412] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T18:22:11.914074] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:22:11.945952] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-16T18:22:11.950066] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:22:12.742818] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-16T18:22:13.034420] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T18:22:13.542852] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-16T18:22:14.342905] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-16T18:22:14.685498] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T18:22:14.828930] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:22:15.137994] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:22:15.142758] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-16T18:22:15.941877] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:22:15.944411] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-16T18:22:16.742861] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-16T18:22:17.443700] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:22:17.512888] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:22:17.542775] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-16T18:22:18.342824] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-16T18:22:19.083395] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:22:19.142783] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-16T18:22:19.942807] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-16T18:22:20.071081] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T18:22:20.111784] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T18:22:20.742823] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-16T18:22:21.195295] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-16T18:22:21.542793] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-16T18:22:21.559296] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T18:22:22.342824] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-16T18:22:23.142792] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-16T18:22:23.265921] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T18:22:23.418517] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:22:23.942881] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-16T18:22:24.751407] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-16T18:22:24.788856] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T18:22:24.866372] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:22:25.542838] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-16T18:22:26.208270] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T18:22:26.342799] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-16T18:22:26.416133] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:22:27.142783] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-16T18:22:27.458244] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:22:27.942890] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-16T18:22:28.506562] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T18:22:28.742811] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-16T18:22:29.415978] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:22:29.421187] [INFO ] [REMOTE ] DBI: Full fetch complete (65227 records). [2025-10-16T18:22:29.421324] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-16T18:22:29.549035] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-16T18:22:29.704121] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:22:29.735615] [INFO ] [REMOTE ] DCO: Full fetch complete (19461 records). [2025-10-16T18:22:29.741332] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-16T18:22:29.762368] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:22:29.785539] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:22:29.796285] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:22:29.841215] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-16T18:22:29.857202] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-16T18:22:29.857326] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-16T18:22:29.857540] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-16T18:22:29.857711] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-16T18:22:29.858568] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-16T18:22:29.858612] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-16T18:22:29.858741] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-16T18:22:29.859124] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DCO took 19.6s. Estimated remaining: 4h 6m 20s. Rate: 7.2 symbols/min [2025-10-16T18:22:29.960816] [DEBUG] [LOCAL ] DBI: Trimmed 65227 records to 44191 (keeping 200 days of data) [2025-10-16T18:22:30.127221] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:30.341060] [DEBUG] [LOCAL ] DBI: Primary data saved (44191 records). [2025-10-16T18:22:30.339439] [DEBUG] [LOCAL ] DD: Loaded 52926 existing records from primary storage. [2025-10-16T18:22:30.341433] [INFO ] [MAIN ] DD: Loaded 52926 existing records. [2025-10-16T18:22:30.341317] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-16T18:22:30.362549] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBI took 53.7s. Estimated remaining: 4h 5m 49s. Rate: 7.2 symbols/min [2025-10-16T18:22:30.383129] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-16T18:22:30.675135] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:30.699081] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-16T18:22:30.699009] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:30.699445] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-16T18:22:30.699691] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-16T18:22:30.699747] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-16T18:22:31.076676] [DEBUG] [LOCAL ] DDD: Loaded 50928 existing records from primary storage. [2025-10-16T18:22:31.102550] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:31.102798] [INFO ] [MAIN ] DDD: Loaded 50928 existing records. [2025-10-16T18:22:31.147146] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-16T18:22:31.306027] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:31.318064] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-16T18:22:31.318856] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-16T18:22:31.318731] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T18:22:31.325783] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-16T18:22:31.326057] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-16T18:22:31.726270] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:31.942801] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-16T18:22:32.213123] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:22:32.742813] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-16T18:22:33.010835] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:22:33.443838] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T18:22:33.542794] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-16T18:22:34.116592] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-16T18:22:34.342812] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-16T18:22:35.018153] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T18:22:35.142807] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-16T18:22:35.942798] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-16T18:22:36.114837] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:22:36.742843] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-16T18:22:36.803432] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:22:36.809440] [INFO ] [REMOTE ] DBRG: Full fetch complete (72109 records). [2025-10-16T18:22:36.809566] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-16T18:22:36.810389] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:22:36.810480] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:22:36.810524] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:22:36.810562] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-16T18:22:36.810616] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-16T18:22:36.810678] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-16T18:22:36.810818] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-16T18:22:36.811336] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DBRG took 38.3s. Estimated remaining: 4h 5m 35s. Rate: 7.2 symbols/min [2025-10-16T18:22:36.979375] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:22:37.014175] [DEBUG] [LOCAL ] DDL: Loaded 36922 existing records from primary storage. [2025-10-16T18:22:37.014441] [INFO ] [MAIN ] DDL: Loaded 36922 existing records. [2025-10-16T18:22:37.191832] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:22:37.192159] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-16T18:22:37.192247] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-16T18:22:37.192597] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-16T18:22:37.192706] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-16T18:22:37.546199] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-16T18:22:37.582847] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T18:22:37.638317] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:22:37.824955] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:22:38.342847] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-16T18:22:39.030891] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:22:39.142843] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-16T18:22:39.942816] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-16T18:22:40.101329] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:22:40.493040] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:22:40.742840] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-16T18:22:41.542865] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-16T18:22:41.690130] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:22:42.322274] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T18:22:42.342769] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-16T18:22:43.142813] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-16T18:22:43.715573] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T18:22:43.942854] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-16T18:22:44.353596] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-16T18:22:44.742890] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-16T18:22:45.026149] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:22:45.325534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:22:45.542880] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-16T18:22:46.195951] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:22:46.342802] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-16T18:22:47.012422] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T18:22:47.142820] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-16T18:22:47.942860] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-16T18:22:48.195521] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T18:22:48.371824] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T18:22:48.742844] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-16T18:22:49.517143] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:22:49.542799] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-16T18:22:50.201355] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T18:22:50.342838] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-16T18:22:51.134068] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T18:22:51.143008] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-16T18:22:51.942821] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-16T18:22:52.099209] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:22:52.742823] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-16T18:22:53.542867] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-16T18:23:05.351639] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (13.41 seconds). [2025-10-16T18:23:05.359530] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-16T18:23:06.274448] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (15.13 seconds). [2025-10-16T18:23:06.287578] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-16T18:23:06.384315] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (12.84 seconds). [2025-10-16T18:23:06.396807] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-16T18:23:07.175433] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (14.43 seconds). [2025-10-16T18:23:07.179921] [INFO ] [REMOTE ] DCI: Full fetch complete (53348 records). [2025-10-16T18:23:07.180052] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-16T18:23:07.180835] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:07.180931] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:07.180975] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:07.181015] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-16T18:23:07.181094] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-16T18:23:07.181131] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-16T18:23:07.181266] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-16T18:23:07.181370] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DCI took 1m 0s. Estimated remaining: 4h 6m 32s. Rate: 7.2 symbols/min [2025-10-16T18:23:07.374793] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T18:23:07.381271] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-16T18:23:07.896967] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:23:07.908536] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-16T18:23:08.516123] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:23:08.522927] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-16T18:23:08.570927] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T18:23:08.579506] [INFO ] [REMOTE ] DD: Full fetch complete (76594 records). [2025-10-16T18:23:08.579742] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-16T18:23:09.019004] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-16T18:23:09.019181] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-16T18:23:09.020298] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-16T18:23:09.020391] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-16T18:23:09.054222] [DEBUG] [LOCAL ] DD: Trimmed 76594 records to 53314 (keeping 200 days of data) [2025-10-16T18:23:09.056028] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-16T18:23:09.069017] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-16T18:23:09.407863] [DEBUG] [LOCAL ] DD: Primary data saved (53314 records). [2025-10-16T18:23:09.408002] [INFO ] [MAIN ] DD: Full history saved. [2025-10-16T18:23:09.408905] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 39.5s. Estimated remaining: 4h 6m 5s. Rate: 7.2 symbols/min [2025-10-16T18:23:10.107177] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T18:23:10.118539] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-16T18:23:10.697495] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:23:10.708861] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-16T18:23:11.752766] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:23:11.760382] [INFO ] [REMOTE ] DDL: Full fetch complete (53522 records). [2025-10-16T18:23:11.760584] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-16T18:23:12.203281] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-16T18:23:12.203384] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-16T18:23:12.204397] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-16T18:23:12.204462] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-16T18:23:12.205558] [DEBUG] [LOCAL ] DDL: Trimmed 53522 records to 37285 (keeping 200 days of data) [2025-10-16T18:23:12.414957] [DEBUG] [LOCAL ] DDL: Primary data saved (37285 records). [2025-10-16T18:23:12.415262] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-16T18:23:12.415382] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 35.6s. Estimated remaining: 4h 5m 41s. Rate: 7.2 symbols/min [2025-10-16T18:23:12.523597] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T18:23:12.534624] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-16T18:23:14.286756] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:23:14.298637] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-16T18:23:15.944720] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:23:15.950853] [INFO ] [REMOTE ] DDD: Full fetch complete (73552 records). [2025-10-16T18:23:15.950970] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-16T18:23:15.951598] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:15.951702] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:15.951748] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:15.951810] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-16T18:23:15.951873] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-16T18:23:15.951910] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-10-16T18:23:15.952037] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-10-16T18:23:15.952122] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 45.6s. Estimated remaining: 4h 5m 19s. Rate: 7.2 symbols/min [2025-10-16T18:23:16.584934] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.633066] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.659870] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-16T18:23:16.692297] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-16T18:23:16.692570] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-16T18:23:16.692137] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.710663] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:16.692686] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-16T18:23:16.710907] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-16T18:23:16.711160] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-16T18:23:16.711912] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-16T18:23:16.711815] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-16T18:23:16.712201] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-16T18:23:16.712041] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-16T18:23:16.718429] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-16T18:23:16.734474] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-16T18:23:17.195464] [DEBUG] [LOCAL ] DEA: Loaded 40436 existing records from primary storage. [2025-10-16T18:23:17.249833] [INFO ] [MAIN ] DEA: Loaded 40436 existing records. [2025-10-16T18:23:17.412823] [DEBUG] [LOCAL ] DE: Loaded 47661 existing records from primary storage. [2025-10-16T18:23:17.437714] [INFO ] [MAIN ] DE: Loaded 47661 existing records. [2025-10-16T18:23:17.664577] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:17.688979] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-16T18:23:17.851198] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:17.848313] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:17.855033] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-16T18:23:17.855395] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-16T18:23:17.878385] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-16T18:23:17.897679] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-16T18:23:17.907935] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-16T18:23:17.980817] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:18.018123] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-16T18:23:18.047040] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-16T18:23:18.049571] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-16T18:23:18.054965] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-16T18:23:18.596958] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:18.606223] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T18:23:18.624777] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-16T18:23:18.624213] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-16T18:23:18.726285] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:18.726708] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-16T18:23:18.991293] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:23:18.994775] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-16T18:23:19.068482] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:23:19.069966] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-16T18:23:19.517763] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:23:19.518882] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-16T18:23:19.862700] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:23:19.865777] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-16T18:23:19.912736] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T18:23:19.913969] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-16T18:23:20.376432] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:23:20.386951] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-16T18:23:20.488042] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:23:20.489981] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-16T18:23:20.598591] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T18:23:20.608908] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-16T18:23:20.753525] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T18:23:20.756602] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-16T18:23:20.813284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-16T18:23:20.814340] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-16T18:23:21.137272] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T18:23:21.138383] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-16T18:23:21.643248] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T18:23:21.646877] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-16T18:23:21.660739] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T18:23:21.662240] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-16T18:23:22.025886] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T18:23:22.027596] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-16T18:23:22.030763] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:23:22.041529] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-16T18:23:22.262709] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:23:22.271805] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-16T18:23:22.438076] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:23:22.441968] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-16T18:23:22.522363] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:23:22.523446] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-16T18:23:22.877505] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T18:23:22.878297] [INFO ] [REMOTE ] DDT: Full fetch complete (2838 records). [2025-10-16T18:23:22.878365] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-16T18:23:23.239370] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T18:23:23.246087] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-16T18:23:23.246169] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-16T18:23:23.246317] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-16T18:23:23.249451] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-16T18:23:23.250312] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-16T18:23:23.251268] [DEBUG] [LOCAL ] DDT: Trimmed 2838 records to 2095 (keeping 200 days of data) [2025-10-16T18:23:23.264756] [DEBUG] [LOCAL ] DDT: Primary data saved (2095 records). [2025-10-16T18:23:23.264824] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-16T18:23:23.264885] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 7.3s. Estimated remaining: 4h 5m 8s. Rate: 7.2 symbols/min [2025-10-16T18:23:23.444688] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:23.477045] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:23:23.512506] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:23:23.512922] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-16T18:23:23.531063] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-16T18:23:23.550087] [DEBUG] [LOCAL ] DEC: Loaded 30346 existing records from primary storage. [2025-10-16T18:23:23.550446] [INFO ] [MAIN ] DEC: Loaded 30346 existing records. [2025-10-16T18:23:23.779816] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:23.780044] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-16T18:23:23.780093] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-16T18:23:23.780296] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-16T18:23:23.780353] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-16T18:23:24.176008] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:24.183926] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-16T18:23:24.184997] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T18:23:24.742819] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-16T18:23:24.951936] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:23:25.024728] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:23:25.055478] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:23:25.542848] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-16T18:23:25.665259] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-16T18:23:26.342830] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-16T18:23:27.142810] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-16T18:23:27.260931] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:23:27.305934] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T18:23:27.942805] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-16T18:23:28.724961] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T18:23:28.742778] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-16T18:23:28.873757] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T18:23:29.542847] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-16T18:23:29.774013] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:23:30.342882] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-16T18:23:31.142823] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-16T18:23:31.302280] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:23:31.942786] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-16T18:23:31.995260] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:23:32.189752] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T18:23:32.742835] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-16T18:23:33.542878] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-16T18:23:33.763245] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:23:33.945032] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:23:34.342821] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-16T18:23:34.965382] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:23:35.142865] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-16T18:23:35.917430] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-16T18:23:35.942785] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-16T18:23:36.146536] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T18:23:36.742830] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-16T18:23:37.047483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:23:37.542841] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-16T18:23:37.569639] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:23:37.571256] [INFO ] [REMOTE ] DDS: Full fetch complete (18645 records). [2025-10-16T18:23:37.571347] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-16T18:23:37.929503] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-16T18:23:37.929599] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-16T18:23:37.930073] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-16T18:23:37.930130] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-16T18:23:37.930826] [DEBUG] [LOCAL ] DDS: Trimmed 18645 records to 12801 (keeping 200 days of data) [2025-10-16T18:23:38.012212] [DEBUG] [LOCAL ] DDS: Primary data saved (12801 records). [2025-10-16T18:23:38.012359] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-16T18:23:38.012433] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 22.1s. Estimated remaining: 4h 5m 18s. Rate: 7.2 symbols/min [2025-10-16T18:23:38.176721] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:38.229090] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-10-16T18:23:38.229436] [INFO ] [MAIN ] DECK: Loaded 53297 existing records. [2025-10-16T18:23:38.347910] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-16T18:23:38.405321] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:38.405521] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-16T18:23:38.405569] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-16T18:23:38.405783] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-16T18:23:38.405840] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-16T18:23:38.764123] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:38.878133] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:23:39.142856] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-16T18:23:39.823101] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:23:39.942846] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-16T18:23:40.512418] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:23:40.742805] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-16T18:23:41.543020] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-16T18:23:41.801305] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:23:41.854990] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T18:23:42.342858] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-16T18:23:42.658796] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:23:43.142783] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-16T18:23:43.942833] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-16T18:23:44.027359] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:23:44.523299] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:23:44.528435] [INFO ] [REMOTE ] DEA: Full fetch complete (61685 records). [2025-10-16T18:23:44.528578] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-16T18:23:44.529391] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:23:44.529501] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:23:44.529543] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:23:44.529582] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-16T18:23:44.529662] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-16T18:23:44.529721] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-16T18:23:44.529864] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-16T18:23:44.529953] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 28.6s. Estimated remaining: 4h 5m 4s. Rate: 7.2 symbols/min [2025-10-16T18:23:44.698564] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:44.698782] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-16T18:23:44.698836] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-16T18:23:44.698943] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-16T18:23:44.698983] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-16T18:23:44.699023] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-16T18:23:44.699056] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-16T18:23:44.752534] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-16T18:23:45.045587] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:45.542833] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-16T18:23:45.757686] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T18:23:46.342869] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-16T18:23:46.482213] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:23:46.826761] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:23:47.142850] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-16T18:23:47.772931] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:23:47.942837] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-16T18:23:48.336429] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:23:48.742857] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-16T18:23:49.542854] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-16T18:23:49.874060] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:23:49.880589] [INFO ] [REMOTE ] DE: Full fetch complete (69869 records). [2025-10-16T18:23:49.880785] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-16T18:23:50.282696] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-16T18:23:50.282827] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-16T18:23:50.283706] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-16T18:23:50.283838] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-16T18:23:50.307286] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:23:50.315975] [DEBUG] [LOCAL ] DE: Trimmed 69869 records to 48037 (keeping 200 days of data) [2025-10-16T18:23:50.372520] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-16T18:23:50.615635] [DEBUG] [LOCAL ] DE: Primary data saved (48037 records). [2025-10-16T18:23:50.615791] [INFO ] [MAIN ] DE: Full history saved. [2025-10-16T18:23:50.615867] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 34.7s. Estimated remaining: 4h 4m 50s. Rate: 7.2 symbols/min [2025-10-16T18:23:50.788057] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:50.841783] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-16T18:23:50.842083] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-16T18:23:51.017204] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:51.017404] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-16T18:23:51.017489] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-16T18:23:51.017783] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-16T18:23:51.017872] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-16T18:23:51.144485] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-16T18:23:51.397628] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:51.428022] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:23:51.764730] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:23:51.942791] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-16T18:23:52.151091] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T18:23:52.742811] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-16T18:23:53.542846] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-16T18:23:54.046371] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:23:54.342807] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-16T18:23:54.502720] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-16T18:23:55.142802] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-16T18:23:55.328179] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:23:55.438118] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:23:55.442701] [INFO ] [REMOTE ] DEC: Full fetch complete (44340 records). [2025-10-16T18:23:55.442823] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-16T18:23:55.815178] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-16T18:23:55.815248] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-16T18:23:55.815944] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-16T18:23:55.816009] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-16T18:23:55.817092] [DEBUG] [LOCAL ] DEC: Trimmed 44340 records to 30584 (keeping 200 days of data) [2025-10-16T18:23:55.962785] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-16T18:23:56.001339] [DEBUG] [LOCAL ] DEC: Primary data saved (30584 records). [2025-10-16T18:23:56.001441] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-16T18:23:56.001517] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 32.7s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-16T18:23:56.168859] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:23:56.215527] [DEBUG] [LOCAL ] DEO: Loaded 49216 existing records from primary storage. [2025-10-16T18:23:56.215847] [INFO ] [MAIN ] DEO: Loaded 49216 existing records. [2025-10-16T18:23:56.390298] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:23:56.390546] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-16T18:23:56.390595] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-16T18:23:56.390797] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-16T18:23:56.390853] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-16T18:23:56.769401] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-16T18:23:56.774543] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:23:57.114402] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T18:23:57.542830] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-16T18:23:57.716442] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T18:23:58.342834] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-16T18:23:59.090099] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T18:23:59.142819] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-16T18:23:59.367021] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:23:59.928188] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:23:59.942764] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-16T18:24:00.742880] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-16T18:24:01.292602] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-16T18:24:01.341718] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:24:01.542816] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-16T18:24:02.115448] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:24:02.342827] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-16T18:24:03.142895] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-16T18:24:03.199994] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T18:24:03.942817] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-16T18:24:04.136672] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-16T18:24:04.742819] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-16T18:24:05.364604] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T18:24:05.544860] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-16T18:24:05.553014] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:24:06.164105] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:24:06.342823] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-16T18:24:07.142861] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-16T18:24:07.942779] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-16T18:24:08.001419] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-16T18:24:08.087877] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:24:08.520312] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T18:24:08.742821] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-16T18:24:09.542870] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-16T18:24:09.695443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:24:09.704920] [INFO ] [REMOTE ] DEI: Full fetch complete (69888 records). [2025-10-16T18:24:09.705114] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-16T18:24:10.250378] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-16T18:24:10.250505] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-16T18:24:10.252324] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-16T18:24:10.252418] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-16T18:24:10.254495] [DEBUG] [LOCAL ] DEI: Trimmed 69888 records to 48658 (keeping 200 days of data) [2025-10-16T18:24:10.345151] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-16T18:24:10.713206] [DEBUG] [LOCAL ] DEI: Primary data saved (48658 records). [2025-10-16T18:24:10.713486] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-16T18:24:10.713605] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEI took 26.2s. Estimated remaining: 4h 4m 43s. Rate: 7.2 symbols/min [2025-10-16T18:24:10.941933] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:10.977473] [DEBUG] [LOCAL ] DFH: Loaded 32196 existing records from primary storage. [2025-10-16T18:24:10.977931] [INFO ] [MAIN ] DFH: Loaded 32196 existing records. [2025-10-16T18:24:11.197448] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:11.197920] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-16T18:24:11.198039] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-16T18:24:11.198275] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-16T18:24:11.198427] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-16T18:24:11.458491] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-16T18:24:11.534958] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-16T18:24:11.626975] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:11.815894] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T18:24:11.942800] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-16T18:24:12.343489] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T18:24:12.742904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-16T18:24:13.542891] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-16T18:24:13.702140] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-16T18:24:13.964262] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-16T18:24:14.115151] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:24:14.342816] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-16T18:24:14.780599] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:24:15.142808] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-16T18:24:15.942876] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-16T18:24:16.218918] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T18:24:16.742838] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-16T18:24:17.467510] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-16T18:24:17.542312] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:24:17.552927] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-16T18:24:18.342791] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-16T18:24:18.616075] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-16T18:24:19.142838] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-16T18:24:19.473979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:24:19.796992] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T18:24:19.942804] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-16T18:24:20.742839] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-16T18:24:20.927021] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:24:21.542906] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-16T18:24:22.021843] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:24:22.249928] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T18:24:22.342830] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-16T18:24:23.142813] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-16T18:24:23.611163] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:24:23.618104] [INFO ] [REMOTE ] DECK: Full fetch complete (77068 records). [2025-10-16T18:24:23.618255] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-16T18:24:23.954565] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-16T18:24:24.015160] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-16T18:24:24.015242] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-16T18:24:24.016207] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-16T18:24:24.016271] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-16T18:24:24.017801] [DEBUG] [LOCAL ] DECK: Trimmed 77068 records to 53687 (keeping 200 days of data) [2025-10-16T18:24:24.343856] [DEBUG] [LOCAL ] DECK: Primary data saved (53687 records). [2025-10-16T18:24:24.344008] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-16T18:24:24.344124] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 46.3s. Estimated remaining: 4h 4m 50s. Rate: 7.2 symbols/min [2025-10-16T18:24:24.512764] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:24.536192] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:24:24.571469] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-16T18:24:24.585634] [DEBUG] [LOCAL ] DFIN: Loaded 22637 existing records from primary storage. [2025-10-16T18:24:24.585817] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-16T18:24:24.586254] [INFO ] [MAIN ] DFIN: Loaded 22637 existing records. [2025-10-16T18:24:24.586130] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-16T18:24:24.648910] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:24:24.664962] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:24:24.682944] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:24:24.685128] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-16T18:24:24.685527] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-16T18:24:24.696208] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-16T18:24:24.711794] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-16T18:24:24.724803] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DELL took 34.1s. Estimated remaining: 4h 4m 19s. Rate: 7.2 symbols/min [2025-10-16T18:24:24.744986] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-16T18:24:24.787990] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:24.788315] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-16T18:24:24.798584] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-16T18:24:24.831692] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-16T18:24:24.837235] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-16T18:24:25.089760] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:25.227055] [DEBUG] [LOCAL ] DFP: Loaded 11194 existing records from primary storage. [2025-10-16T18:24:25.227381] [INFO ] [MAIN ] DFP: Loaded 11194 existing records. [2025-10-16T18:24:25.429709] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:25.488459] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:25.488711] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-16T18:24:25.488793] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-16T18:24:25.489015] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-16T18:24:25.489070] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-16T18:24:25.550403] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-16T18:24:25.838405] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:26.144638] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-16T18:24:26.223020] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:24:26.342789] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-16T18:24:26.792373] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:24:27.142823] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-16T18:24:27.788246] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:24:27.942857] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-16T18:24:28.402783] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:24:28.742842] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-16T18:24:29.542787] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-16T18:24:29.775310] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:24:29.975718] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T18:24:29.982390] [INFO ] [REMOTE ] DEO: Full fetch complete (71722 records). [2025-10-16T18:24:29.982537] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-16T18:24:30.353229] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-16T18:24:30.439219] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-16T18:24:30.439496] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-16T18:24:30.440702] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-16T18:24:30.440792] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-16T18:24:30.442333] [DEBUG] [LOCAL ] DEO: Trimmed 71722 records to 49588 (keeping 200 days of data) [2025-10-16T18:24:30.561843] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T18:24:30.785050] [DEBUG] [LOCAL ] DEO: Primary data saved (49588 records). [2025-10-16T18:24:30.785260] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-16T18:24:30.785984] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 34.8s. Estimated remaining: 4h 4m 4s. Rate: 7.2 symbols/min [2025-10-16T18:24:30.965925] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:30.966115] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-16T18:24:30.966155] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-16T18:24:30.966297] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-16T18:24:30.966339] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-16T18:24:30.966383] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-16T18:24:30.966416] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-16T18:24:31.155294] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-16T18:24:31.230324] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:24:31.340600] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:31.942834] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-16T18:24:32.673222] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:24:32.690549] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T18:24:32.742779] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-16T18:24:33.542865] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-16T18:24:34.219226] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:24:34.342791] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-16T18:24:34.431320] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T18:24:35.142804] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-16T18:24:35.599581] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:24:35.942783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-16T18:24:36.025507] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-16T18:24:36.416246] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T18:24:36.742815] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-16T18:24:37.542811] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-16T18:24:38.342783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-16T18:24:38.744922] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:24:38.872447] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T18:24:39.142792] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-16T18:24:39.188997] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:24:39.942831] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-16T18:24:40.349909] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:24:40.353998] [INFO ] [REMOTE ] DFH: Full fetch complete (47779 records). [2025-10-16T18:24:40.354220] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-16T18:24:40.355269] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:24:40.355358] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:24:40.355426] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:24:40.355501] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-16T18:24:40.355609] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-16T18:24:40.355694] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-16T18:24:40.356272] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-16T18:24:40.356368] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFH took 29.6s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-16T18:24:40.538291] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:40.585357] [DEBUG] [LOCAL ] DGX: Loaded 44657 existing records from primary storage. [2025-10-16T18:24:40.585746] [INFO ] [MAIN ] DGX: Loaded 44657 existing records. [2025-10-16T18:24:40.764568] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-16T18:24:40.770513] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:40.771996] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-16T18:24:40.772065] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-16T18:24:40.772301] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-16T18:24:40.772358] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-16T18:24:41.145393] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:41.249032] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T18:24:41.542782] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-16T18:24:41.665704] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T18:24:42.342855] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-16T18:24:42.693401] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:24:42.893394] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T18:24:43.142818] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-16T18:24:43.939111] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:24:43.942756] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-16T18:24:44.743900] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-16T18:24:44.745372] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T18:24:45.542824] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-16T18:24:46.225321] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:24:46.226888] [INFO ] [REMOTE ] DFP: Full fetch complete (15841 records). [2025-10-16T18:24:46.226957] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-16T18:24:46.351250] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-16T18:24:46.594129] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-16T18:24:46.594247] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-16T18:24:46.594783] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-16T18:24:46.594903] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-16T18:24:46.595758] [DEBUG] [LOCAL ] DFP: Trimmed 15841 records to 11238 (keeping 200 days of data) [2025-10-16T18:24:46.681995] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T18:24:46.708687] [DEBUG] [LOCAL ] DFP: Primary data saved (11238 records). [2025-10-16T18:24:46.708882] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-16T18:24:46.708982] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFP took 22.0s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-16T18:24:46.875546] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:24:46.895936] [DEBUG] [LOCAL ] DHF: Loaded 21070 existing records from primary storage. [2025-10-16T18:24:46.896190] [INFO ] [MAIN ] DHF: Loaded 21070 existing records. [2025-10-16T18:24:47.069620] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:24:47.069887] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-16T18:24:47.069937] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-16T18:24:47.070109] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-16T18:24:47.070149] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-16T18:24:47.148121] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-16T18:24:47.424831] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:24:47.942857] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-16T18:24:48.357841] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T18:24:48.427927] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:24:48.631021] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T18:24:48.742843] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-16T18:24:49.542799] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-16T18:24:49.714597] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:24:50.342836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-16T18:24:51.142819] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-16T18:24:51.235308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:24:51.258448] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T18:24:51.942828] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-16T18:24:51.977246] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-16T18:24:52.742834] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-16T18:24:53.494196] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:24:53.543747] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-16T18:24:53.545604] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:24:54.342804] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-16T18:24:55.142804] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-16T18:24:55.472552] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T18:24:55.544682] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:24:55.942862] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-16T18:24:56.278877] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T18:24:56.742873] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-16T18:24:57.542801] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-16T18:24:57.764546] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:24:58.342852] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-16T18:24:58.430380] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:24:58.782788] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T18:24:59.142865] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-16T18:24:59.791587] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T18:24:59.942796] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-16T18:25:00.742863] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-16T18:25:01.122426] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:25:01.127173] [INFO ] [REMOTE ] DFIN: Full fetch complete (33397 records). [2025-10-16T18:25:01.127342] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-16T18:25:01.526853] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-16T18:25:01.566459] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-16T18:25:01.580971] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-16T18:25:01.581060] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-16T18:25:01.581708] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-16T18:25:01.582199] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-16T18:25:01.583787] [DEBUG] [LOCAL ] DFIN: Trimmed 33397 records to 22789 (keeping 200 days of data) [2025-10-16T18:25:01.723010] [DEBUG] [LOCAL ] DFIN: Primary data saved (22789 records). [2025-10-16T18:25:01.723169] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-16T18:25:01.723252] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFIN took 37.4s. Estimated remaining: 4h 3m 56s. Rate: 7.2 symbols/min [2025-10-16T18:25:01.907768] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:01.907972] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-16T18:25:01.908040] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-16T18:25:01.908252] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-16T18:25:01.908337] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-16T18:25:01.925336] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-16T18:25:01.926053] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-16T18:25:01.959523] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:25:02.279931] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:02.342846] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-16T18:25:03.142955] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-16T18:25:03.184713] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:25:03.942815] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-16T18:25:04.383235] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T18:25:04.742784] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-16T18:25:04.908914] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:25:05.490833] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:25:05.542774] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-16T18:25:06.342890] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-16T18:25:06.665229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T18:25:07.142842] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-16T18:25:07.382822] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:25:07.766495] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T18:25:07.942805] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-16T18:25:08.024180] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:25:08.742870] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-16T18:25:08.951004] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T18:25:09.542836] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-16T18:25:10.275366] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:25:10.342824] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-16T18:25:11.142828] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-16T18:25:11.225739] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:25:11.942835] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-16T18:25:12.190439] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T18:25:12.219208] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:25:12.742836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-16T18:25:13.542815] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-16T18:25:13.600220] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:25:13.880226] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:25:14.342861] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-16T18:25:15.142796] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-16T18:25:15.443873] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-16T18:25:15.552416] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:25:15.942844] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-16T18:25:16.578075] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:25:16.584264] [INFO ] [REMOTE ] DGX: Full fetch complete (65309 records). [2025-10-16T18:25:16.584443] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-16T18:25:16.744836] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-16T18:25:16.987224] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-16T18:25:16.987297] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-16T18:25:16.988134] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-16T18:25:16.988196] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-16T18:25:16.989477] [DEBUG] [LOCAL ] DGX: Trimmed 65309 records to 44978 (keeping 200 days of data) [2025-10-16T18:25:17.272694] [DEBUG] [LOCAL ] DGX: Primary data saved (44978 records). [2025-10-16T18:25:17.272824] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-16T18:25:17.273737] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DGX took 36.9s. Estimated remaining: 4h 4m 8s. Rate: 7.2 symbols/min [2025-10-16T18:25:17.456932] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:17.513065] [DEBUG] [LOCAL ] DHR: Loaded 53378 existing records from primary storage. [2025-10-16T18:25:17.513394] [INFO ] [MAIN ] DHR: Loaded 53378 existing records. [2025-10-16T18:25:17.543967] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-16T18:25:17.704227] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:17.705130] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-16T18:25:17.705229] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-16T18:25:17.705764] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:25:17.708919] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-16T18:25:17.709189] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-16T18:25:17.729854] [INFO ] [REMOTE ] DHF: Full fetch complete (30004 records). [2025-10-16T18:25:17.777268] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-16T18:25:18.028570] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:25:18.344172] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-16T18:25:18.519900] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:18.598417] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-16T18:25:18.598500] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-16T18:25:18.599143] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-16T18:25:18.599207] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-16T18:25:18.600046] [DEBUG] [LOCAL ] DHF: Trimmed 30004 records to 21169 (keeping 200 days of data) [2025-10-16T18:25:18.722570] [DEBUG] [LOCAL ] DHF: Primary data saved (21169 records). [2025-10-16T18:25:18.722750] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-16T18:25:18.722844] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DHF took 32.0s. Estimated remaining: 4h 3m 40s. Rate: 7.2 symbols/min [2025-10-16T18:25:18.888090] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:18.933297] [DEBUG] [LOCAL ] DHT: Loaded 47932 existing records from primary storage. [2025-10-16T18:25:18.933597] [INFO ] [MAIN ] DHT: Loaded 47932 existing records. [2025-10-16T18:25:19.109228] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:19.109451] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-16T18:25:19.109504] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-16T18:25:19.109993] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-16T18:25:19.110051] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-16T18:25:19.152762] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-16T18:25:19.468263] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:19.526770] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T18:25:19.942818] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-16T18:25:20.742918] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-16T18:25:20.945247] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:25:20.985767] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-16T18:25:21.466425] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:25:21.473486] [INFO ] [REMOTE ] DG: Full fetch complete (77352 records). [2025-10-16T18:25:21.473611] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-16T18:25:21.547618] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-16T18:25:21.943034] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-16T18:25:21.943228] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-16T18:25:21.944306] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-16T18:25:21.944468] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-16T18:25:21.948327] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T18:25:21.960140] [DEBUG] [LOCAL ] DG: Trimmed 77352 records to 53667 (keeping 200 days of data) [2025-10-16T18:25:22.297191] [DEBUG] [LOCAL ] DG: Primary data saved (53667 records). [2025-10-16T18:25:22.297359] [INFO ] [MAIN ] DG: Full history saved. [2025-10-16T18:25:22.297446] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DG took 51.5s. Estimated remaining: 4h 3m 18s. Rate: 7.2 symbols/min [2025-10-16T18:25:22.351281] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-16T18:25:22.464993] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:22.479030] [DEBUG] [LOCAL ] DHX: Loaded 13388 existing records from primary storage. [2025-10-16T18:25:22.479248] [INFO ] [MAIN ] DHX: Loaded 13388 existing records. [2025-10-16T18:25:22.649925] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:22.650135] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-16T18:25:22.650181] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-16T18:25:22.650331] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-16T18:25:22.650369] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-16T18:25:22.994273] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:23.142779] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-16T18:25:23.698261] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T18:25:23.800695] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:25:23.942821] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-16T18:25:24.049453] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T18:25:24.742803] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-16T18:25:25.542792] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-16T18:25:25.791424] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:25:26.342826] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-16T18:25:26.663630] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:25:26.920986] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:25:27.079250] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:25:27.142766] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-16T18:25:27.942831] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-16T18:25:28.742883] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-16T18:25:28.794208] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:25:29.542817] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-16T18:25:30.031875] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-16T18:25:30.342777] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-16T18:25:30.553938] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:25:31.009781] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T18:25:31.142854] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-16T18:25:31.448518] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T18:25:31.942829] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-16T18:25:32.742800] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-16T18:25:32.820541] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:25:33.264800] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:25:33.542871] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-16T18:25:34.342831] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-16T18:25:34.784760] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T18:25:34.990226] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:25:35.152172] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-16T18:25:35.157665] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:25:35.842888] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T18:25:35.942838] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-16T18:25:36.742826] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-16T18:25:36.868017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:25:37.542816] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-16T18:25:38.342865] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-16T18:25:39.117679] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-16T18:25:39.142822] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-16T18:25:39.247058] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T18:25:39.254924] [INFO ] [REMOTE ] DHI: Full fetch complete (77397 records). [2025-10-16T18:25:39.255211] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-16T18:25:39.663944] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-16T18:25:39.664188] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-16T18:25:39.665529] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-16T18:25:39.665632] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-16T18:25:39.698022] [DEBUG] [LOCAL ] DHI: Trimmed 77397 records to 53756 (keeping 200 days of data) [2025-10-16T18:25:39.697856] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T18:25:39.943210] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-16T18:25:40.046485] [DEBUG] [LOCAL ] DHI: Primary data saved (53756 records). [2025-10-16T18:25:40.046620] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-16T18:25:40.046723] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 38.3s. Estimated remaining: 4h 3m 37s. Rate: 7.2 symbols/min [2025-10-16T18:25:40.215865] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:40.230231] [DEBUG] [LOCAL ] DIAX: Loaded 13028 existing records from primary storage. [2025-10-16T18:25:40.230447] [INFO ] [MAIN ] DIAX: Loaded 13028 existing records. [2025-10-16T18:25:40.411214] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:40.411466] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-16T18:25:40.411526] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-16T18:25:40.411741] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-16T18:25:40.411796] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-16T18:25:40.715618] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:25:40.752592] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-16T18:25:40.788857] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:40.961780] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T18:25:41.542824] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-16T18:25:42.342804] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-16T18:25:42.548809] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T18:25:42.549516] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T18:25:43.142814] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-16T18:25:43.862488] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T18:25:43.942820] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-16T18:25:44.742778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-16T18:25:45.035919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T18:25:45.350063] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T18:25:45.367543] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T18:25:45.542801] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-16T18:25:46.248035] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:25:46.342782] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-16T18:25:47.142789] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-16T18:25:47.264123] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T18:25:47.895130] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:25:47.942778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-16T18:25:48.742799] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-16T18:25:48.950693] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-16T18:25:49.542815] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-16T18:25:50.231869] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:25:50.342778] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-16T18:25:50.434430] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:25:51.142842] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-16T18:25:51.942805] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-16T18:25:52.000132] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:25:52.006878] [INFO ] [REMOTE ] DHT: Full fetch complete (69787 records). [2025-10-16T18:25:52.007029] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-16T18:25:52.007938] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:25:52.008020] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:25:52.008087] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:25:52.008162] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-16T18:25:52.008233] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-16T18:25:52.008293] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-16T18:25:52.008441] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-10-16T18:25:52.008532] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 33.3s. Estimated remaining: 4h 3m 39s. Rate: 7.2 symbols/min [2025-10-16T18:25:52.187359] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:52.227502] [DEBUG] [LOCAL ] DIN: Loaded 37272 existing records from primary storage. [2025-10-16T18:25:52.227818] [INFO ] [MAIN ] DIN: Loaded 37272 existing records. [2025-10-16T18:25:52.412016] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:52.412240] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-16T18:25:52.412319] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-16T18:25:52.412576] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-16T18:25:52.412633] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-16T18:25:52.753609] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-16T18:25:52.780103] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:52.858050] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:25:52.861355] [INFO ] [REMOTE ] DHX: Full fetch complete (21468 records). [2025-10-16T18:25:52.861484] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-16T18:25:53.108268] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T18:25:53.271897] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-16T18:25:53.272014] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-16T18:25:53.272558] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-16T18:25:53.272598] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-16T18:25:53.273155] [DEBUG] [LOCAL ] DHX: Trimmed 21468 records to 13573 (keeping 200 days of data) [2025-10-16T18:25:53.338847] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T18:25:53.358764] [DEBUG] [LOCAL ] DHX: Primary data saved (13573 records). [2025-10-16T18:25:53.358937] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-16T18:25:53.359031] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHX took 31.1s. Estimated remaining: 4h 3m 11s. Rate: 7.2 symbols/min [2025-10-16T18:25:53.524356] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:25:53.553923] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-16T18:25:53.576599] [DEBUG] [LOCAL ] DINO: Loaded 52842 existing records from primary storage. [2025-10-16T18:25:53.576972] [INFO ] [MAIN ] DINO: Loaded 52842 existing records. [2025-10-16T18:25:53.749263] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:25:53.749462] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-16T18:25:53.749510] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-16T18:25:53.750398] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-16T18:25:53.750456] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-16T18:25:54.098786] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:25:54.330079] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:25:54.342771] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-16T18:25:55.142808] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-16T18:25:55.283536] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:25:55.942862] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-16T18:25:56.431218] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T18:25:56.547527] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:25:56.742795] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-16T18:25:57.542817] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-16T18:25:58.342845] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-16T18:25:58.384864] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:25:59.142784] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-16T18:25:59.336313] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:25:59.456573] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T18:25:59.942843] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-16T18:26:00.320990] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:26:00.742851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-16T18:26:00.841348] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:26:00.849163] [INFO ] [REMOTE ] DHR: Full fetch complete (77435 records). [2025-10-16T18:26:00.849353] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-16T18:26:01.301265] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-16T18:26:01.301358] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-16T18:26:01.302515] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-16T18:26:01.302601] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-16T18:26:01.304290] [DEBUG] [LOCAL ] DHR: Trimmed 77435 records to 53768 (keeping 200 days of data) [2025-10-16T18:26:01.550434] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-16T18:26:01.697465] [DEBUG] [LOCAL ] DHR: Primary data saved (53768 records). [2025-10-16T18:26:01.697636] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-16T18:26:01.698455] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHR took 44.4s. Estimated remaining: 4h 3m 2s. Rate: 7.2 symbols/min [2025-10-16T18:26:01.908029] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:01.969533] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-16T18:26:01.969919] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-16T18:26:02.177283] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:02.178514] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-16T18:26:02.178686] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-16T18:26:02.179805] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-16T18:26:02.179863] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-16T18:26:02.344867] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-16T18:26:02.477449] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T18:26:02.470625] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T18:26:02.530355] [INFO ] [REMOTE ] DIAX: Full fetch complete (17720 records). [2025-10-16T18:26:02.533378] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-16T18:26:02.752069] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:03.058005] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-16T18:26:03.058087] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-16T18:26:03.058542] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-16T18:26:03.058584] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-16T18:26:03.059239] [DEBUG] [LOCAL ] DIAX: Trimmed 17720 records to 13091 (keeping 200 days of data) [2025-10-16T18:26:03.140226] [DEBUG] [LOCAL ] DIAX: Primary data saved (13091 records). [2025-10-16T18:26:03.140358] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-16T18:26:03.140439] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 23.1s. Estimated remaining: 4h 2m 35s. Rate: 7.2 symbols/min [2025-10-16T18:26:03.151545] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-16T18:26:03.312091] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:03.312267] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-16T18:26:03.312305] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-16T18:26:03.312417] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-16T18:26:03.312456] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-16T18:26:03.312496] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-16T18:26:03.312527] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-16T18:26:03.668334] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:03.942818] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-16T18:26:04.127136] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-16T18:26:04.742863] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-16T18:26:05.535931] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:26:05.544282] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-16T18:26:05.603813] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T18:26:06.256058] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T18:26:06.311781] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T18:26:06.342784] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-16T18:26:07.142831] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-16T18:26:07.571180] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:26:07.942848] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-16T18:26:08.072805] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:26:08.250753] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:26:08.742822] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-16T18:26:09.210675] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:26:09.542866] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-16T18:26:10.342816] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-16T18:26:10.772685] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:26:11.114814] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:26:11.142802] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-16T18:26:11.492602] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T18:26:11.942803] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-16T18:26:12.742836] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-16T18:26:13.293859] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:26:13.542828] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-16T18:26:14.342888] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-16T18:26:14.925600] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:26:15.142794] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-16T18:26:15.233283] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-16T18:26:15.752063] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:26:15.942814] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-16T18:26:16.070544] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:26:16.371033] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-16T18:26:16.742812] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-16T18:26:17.542829] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-16T18:26:17.814071] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T18:26:18.342812] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-16T18:26:18.469635] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:26:19.142821] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-16T18:26:19.572273] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T18:26:19.942823] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-16T18:26:20.639717] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-16T18:26:20.742771] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-16T18:26:21.544817] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T18:26:21.543142] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-16T18:26:22.342810] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-16T18:26:22.639907] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T18:26:23.066823] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-16T18:26:23.142775] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-16T18:26:23.192776] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:26:23.942832] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-16T18:26:24.742844] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-16T18:26:25.190943] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T18:26:25.542785] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-16T18:26:25.605254] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-16T18:26:26.342821] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-16T18:26:26.524052] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T18:26:26.934669] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:26:26.935535] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-16T18:26:26.935607] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-16T18:26:27.126798] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T18:26:27.127083] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:26:27.127284] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:26:27.127434] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-16T18:26:27.127527] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-16T18:26:27.127740] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-16T18:26:27.127869] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-16T18:26:27.127965] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIVY took 24.0s. Estimated remaining: 4h 3m 10s. Rate: 7.2 symbols/min [2025-10-16T18:26:27.148389] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-16T18:26:27.270921] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T18:26:27.335823] [INFO ] [REMOTE ] DIN: Full fetch complete (55112 records). [2025-10-16T18:26:27.338473] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:27.338907] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-16T18:26:27.711910] [DEBUG] [LOCAL ] DK: Loaded 49447 existing records from primary storage. [2025-10-16T18:26:27.729161] [INFO ] [MAIN ] DK: Loaded 49447 existing records. [2025-10-16T18:26:27.939426] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-16T18:26:27.944760] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-16T18:26:27.944813] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-16T18:26:27.946441] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-16T18:26:27.958941] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-16T18:26:28.020974] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:28.021394] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-16T18:26:28.021732] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-16T18:26:28.021962] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-16T18:26:28.022246] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-16T18:26:28.022138] [DEBUG] [LOCAL ] DIN: Trimmed 55112 records to 37519 (keeping 200 days of data) [2025-10-16T18:26:28.508907] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:28.652778] [DEBUG] [LOCAL ] DIN: Primary data saved (37519 records). [2025-10-16T18:26:28.652991] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-16T18:26:28.653104] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIN took 36.6s. Estimated remaining: 4h 2m 43s. Rate: 7.2 symbols/min [2025-10-16T18:26:28.752504] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-16T18:26:28.842579] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:28.863586] [DEBUG] [LOCAL ] DKL: Loaded 17546 existing records from primary storage. [2025-10-16T18:26:28.863959] [INFO ] [MAIN ] DKL: Loaded 17546 existing records. [2025-10-16T18:26:29.058132] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:29.058576] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-16T18:26:29.058873] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-16T18:26:29.059180] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-16T18:26:29.059251] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-16T18:26:29.204448] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:26:29.535918] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:29.542782] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-16T18:26:30.342789] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-16T18:26:30.437405] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:26:30.517361] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-16T18:26:30.735820] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:26:31.142842] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-16T18:26:31.869803] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:26:31.942841] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-16T18:26:32.747967] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-16T18:26:32.771767] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:26:33.542888] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-16T18:26:34.225214] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-16T18:26:34.342810] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-16T18:26:34.624397] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T18:26:34.643880] [INFO ] [REMOTE ] DINO: Full fetch complete (76730 records). [2025-10-16T18:26:34.658838] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-16T18:26:34.660836] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:26:35.076284] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-16T18:26:35.076399] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-16T18:26:35.077856] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-16T18:26:35.077934] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-16T18:26:35.080060] [DEBUG] [LOCAL ] DINO: Trimmed 76730 records to 53216 (keeping 200 days of data) [2025-10-16T18:26:35.145095] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-16T18:26:35.430209] [DEBUG] [LOCAL ] DINO: Primary data saved (53216 records). [2025-10-16T18:26:35.430436] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-16T18:26:35.431341] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 42.1s. Estimated remaining: 4h 2m 30s. Rate: 7.2 symbols/min [2025-10-16T18:26:35.603851] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:35.653395] [DEBUG] [LOCAL ] DKS: Loaded 49719 existing records from primary storage. [2025-10-16T18:26:35.653734] [INFO ] [MAIN ] DKS: Loaded 49719 existing records. [2025-10-16T18:26:35.842033] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:35.842443] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-16T18:26:35.842499] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-16T18:26:35.842764] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-16T18:26:35.842820] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-16T18:26:35.943890] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-16T18:26:36.221559] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:36.233359] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T18:26:36.707065] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-16T18:26:36.742773] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-16T18:26:37.547876] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-16T18:26:37.563120] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:26:38.342859] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-16T18:26:38.739115] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T18:26:39.142842] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-16T18:26:39.410432] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:26:39.517882] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T18:26:39.942817] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-16T18:26:40.742833] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-16T18:26:41.321999] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-16T18:26:41.542854] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-16T18:26:41.682631] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:26:42.044579] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:26:42.051842] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-16T18:26:42.051952] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-16T18:26:42.344241] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-16T18:26:42.454578] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-16T18:26:42.454709] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-16T18:26:42.455768] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-16T18:26:42.455915] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-16T18:26:42.457690] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54178 (keeping 200 days of data) [2025-10-16T18:26:42.579753] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:26:42.841479] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-16T18:26:42.841613] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-16T18:26:42.842534] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 41.1s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-16T18:26:43.012612] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:26:43.046004] [DEBUG] [LOCAL ] DLB: Loaded 32247 existing records from primary storage. [2025-10-16T18:26:43.046272] [INFO ] [MAIN ] DLB: Loaded 32247 existing records. [2025-10-16T18:26:43.145160] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-16T18:26:43.222760] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:26:43.222961] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-16T18:26:43.223008] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-16T18:26:43.223681] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-16T18:26:43.223738] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-16T18:26:43.543367] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T18:26:43.601589] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:26:43.942811] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-16T18:26:44.742826] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-16T18:26:44.827102] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T18:26:45.444377] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:26:45.542787] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-16T18:26:45.599400] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T18:26:46.342843] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-16T18:26:47.142857] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-16T18:26:47.220531] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T18:26:47.942878] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-16T18:26:48.125533] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:26:48.257554] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T18:26:48.742820] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-16T18:26:49.045744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:26:49.518842] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T18:26:49.542777] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-16T18:26:50.342820] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-16T18:26:51.070246] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:26:51.142810] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-16T18:26:51.815537] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T18:26:51.942860] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-16T18:26:52.742856] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-16T18:26:52.925506] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:26:53.321701] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:26:53.542851] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-16T18:26:54.342864] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-16T18:26:54.478628] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:26:55.059634] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:26:55.142875] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-16T18:26:55.425941] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:26:55.942853] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-16T18:26:56.742850] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-16T18:26:56.845184] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T18:26:56.885789] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:26:57.542855] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-16T18:26:57.891942] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:26:58.184372] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:26:58.342862] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-16T18:26:59.142840] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-16T18:26:59.156796] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T18:26:59.942838] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-16T18:27:00.742861] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-16T18:27:00.915807] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:27:01.542846] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-16T18:27:01.641883] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T18:27:01.684986] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T18:27:01.686994] [INFO ] [REMOTE ] DKL: Full fetch complete (27855 records). [2025-10-16T18:27:01.687092] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-16T18:27:01.687578] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:27:01.687704] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:27:01.687758] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:27:01.687801] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-16T18:27:01.687858] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-16T18:27:01.687968] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-16T18:27:01.688261] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-16T18:27:01.688354] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 33.0s. Estimated remaining: 4h 2m 40s. Rate: 7.2 symbols/min [2025-10-16T18:27:01.858012] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:01.865725] [DEBUG] [LOCAL ] DLNG: Loaded 6188 existing records from primary storage. [2025-10-16T18:27:01.865954] [INFO ] [MAIN ] DLNG: Loaded 6188 existing records. [2025-10-16T18:27:02.058857] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:02.059121] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-16T18:27:02.059177] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-16T18:27:02.059744] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-16T18:27:02.059851] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-16T18:27:02.350848] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-16T18:27:02.458495] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:03.142861] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-16T18:27:03.261093] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:27:03.268335] [INFO ] [REMOTE ] DK: Full fetch complete (70972 records). [2025-10-16T18:27:03.268536] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-16T18:27:03.678398] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-16T18:27:03.678474] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-16T18:27:03.679397] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-16T18:27:03.679461] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-16T18:27:03.681022] [DEBUG] [LOCAL ] DK: Trimmed 70972 records to 49758 (keeping 200 days of data) [2025-10-16T18:27:03.947596] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-16T18:27:03.982057] [DEBUG] [LOCAL ] DK: Primary data saved (49758 records). [2025-10-16T18:27:03.982302] [INFO ] [MAIN ] DK: Full history saved. [2025-10-16T18:27:03.982394] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 36.9s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-16T18:27:04.158581] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:04.158911] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-10-16T18:27:04.159031] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-10-16T18:27:04.159163] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-16T18:27:04.159231] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-16T18:27:04.159369] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-10-16T18:27:04.159500] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-16T18:27:04.549193] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:04.543799] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T18:27:04.588859] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-16T18:27:04.742780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-16T18:27:04.890532] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T18:27:05.542844] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-16T18:27:06.037149] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:27:06.342831] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-16T18:27:06.550707] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T18:27:07.142809] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-16T18:27:07.727008] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:27:07.942917] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-16T18:27:08.148595] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:27:08.742845] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-16T18:27:09.056581] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T18:27:09.542861] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-16T18:27:10.342842] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-16T18:27:10.591477] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T18:27:10.887007] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T18:27:11.142844] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-16T18:27:11.805997] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:27:11.830332] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T18:27:11.942858] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-16T18:27:12.470702] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T18:27:12.742850] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-16T18:27:13.497701] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T18:27:13.542778] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-16T18:27:14.099868] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:27:14.342813] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-16T18:27:15.013533] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T18:27:15.142825] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-16T18:27:15.824032] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T18:27:15.942820] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-16T18:27:16.742803] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-16T18:27:17.542798] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-16T18:27:17.912381] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T18:27:17.918882] [INFO ] [REMOTE ] DKS: Full fetch complete (71806 records). [2025-10-16T18:27:17.919045] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-16T18:27:18.342679] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-16T18:27:18.343141] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-16T18:27:18.342985] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-16T18:27:18.344725] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-16T18:27:18.345025] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-16T18:27:18.348579] [DEBUG] [LOCAL ] DKS: Trimmed 71806 records to 50058 (keeping 200 days of data) [2025-10-16T18:27:18.637017] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T18:27:18.740338] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T18:27:18.777098] [DEBUG] [LOCAL ] DKS: Primary data saved (50058 records). [2025-10-16T18:27:18.777312] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-16T18:27:18.778293] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DKS took 43.3s. Estimated remaining: 4h 2m 25s. Rate: 7.2 symbols/min [2025-10-16T18:27:18.974070] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:18.988284] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:27:19.011167] [DEBUG] [LOCAL ] DLX: Loaded 28382 existing records from primary storage. [2025-10-16T18:27:19.011442] [INFO ] [MAIN ] DLX: Loaded 28382 existing records. [2025-10-16T18:27:19.150290] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-16T18:27:19.191282] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:19.191529] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-16T18:27:19.191579] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-16T18:27:19.191912] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-16T18:27:19.191968] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-16T18:27:19.585723] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:19.942823] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-16T18:27:20.742875] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-16T18:27:20.769577] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:27:20.771486] [INFO ] [REMOTE ] DLNG: Full fetch complete (11734 records). [2025-10-16T18:27:20.771581] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-16T18:27:21.196126] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-16T18:27:21.196303] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-16T18:27:21.196748] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-16T18:27:21.196936] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-16T18:27:21.213871] [DEBUG] [LOCAL ] DLNG: Trimmed 11734 records to 6230 (keeping 200 days of data) [2025-10-16T18:27:21.242426] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T18:27:21.275499] [DEBUG] [LOCAL ] DLNG: Primary data saved (6230 records). [2025-10-16T18:27:21.275621] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-16T18:27:21.275741] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 19.6s. Estimated remaining: 4h 2m 0s. Rate: 7.2 symbols/min [2025-10-16T18:27:21.443620] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:21.443813] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-16T18:27:21.443860] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-16T18:27:21.443977] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-16T18:27:21.444018] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-16T18:27:21.444058] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-16T18:27:21.444089] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-16T18:27:21.552539] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-16T18:27:21.816481] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:22.103082] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:27:22.107879] [INFO ] [REMOTE ] DLB: Full fetch complete (47294 records). [2025-10-16T18:27:22.107992] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-16T18:27:22.348939] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-16T18:27:22.483308] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-16T18:27:22.483395] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-16T18:27:22.484161] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-16T18:27:22.484226] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-16T18:27:22.485386] [DEBUG] [LOCAL ] DLB: Trimmed 47294 records to 32489 (keeping 200 days of data) [2025-10-16T18:27:22.682957] [DEBUG] [LOCAL ] DLB: Primary data saved (32489 records). [2025-10-16T18:27:22.683095] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-16T18:27:22.683172] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DLB took 39.8s. Estimated remaining: 4h 1m 33s. Rate: 7.2 symbols/min [2025-10-16T18:27:22.854559] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:22.866378] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-10-16T18:27:22.867425] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T18:27:22.866982] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-10-16T18:27:22.872435] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-16T18:27:22.872486] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-16T18:27:22.872531] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-16T18:27:22.872565] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-16T18:27:23.147875] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-16T18:27:23.236689] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:23.570568] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T18:27:23.942818] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-16T18:27:24.742852] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-16T18:27:25.008514] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T18:27:25.069939] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:27:25.173845] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T18:27:25.542847] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-16T18:27:26.342867] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-16T18:27:27.142846] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-16T18:27:27.202278] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:27:27.236795] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T18:27:27.695079] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:27:27.942816] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-16T18:27:28.497851] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T18:27:28.742897] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-16T18:27:29.377381] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T18:27:29.542847] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-16T18:27:30.342860] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-16T18:27:30.526619] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T18:27:31.142819] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-16T18:27:31.718405] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T18:27:31.720252] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:27:31.942843] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-16T18:27:32.742807] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-16T18:27:33.542788] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-16T18:27:33.847686] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:27:33.957476] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T18:27:34.342851] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-16T18:27:34.485506] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:27:34.659686] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-16T18:27:35.142815] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-16T18:27:35.942870] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-16T18:27:36.365314] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:27:36.742821] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-16T18:27:37.542823] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-16T18:27:37.759575] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T18:27:37.789990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:27:38.306679] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:27:38.342878] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-16T18:27:39.142856] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-16T18:27:39.616562] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:27:39.942846] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-16T18:27:40.742860] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-16T18:27:40.878405] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:27:41.248820] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T18:27:41.542794] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-16T18:27:41.662579] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T18:27:42.342803] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-16T18:27:42.850559] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:27:43.052161] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:27:43.142783] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-16T18:27:43.942805] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-16T18:27:44.371283] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T18:27:44.722476] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:27:44.742772] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-16T18:27:45.542822] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-16T18:27:45.583554] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T18:27:45.590219] [INFO ] [REMOTE ] DLR: Full fetch complete (74149 records). [2025-10-16T18:27:45.590399] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-16T18:27:45.986833] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-16T18:27:45.986934] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-16T18:27:45.987976] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-16T18:27:45.988042] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-16T18:27:45.989578] [DEBUG] [LOCAL ] DLR: Trimmed 74149 records to 51052 (keeping 200 days of data) [2025-10-16T18:27:46.311524] [DEBUG] [LOCAL ] DLR: Primary data saved (51052 records). [2025-10-16T18:27:46.311696] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-16T18:27:46.311786] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 42.3s. Estimated remaining: 4h 2m 7s. Rate: 7.2 symbols/min [2025-10-16T18:27:46.348042] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-16T18:27:46.486941] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:46.499589] [DEBUG] [LOCAL ] DMB: Loaded 10304 existing records from primary storage. [2025-10-16T18:27:46.499859] [INFO ] [MAIN ] DMB: Loaded 10304 existing records. [2025-10-16T18:27:46.682025] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:46.682389] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-16T18:27:46.682468] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-16T18:27:46.682763] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-16T18:27:46.682822] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-16T18:27:46.969852] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:27:47.078872] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:47.142787] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-16T18:27:47.253298] [DEBUG] [REMOTE ] DMB: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-16T18:27:47.253676] [WARN ] [REMOTE ] DMB: No data returned for month 2024-12 [2025-10-16T18:27:47.253749] [FATAL] [REMOTE ] DMB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:27:47.253815] [FATAL] [MAIN ] DMB: Failed to fetch primary data. [2025-10-16T18:27:47.253880] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:27:47.253951] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-16T18:27:47.254015] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-16T18:27:47.254051] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-16T18:27:47.254187] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-16T18:27:47.254287] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DMB took 0.9s. Estimated remaining: 4h 1m 38s. Rate: 7.2 symbols/min [2025-10-16T18:27:47.426938] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:47.439065] [DEBUG] [LOCAL ] DMO: Loaded 9967 existing records from primary storage. [2025-10-16T18:27:47.439292] [INFO ] [MAIN ] DMO: Loaded 9967 existing records. [2025-10-16T18:27:47.613437] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T18:27:47.633313] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:27:47.638607] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-16T18:27:47.638993] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-16T18:27:47.639187] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-16T18:27:47.639243] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-16T18:27:47.954432] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-16T18:27:47.994402] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:48.742806] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-16T18:27:49.162912] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:27:49.166179] [INFO ] [REMOTE ] DLX: Full fetch complete (41308 records). [2025-10-16T18:27:49.166268] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-16T18:27:49.481781] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:27:49.548090] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-16T18:27:49.549623] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-16T18:27:49.549709] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-16T18:27:49.550376] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-16T18:27:49.550520] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-16T18:27:49.551563] [DEBUG] [LOCAL ] DLX: Trimmed 41308 records to 28520 (keeping 200 days of data) [2025-10-16T18:27:49.723067] [DEBUG] [LOCAL ] DLX: Primary data saved (28520 records). [2025-10-16T18:27:49.723235] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-16T18:27:49.723330] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DLX took 30.9s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-16T18:27:49.893081] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:27:49.893232] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-16T18:27:49.893286] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-16T18:27:49.893392] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-16T18:27:49.893441] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-16T18:27:49.893482] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-16T18:27:49.893517] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-16T18:27:50.249122] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:27:50.342773] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-16T18:27:50.351883] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:27:51.142802] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-16T18:27:51.942785] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-16T18:27:52.001319] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T18:27:52.125874] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T18:27:52.640339] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-16T18:27:52.742880] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-16T18:27:53.542820] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-16T18:27:54.342817] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-16T18:27:54.399882] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T18:27:54.401999] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T18:27:54.787392] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T18:27:55.142816] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-16T18:27:55.942447] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T18:27:55.943269] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-16T18:27:56.742834] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-16T18:27:57.153846] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T18:27:57.542826] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-16T18:27:58.148292] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T18:27:58.342790] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-16T18:27:58.390240] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:27:58.940699] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:27:59.142862] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-16T18:27:59.942815] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-16T18:28:00.051989] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:28:00.055966] [INFO ] [REMOTE ] DLY: Full fetch complete (28557 records). [2025-10-16T18:28:00.056068] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-16T18:28:00.425768] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-16T18:28:00.425842] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-16T18:28:00.426385] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-16T18:28:00.426443] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-16T18:28:00.427107] [DEBUG] [LOCAL ] DLY: Trimmed 28557 records to 20735 (keeping 200 days of data) [2025-10-16T18:28:00.552825] [DEBUG] [LOCAL ] DLY: Primary data saved (20735 records). [2025-10-16T18:28:00.552945] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-16T18:28:00.553015] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 39.3s. Estimated remaining: 4h 1m 12s. Rate: 7.2 symbols/min [2025-10-16T18:28:00.726675] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:00.747502] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-16T18:28:00.766803] [DEBUG] [LOCAL ] DNOW: Loaded 43750 existing records from primary storage. [2025-10-16T18:28:00.767120] [INFO ] [MAIN ] DNOW: Loaded 43750 existing records. [2025-10-16T18:28:00.948080] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:00.955283] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-16T18:28:00.955360] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-16T18:28:00.955581] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:28:00.959003] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-16T18:28:00.959077] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-16T18:28:01.311542] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:01.542845] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-16T18:28:01.547441] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:28:01.549965] [INFO ] [REMOTE ] DMA: Full fetch complete (6730 records). [2025-10-16T18:28:01.550055] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-16T18:28:01.903439] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-16T18:28:01.903513] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-16T18:28:01.903717] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-16T18:28:01.903777] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-16T18:28:01.904150] [DEBUG] [LOCAL ] DMA: Trimmed 6730 records to 4772 (keeping 200 days of data) [2025-10-16T18:28:01.932866] [DEBUG] [LOCAL ] DMA: Primary data saved (4772 records). [2025-10-16T18:28:01.933010] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-16T18:28:01.933083] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMA took 39.2s. Estimated remaining: 4h 0m 44s. Rate: 7.2 symbols/min [2025-10-16T18:28:02.100614] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:02.132731] [DEBUG] [LOCAL ] DNP: Loaded 33232 existing records from primary storage. [2025-10-16T18:28:02.133022] [INFO ] [MAIN ] DNP: Loaded 33232 existing records. [2025-10-16T18:28:02.308036] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:02.308235] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-16T18:28:02.308307] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-16T18:28:02.309061] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-16T18:28:02.309134] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-16T18:28:02.351129] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-16T18:28:02.664845] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:03.142852] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-16T18:28:03.162806] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T18:28:03.367227] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:28:03.942807] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-16T18:28:04.596284] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:28:04.742812] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-16T18:28:05.410444] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T18:28:05.548941] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-16T18:28:05.568314] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:28:06.342832] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-16T18:28:06.816615] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:28:07.142888] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-16T18:28:07.154703] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:28:07.942895] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-16T18:28:08.662147] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T18:28:08.706433] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T18:28:08.742816] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-16T18:28:09.482410] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T18:28:09.484094] [INFO ] [REMOTE ] DMO: Full fetch complete (14523 records). [2025-10-16T18:28:09.484180] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-16T18:28:09.547954] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-16T18:28:09.847222] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-16T18:28:09.847311] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-16T18:28:09.847681] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-16T18:28:09.847746] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-16T18:28:09.848466] [DEBUG] [LOCAL ] DMO: Trimmed 14523 records to 9999 (keeping 200 days of data) [2025-10-16T18:28:09.909967] [DEBUG] [LOCAL ] DMO: Primary data saved (9999 records). [2025-10-16T18:28:09.910110] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-16T18:28:09.910192] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 22.7s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-16T18:28:10.079562] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:10.130475] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-16T18:28:10.130812] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-16T18:28:10.306054] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:10.306278] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-16T18:28:10.306324] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-16T18:28:10.306525] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-16T18:28:10.306580] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-16T18:28:10.348056] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-16T18:28:10.653233] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:11.060820] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:28:11.142812] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-16T18:28:11.904109] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:28:11.942777] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-16T18:28:12.366961] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:28:12.742796] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-16T18:28:13.513813] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:28:13.542784] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-16T18:28:13.764362] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:28:14.342824] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-16T18:28:14.995214] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:28:15.142778] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-16T18:28:15.752802] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:28:15.942813] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-16T18:28:16.601999] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:28:16.742812] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-16T18:28:17.542819] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-16T18:28:17.837511] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:28:18.186241] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:28:18.342816] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-16T18:28:18.608610] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T18:28:19.142884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-16T18:28:19.942890] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-16T18:28:20.261116] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:28:20.742791] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-16T18:28:20.863813] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:28:20.940104] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:28:21.542838] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-16T18:28:22.342778] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-16T18:28:22.513719] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:28:23.142826] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-16T18:28:23.319949] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:28:23.360306] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T18:28:23.942888] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-16T18:28:24.742884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-16T18:28:24.801488] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:28:25.542827] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-16T18:28:25.731563] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:28:26.342900] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-16T18:28:27.142478] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:28:27.152748] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-16T18:28:27.942840] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-16T18:28:28.408801] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-16T18:28:28.481782] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:28:28.742882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-16T18:28:29.542836] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-16T18:28:29.894579] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (5.15 seconds). [2025-10-16T18:28:29.952702] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:28:30.342843] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-16T18:28:30.643044] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-16T18:28:30.847738] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:28:31.142809] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-16T18:28:31.611711] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:28:31.942810] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-16T18:28:32.144077] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:28:32.148374] [INFO ] [REMOTE ] DNP: Full fetch complete (48870 records). [2025-10-16T18:28:32.148473] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-16T18:28:32.516171] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-16T18:28:32.516249] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-16T18:28:32.516967] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-16T18:28:32.517042] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-16T18:28:32.518230] [DEBUG] [LOCAL ] DNP: Trimmed 48870 records to 33479 (keeping 200 days of data) [2025-10-16T18:28:32.722607] [DEBUG] [LOCAL ] DNP: Primary data saved (33479 records). [2025-10-16T18:28:32.722765] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-16T18:28:32.722849] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNP took 30.8s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-16T18:28:32.747958] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-16T18:28:32.905504] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:32.905682] [DEBUG] [LOCAL ] DOCN: No existing data file found in primary storage. [2025-10-16T18:28:32.905740] [WARN ] [MAIN ] DOCN: No existing data found, performing full refresh instead. [2025-10-16T18:28:32.905863] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-16T18:28:32.905938] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-16T18:28:32.906000] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-16T18:28:32.906048] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-16T18:28:33.289291] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:33.542832] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-16T18:28:34.083689] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-16T18:28:34.090200] [INFO ] [REMOTE ] DNA: Full fetch complete (71278 records). [2025-10-16T18:28:34.090332] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-16T18:28:34.342853] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-16T18:28:34.483251] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-16T18:28:34.483353] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-16T18:28:34.484372] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-16T18:28:34.484486] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-16T18:28:34.512733] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T18:28:34.511490] [DEBUG] [LOCAL ] DNA: Trimmed 71278 records to 48954 (keeping 200 days of data) [2025-10-16T18:28:34.796555] [DEBUG] [LOCAL ] DNA: Primary data saved (48954 records). [2025-10-16T18:28:34.796801] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-16T18:28:34.796925] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 45.1s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-16T18:28:34.821545] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:28:35.142821] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-16T18:28:35.942849] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-16T18:28:36.217892] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:28:36.473181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:28:36.742839] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-16T18:28:37.442434] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:28:37.542848] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-16T18:28:38.224784] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:28:38.342768] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-16T18:28:39.073577] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:28:39.142776] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-16T18:28:39.836425] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:28:39.942790] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-16T18:28:40.742795] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-16T18:28:40.823113] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T18:28:40.829064] [INFO ] [REMOTE ] DNOW: Full fetch complete (63344 records). [2025-10-16T18:28:40.829179] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-16T18:28:41.214718] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-16T18:28:41.214825] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-16T18:28:41.215748] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-16T18:28:41.215813] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-16T18:28:41.217167] [DEBUG] [LOCAL ] DNOW: Trimmed 63344 records to 44124 (keeping 200 days of data) [2025-10-16T18:28:41.471947] [DEBUG] [LOCAL ] DNOW: Primary data saved (44124 records). [2025-10-16T18:28:41.472075] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-16T18:28:41.472151] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNOW took 40.9s. Estimated remaining: 4h 0m 28s. Rate: 7.2 symbols/min [2025-10-16T18:28:42.003705] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T18:28:42.014914] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-16T18:28:42.687555] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T18:28:42.698236] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-16T18:28:43.949266] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T18:28:43.956191] [INFO ] [REMOTE ] DOC: Full fetch complete (77570 records). [2025-10-16T18:28:43.956310] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-16T18:28:44.351264] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-16T18:28:44.351403] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-16T18:28:44.352543] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-16T18:28:44.362301] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-16T18:28:44.381233] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T18:28:44.392918] [DEBUG] [LOCAL ] DOC: Trimmed 77570 records to 53944 (keeping 200 days of data) [2025-10-16T18:28:44.392820] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-16T18:28:44.725902] [DEBUG] [LOCAL ] DOC: Primary data saved (53944 records). [2025-10-16T18:28:44.726350] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-16T18:28:44.726451] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 34.8s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-16T18:28:46.261394] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-16T18:28:46.271937] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-16T18:28:48.113177] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:28:48.129102] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-16T18:28:49.963914] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:28:49.975343] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-16T18:28:51.776419] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-16T18:28:51.787869] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-16T18:28:53.745807] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:28:53.752491] [INFO ] [REMOTE ] DOCN: Full fetch complete (72657 records). [2025-10-16T18:28:53.752616] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-16T18:28:54.133595] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-16T18:28:54.133704] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-16T18:28:54.134608] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-16T18:28:54.134677] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-16T18:28:54.136211] [DEBUG] [LOCAL ] DOCN: Trimmed 72657 records to 51421 (keeping 200 days of data) [2025-10-16T18:28:54.435309] [DEBUG] [LOCAL ] DOCN: Primary data saved (51421 records). [2025-10-16T18:28:54.435453] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-16T18:28:54.435526] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 21.7s. Estimated remaining: 4h 0m 1s. Rate: 7.2 symbols/min [2025-10-16T18:28:54.965703] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.086242] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.072937] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.145516] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:28:55.178476] [DEBUG] [LOCAL ] DOUG: Loaded 34244 existing records from primary storage. [2025-10-16T18:28:55.179076] [INFO ] [MAIN ] DOUG: Loaded 34244 existing records. [2025-10-16T18:28:55.366445] [DEBUG] [LOCAL ] DOV: Loaded 45611 existing records from primary storage. [2025-10-16T18:28:55.385382] [INFO ] [MAIN ] DOV: Loaded 45611 existing records. [2025-10-16T18:28:55.480932] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:55.475457] [DEBUG] [LOCAL ] DOLE: Loaded 39209 existing records from primary storage. [2025-10-16T18:28:55.501586] [DEBUG] [LOCAL ] DOCS: Loaded 50742 existing records from primary storage. [2025-10-16T18:28:55.521395] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-16T18:28:55.532082] [INFO ] [MAIN ] DOLE: Loaded 39209 existing records. [2025-10-16T18:28:55.531968] [INFO ] [MAIN ] DOCS: Loaded 50742 existing records. [2025-10-16T18:28:55.526720] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-16T18:28:55.557180] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-16T18:28:55.628574] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-16T18:28:55.879254] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:55.916219] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-16T18:28:55.975889] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-16T18:28:56.050258] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:56.069319] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-16T18:28:56.069462] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-16T18:28:56.100327] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-16T18:28:56.069784] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-16T18:28:56.153425] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-16T18:28:56.193032] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-16T18:28:56.261109] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:28:56.463379] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-16T18:28:56.479076] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-16T18:28:56.499384] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-16T18:28:56.515619] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-16T18:28:56.777306] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:56.828425] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-16T18:28:57.304292] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.361526] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.369424] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-16T18:28:57.399192] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-16T18:28:57.479997] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:28:57.480285] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-16T18:28:58.479982] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T18:28:58.487015] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-16T18:28:58.535562] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T18:28:58.544686] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-16T18:28:58.636088] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:28:58.644464] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-16T18:28:58.762353] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:28:58.772738] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-16T18:28:59.447130] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T18:28:59.454579] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-16T18:28:59.876195] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:28:59.884000] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-16T18:28:59.908495] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:28:59.918476] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-16T18:29:00.418171] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:29:00.428339] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-16T18:29:00.445784] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:29:00.452277] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-16T18:29:01.216233] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T18:29:01.223781] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-16T18:29:01.247310] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T18:29:01.255590] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-16T18:29:01.500107] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T18:29:01.507970] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-16T18:29:02.316584] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T18:29:02.326513] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-16T18:29:02.541272] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:29:02.552113] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-16T18:29:02.605255] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T18:29:02.614101] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-16T18:29:02.646615] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T18:29:02.656407] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-16T18:29:03.835367] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:29:03.865744] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-16T18:29:03.867145] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:29:03.942774] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-16T18:29:04.033906] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:29:04.742850] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-16T18:29:04.788315] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-16T18:29:05.423616] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T18:29:05.541455] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:29:05.551483] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-16T18:29:05.892052] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T18:29:06.342799] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-16T18:29:07.142805] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-16T18:29:07.202215] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:29:07.413995] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:29:07.942869] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-16T18:29:08.469608] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:29:08.742839] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-16T18:29:09.497085] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T18:29:09.542840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-16T18:29:10.074202] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:29:10.342818] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-16T18:29:11.142799] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-16T18:29:11.214795] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:29:11.583417] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:29:11.942820] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-16T18:29:12.742858] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-16T18:29:13.280946] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-16T18:29:13.350764] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T18:29:13.542803] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-16T18:29:13.964088] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:29:14.342863] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-16T18:29:15.142838] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-16T18:29:15.253574] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:29:15.942840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-16T18:29:16.094901] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:29:16.127146] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T18:29:16.742831] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-16T18:29:17.318442] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T18:29:17.542811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-16T18:29:18.225581] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T18:29:18.342794] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-16T18:29:18.944377] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T18:29:18.949875] [INFO ] [REMOTE ] DOUG: Full fetch complete (50450 records). [2025-10-16T18:29:18.950045] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-16T18:29:19.150694] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-16T18:29:19.360776] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-16T18:29:19.360864] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-16T18:29:19.361592] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-16T18:29:19.361635] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-16T18:29:19.362903] [DEBUG] [LOCAL ] DOUG: Trimmed 50450 records to 34428 (keeping 200 days of data) [2025-10-16T18:29:19.567790] [DEBUG] [LOCAL ] DOUG: Primary data saved (34428 records). [2025-10-16T18:29:19.567921] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-16T18:29:19.567999] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 25.1s. Estimated remaining: 4h 0m 38s. Rate: 7.2 symbols/min [2025-10-16T18:29:19.735407] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:19.785096] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-16T18:29:19.785410] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-16T18:29:19.943901] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-16T18:29:19.968019] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:19.968408] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-16T18:29:19.968588] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-16T18:29:19.968988] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-16T18:29:19.969046] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-16T18:29:20.343540] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:20.355845] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:29:20.739773] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:29:20.748444] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-16T18:29:20.750218] [INFO ] [REMOTE ] DOLE: Full fetch complete (54631 records). [2025-10-16T18:29:20.750348] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-16T18:29:21.151100] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-16T18:29:21.151200] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-16T18:29:21.152137] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-16T18:29:21.152217] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-16T18:29:21.153462] [DEBUG] [LOCAL ] DOLE: Trimmed 54631 records to 39478 (keeping 200 days of data) [2025-10-16T18:29:21.396530] [DEBUG] [LOCAL ] DOLE: Primary data saved (39478 records). [2025-10-16T18:29:21.396708] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-16T18:29:21.396804] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOLE took 26.9s. Estimated remaining: 4h 0m 12s. Rate: 7.2 symbols/min [2025-10-16T18:29:21.562793] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-16T18:29:21.590566] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:21.609202] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:29:21.615728] [INFO ] [REMOTE ] DOV: Full fetch complete (65837 records). [2025-10-16T18:29:21.616392] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-16T18:29:21.726296] [DEBUG] [LOCAL ] DPG: Loaded 13576 existing records from primary storage. [2025-10-16T18:29:21.732243] [INFO ] [MAIN ] DPG: Loaded 13576 existing records. [2025-10-16T18:29:22.118842] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:22.129382] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-16T18:29:22.146823] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-16T18:29:22.164230] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-16T18:29:22.182080] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-16T18:29:22.281452] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-16T18:29:22.297348] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-16T18:29:22.308610] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-16T18:29:22.314356] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-16T18:29:22.367913] [DEBUG] [LOCAL ] DOV: Trimmed 65837 records to 45966 (keeping 200 days of data) [2025-10-16T18:29:22.660788] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:22.661871] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-16T18:29:22.830387] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-16T18:29:22.904746] [DEBUG] [LOCAL ] DOV: Primary data saved (45966 records). [2025-10-16T18:29:22.904882] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-16T18:29:22.904963] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOV took 28.4s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-16T18:29:23.070184] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:23.110548] [DEBUG] [LOCAL ] DQ: Loaded 43738 existing records from primary storage. [2025-10-16T18:29:23.110867] [INFO ] [MAIN ] DQ: Loaded 43738 existing records. [2025-10-16T18:29:23.153598] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-16T18:29:23.292726] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:23.292937] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-16T18:29:23.292991] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-16T18:29:23.293262] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-16T18:29:23.293372] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-16T18:29:23.421786] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:29:23.643210] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:29:23.702723] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:23.942811] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-16T18:29:24.742842] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-16T18:29:25.012506] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:29:25.325901] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T18:29:25.331478] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T18:29:25.542813] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-16T18:29:26.342822] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-16T18:29:26.962727] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T18:29:27.142843] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-16T18:29:27.942839] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-16T18:29:28.169053] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-16T18:29:28.724990] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:29:28.742763] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-16T18:29:28.887457] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:29:28.893801] [INFO ] [REMOTE ] DOCS: Full fetch complete (74031 records). [2025-10-16T18:29:28.893911] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-16T18:29:29.279995] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-16T18:29:29.280092] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-16T18:29:29.281165] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-16T18:29:29.281230] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-16T18:29:29.282606] [DEBUG] [LOCAL ] DOCS: Trimmed 74031 records to 51081 (keeping 200 days of data) [2025-10-16T18:29:29.496296] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:29:29.557002] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-16T18:29:29.595395] [DEBUG] [LOCAL ] DOCS: Primary data saved (51081 records). [2025-10-16T18:29:29.595525] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-16T18:29:29.596747] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 35.2s. Estimated remaining: 3h 59m 33s. Rate: 7.2 symbols/min [2025-10-16T18:29:29.790640] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:29.829638] [DEBUG] [LOCAL ] DRD: Loaded 37717 existing records from primary storage. [2025-10-16T18:29:29.829951] [INFO ] [MAIN ] DRD: Loaded 37717 existing records. [2025-10-16T18:29:30.002889] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:30.003081] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-16T18:29:30.003128] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-16T18:29:30.003335] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-16T18:29:30.003390] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-16T18:29:30.347140] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:30.347237] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-16T18:29:31.142873] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-16T18:29:31.225555] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T18:29:31.278629] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T18:29:31.942865] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-16T18:29:32.287987] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:29:32.742809] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-16T18:29:32.821945] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T18:29:33.542852] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-16T18:29:33.910719] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:29:34.342817] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-16T18:29:34.465883] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:29:35.142815] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-16T18:29:35.900963] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:29:35.942766] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-16T18:29:36.075754] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T18:29:36.742882] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-16T18:29:37.502999] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:29:37.542768] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-16T18:29:38.342804] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-16T18:29:38.471993] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:29:38.976934] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:29:39.142780] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-16T18:29:39.250807] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:29:39.942849] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-16T18:29:40.588203] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:29:40.742893] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-16T18:29:40.808177] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:29:41.542890] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-16T18:29:42.342861] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-16T18:29:42.905033] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-16T18:29:43.071934] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T18:29:43.142774] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-16T18:29:43.258755] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T18:29:43.942841] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-16T18:29:44.709928] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T18:29:44.712795] [INFO ] [REMOTE ] DPG: Full fetch complete (19051 records). [2025-10-16T18:29:44.712919] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-16T18:29:44.746574] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-16T18:29:44.900613] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:29:45.152271] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-16T18:29:45.152399] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-16T18:29:45.153504] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-16T18:29:45.153584] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-16T18:29:45.154825] [DEBUG] [LOCAL ] DPG: Trimmed 19051 records to 13660 (keeping 200 days of data) [2025-10-16T18:29:45.244226] [DEBUG] [LOCAL ] DPG: Primary data saved (13660 records). [2025-10-16T18:29:45.244431] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-16T18:29:45.244531] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 23.8s. Estimated remaining: 3h 59m 44s. Rate: 7.2 symbols/min [2025-10-16T18:29:45.429247] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:45.480364] [DEBUG] [LOCAL ] DRH: Loaded 50410 existing records from primary storage. [2025-10-16T18:29:45.481077] [INFO ] [MAIN ] DRH: Loaded 50410 existing records. [2025-10-16T18:29:45.550133] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-16T18:29:45.670986] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:45.671195] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-16T18:29:45.671244] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-16T18:29:45.671463] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-16T18:29:45.671520] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-16T18:29:46.010679] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:46.342878] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-16T18:29:46.817185] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:29:47.145445] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-16T18:29:47.148434] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T18:29:47.852825] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T18:29:47.942886] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-16T18:29:48.509436] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:29:48.742804] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-16T18:29:48.972048] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:29:49.542852] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-16T18:29:50.342822] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-16T18:29:50.805142] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T18:29:51.007894] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:29:51.142780] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-16T18:29:51.529900] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T18:29:51.942804] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-16T18:29:52.399451] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T18:29:52.742885] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-16T18:29:53.542862] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-16T18:29:54.199099] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:29:54.342784] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-16T18:29:54.465176] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T18:29:54.471300] [INFO ] [REMOTE ] DQ: Full fetch complete (63576 records). [2025-10-16T18:29:54.471411] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-16T18:29:54.852588] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-16T18:29:54.852709] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-16T18:29:54.853600] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-16T18:29:54.853692] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-16T18:29:54.854938] [DEBUG] [LOCAL ] DQ: Trimmed 63576 records to 44086 (keeping 200 days of data) [2025-10-16T18:29:55.109306] [DEBUG] [LOCAL ] DQ: Primary data saved (44086 records). [2025-10-16T18:29:55.109463] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-16T18:29:55.110119] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 32.2s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-10-16T18:29:55.152273] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-16T18:29:55.293371] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:29:55.312539] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:29:55.367136] [DEBUG] [LOCAL ] DRI: Loaded 47693 existing records from primary storage. [2025-10-16T18:29:55.367433] [INFO ] [MAIN ] DRI: Loaded 47693 existing records. [2025-10-16T18:29:55.540829] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:29:55.541045] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-16T18:29:55.541092] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-16T18:29:55.541275] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-16T18:29:55.541313] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-16T18:29:55.887249] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:29:55.942773] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-16T18:29:56.489930] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-16T18:29:56.521211] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:29:56.742845] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-16T18:29:57.278324] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:29:57.542842] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-16T18:29:58.189949] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:29:58.342828] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-16T18:29:59.142885] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-16T18:29:59.371197] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T18:29:59.942823] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-16T18:30:00.150275] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T18:30:00.418472] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T18:30:00.742799] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-16T18:30:01.542789] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-16T18:30:01.871768] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-16T18:30:02.342859] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-16T18:30:02.945971] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:30:03.142804] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-16T18:30:03.633505] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-16T18:30:03.640587] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-16T18:30:03.640787] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-16T18:30:03.947951] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-16T18:30:04.025431] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-16T18:30:04.025521] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-16T18:30:04.026535] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-16T18:30:04.026602] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-16T18:30:04.028105] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54123 (keeping 200 days of data) [2025-10-16T18:30:04.276973] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T18:30:04.398882] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-16T18:30:04.399034] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-16T18:30:04.399121] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DOW took 44.8s. Estimated remaining: 3h 59m 34s. Rate: 7.2 symbols/min [2025-10-16T18:30:04.581154] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:04.592615] [DEBUG] [LOCAL ] DRLL: Loaded 9148 existing records from primary storage. [2025-10-16T18:30:04.592877] [INFO ] [MAIN ] DRLL: Loaded 9148 existing records. [2025-10-16T18:30:04.749333] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-16T18:30:04.812334] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T18:30:04.809856] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:04.822508] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-16T18:30:04.822758] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-16T18:30:04.823252] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-16T18:30:04.823318] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-16T18:30:05.181254] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:05.485388] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:30:05.542815] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-16T18:30:06.267605] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:30:06.342821] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-16T18:30:06.724016] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:30:07.142800] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-16T18:30:07.912922] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:30:07.942785] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-16T18:30:08.075814] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T18:30:08.742864] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-16T18:30:09.542837] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-16T18:30:09.916240] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-16T18:30:09.921683] [INFO ] [REMOTE ] DRD: Full fetch complete (51075 records). [2025-10-16T18:30:09.921789] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-16T18:30:09.922487] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:09.922586] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:09.922687] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:09.922776] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-16T18:30:09.922851] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-16T18:30:09.922902] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-10-16T18:30:09.923084] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-10-16T18:30:09.923615] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 40.3s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-16T18:30:10.090088] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:10.121676] [DEBUG] [LOCAL ] DSL: Loaded 28822 existing records from primary storage. [2025-10-16T18:30:10.121983] [INFO ] [MAIN ] DSL: Loaded 28822 existing records. [2025-10-16T18:30:10.297549] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:10.297841] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-16T18:30:10.297938] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-16T18:30:10.298261] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-16T18:30:10.298322] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-16T18:30:10.352452] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-16T18:30:10.617905] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T18:30:10.702261] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:11.015214] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:30:11.021210] [INFO ] [REMOTE ] DRH: Full fetch complete (71742 records). [2025-10-16T18:30:11.021321] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-16T18:30:11.022102] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:11.022198] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:11.022271] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:11.022358] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-16T18:30:11.022434] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-16T18:30:11.022477] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-16T18:30:11.022707] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-16T18:30:11.023289] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 25.8s. Estimated remaining: 3h 58m 51s. Rate: 7.2 symbols/min [2025-10-16T18:30:11.143012] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-16T18:30:11.148518] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:30:11.207611] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:11.222618] [DEBUG] [LOCAL ] DSM: Loaded 14125 existing records from primary storage. [2025-10-16T18:30:11.222882] [INFO ] [MAIN ] DSM: Loaded 14125 existing records. [2025-10-16T18:30:11.394517] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:11.394768] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-16T18:30:11.394826] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-16T18:30:11.394985] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-16T18:30:11.395041] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-16T18:30:11.743064] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:11.942792] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-16T18:30:12.548102] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:30:12.590930] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:30:12.742787] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-16T18:30:13.542794] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-16T18:30:13.943850] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:30:14.342816] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-16T18:30:14.435260] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T18:30:15.142806] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-16T18:30:15.942837] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-16T18:30:15.967910] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-16T18:30:16.000621] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T18:30:16.742803] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-16T18:30:17.168378] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:30:17.337855] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T18:30:17.542855] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-16T18:30:18.342811] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-16T18:30:19.142807] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-16T18:30:19.942798] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-16T18:30:20.137384] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:30:20.211696] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-16T18:30:20.330787] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T18:30:20.411594] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T18:30:20.742796] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-16T18:30:21.542809] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-16T18:30:21.685707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:30:22.342852] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-16T18:30:22.855821] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-16T18:30:22.966497] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:30:23.142809] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-16T18:30:23.942859] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-16T18:30:24.573726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T18:30:24.747874] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-16T18:30:24.760591] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:30:25.542816] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-16T18:30:25.972057] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:30:26.342825] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-16T18:30:26.768987] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:30:27.142815] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-16T18:30:27.766444] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:30:27.942809] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-16T18:30:28.264374] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:30:28.742780] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-16T18:30:28.930348] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:30:29.542823] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-16T18:30:29.731984] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:30:30.342814] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-16T18:30:30.625971] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T18:30:31.142810] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-16T18:30:31.252068] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T18:30:31.942894] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-16T18:30:32.023105] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:30:32.024578] [INFO ] [REMOTE ] DRLL: Full fetch complete (14707 records). [2025-10-16T18:30:32.024668] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-16T18:30:32.025180] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:32.025270] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:32.025328] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:32.025369] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-16T18:30:32.025494] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-16T18:30:32.025549] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-16T18:30:32.025709] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-16T18:30:32.025800] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DRLL took 27.6s. Estimated remaining: 3h 59m 16s. Rate: 7.2 symbols/min [2025-10-16T18:30:32.192579] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:32.196831] [DEBUG] [LOCAL ] DSMC: Loaded 1837 existing records from primary storage. [2025-10-16T18:30:32.196987] [INFO ] [MAIN ] DSMC: Loaded 1837 existing records. [2025-10-16T18:30:32.368951] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:32.369133] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-16T18:30:32.369183] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-16T18:30:32.369310] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-16T18:30:32.369348] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-16T18:30:32.746825] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-16T18:30:32.755929] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:32.824345] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:30:33.542792] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-16T18:30:33.777970] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:30:34.342888] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-16T18:30:34.900786] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:30:35.142805] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-16T18:30:35.189707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:30:35.942842] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-16T18:30:36.505733] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:30:36.510024] [INFO ] [REMOTE ] DSL: Full fetch complete (41450 records). [2025-10-16T18:30:36.510190] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-16T18:30:36.510888] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:36.511005] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:36.511082] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:36.511177] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-16T18:30:36.511256] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-16T18:30:36.511293] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-16T18:30:36.511409] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-16T18:30:36.511497] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DSL took 26.6s. Estimated remaining: 3h 58m 57s. Rate: 7.2 symbols/min [2025-10-16T18:30:36.696099] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:36.719806] [DEBUG] [LOCAL ] DSU: Loaded 23007 existing records from primary storage. [2025-10-16T18:30:36.720088] [INFO ] [MAIN ] DSU: Loaded 23007 existing records. [2025-10-16T18:30:36.753999] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-16T18:30:36.922960] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:36.923218] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-16T18:30:36.923280] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-16T18:30:36.923469] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-16T18:30:36.923538] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-16T18:30:37.312030] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:37.316587] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T18:30:37.542787] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-16T18:30:37.584945] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:30:38.343011] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-16T18:30:38.918427] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:30:39.144628] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-16T18:30:39.145545] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-16T18:30:39.942802] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-16T18:30:40.248751] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:30:40.375521] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:30:40.742805] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-16T18:30:41.510469] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:30:41.542825] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-16T18:30:42.342789] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-16T18:30:42.608124] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:30:43.142843] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-16T18:30:43.207538] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-16T18:30:43.942855] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-16T18:30:44.727707] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T18:30:44.729508] [INFO ] [REMOTE ] DSM: Full fetch complete (23904 records). [2025-10-16T18:30:44.729579] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-16T18:30:44.750110] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-16T18:30:45.149552] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-16T18:30:45.151597] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T18:30:45.150130] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-16T18:30:45.162958] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-16T18:30:45.163522] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-16T18:30:45.164869] [DEBUG] [LOCAL ] DSM: Trimmed 23904 records to 14194 (keeping 200 days of data) [2025-10-16T18:30:45.264839] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T18:30:45.270109] [DEBUG] [LOCAL ] DSM: Primary data saved (14194 records). [2025-10-16T18:30:45.270281] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-16T18:30:45.270373] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DSM took 34.2s. Estimated remaining: 3h 58m 50s. Rate: 7.2 symbols/min [2025-10-16T18:30:45.470135] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:45.495164] [DEBUG] [LOCAL ] DSX: Loaded 23924 existing records from primary storage. [2025-10-16T18:30:45.495467] [INFO ] [MAIN ] DSX: Loaded 23924 existing records. [2025-10-16T18:30:45.548021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-16T18:30:45.695246] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:30:45.695507] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-16T18:30:45.695558] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-16T18:30:45.695802] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-16T18:30:45.695861] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-16T18:30:46.046690] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:46.342888] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-16T18:30:47.142869] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-16T18:30:47.423588] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T18:30:47.534015] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:30:47.901399] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:30:47.942776] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-16T18:30:48.742780] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-16T18:30:49.063840] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T18:30:49.306710] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:30:49.542812] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-16T18:30:49.904423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T18:30:50.342858] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-16T18:30:51.142821] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-16T18:30:51.585181] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T18:30:51.600491] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T18:30:51.942863] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-16T18:30:52.742826] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-16T18:30:52.769313] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:30:52.775373] [INFO ] [REMOTE ] DRI: Full fetch complete (69172 records). [2025-10-16T18:30:52.775539] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-16T18:30:52.776529] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:30:52.776685] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:30:52.776952] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:30:52.777045] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-16T18:30:52.777130] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-16T18:30:52.777169] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-16T18:30:52.777332] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-16T18:30:52.778223] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DRI took 57.7s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-16T18:30:52.956469] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:30:52.956678] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-16T18:30:52.956733] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-16T18:30:52.956875] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-16T18:30:52.956949] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-16T18:30:52.957012] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-16T18:30:52.957048] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-16T18:30:53.215070] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T18:30:53.357295] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:30:53.542870] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-16T18:30:54.342883] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-16T18:30:55.149574] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-16T18:30:55.156398] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T18:30:55.459591] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:30:55.509124] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-16T18:30:55.942789] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-16T18:30:56.742827] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-16T18:30:57.099190] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:30:57.542834] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-16T18:30:57.789139] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T18:30:58.342801] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-16T18:30:58.561861] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T18:30:59.142782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-16T18:30:59.274893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:30:59.669518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:30:59.942818] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-16T18:31:00.742836] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-16T18:31:01.354637] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T18:31:01.548007] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-16T18:31:01.558815] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T18:31:02.050692] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T18:31:02.051489] [INFO ] [REMOTE ] DSMC: Full fetch complete (2849 records). [2025-10-16T18:31:02.051578] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-16T18:31:02.052016] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:31:02.052100] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:02.052144] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:02.052210] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-16T18:31:02.052272] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-16T18:31:02.052307] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-16T18:31:02.052556] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-16T18:31:02.052671] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 30.0s. Estimated remaining: 3h 58m 34s. Rate: 7.2 symbols/min [2025-10-16T18:31:02.222555] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:02.230220] [DEBUG] [LOCAL ] DTB: Loaded 5012 existing records from primary storage. [2025-10-16T18:31:02.230421] [INFO ] [MAIN ] DTB: Loaded 5012 existing records. [2025-10-16T18:31:02.347996] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-16T18:31:02.408633] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:02.408866] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-16T18:31:02.408916] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-16T18:31:02.409176] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-16T18:31:02.409232] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-16T18:31:02.763565] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:03.142807] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-16T18:31:03.730550] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:31:03.733998] [INFO ] [REMOTE ] DSU: Full fetch complete (33124 records). [2025-10-16T18:31:03.734142] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-16T18:31:03.948036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-16T18:31:04.121174] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-16T18:31:04.121261] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-16T18:31:04.121953] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-16T18:31:04.122031] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-16T18:31:04.123015] [DEBUG] [LOCAL ] DSU: Trimmed 33124 records to 23202 (keeping 200 days of data) [2025-10-16T18:31:04.265941] [DEBUG] [LOCAL ] DSU: Primary data saved (23202 records). [2025-10-16T18:31:04.266073] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-16T18:31:04.266153] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSU took 27.8s. Estimated remaining: 3h 58m 9s. Rate: 7.2 symbols/min [2025-10-16T18:31:04.441373] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:04.441721] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-16T18:31:04.447552] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-16T18:31:04.458197] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T18:31:04.458487] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-16T18:31:04.470231] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-16T18:31:04.471066] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-16T18:31:04.470832] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-16T18:31:04.471270] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-16T18:31:04.748231] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-16T18:31:04.839099] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:05.542869] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-16T18:31:05.570492] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T18:31:06.342822] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-16T18:31:07.142809] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-16T18:31:07.205877] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:31:07.803709] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:31:07.818562] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:31:07.942818] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-16T18:31:08.742885] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-16T18:31:09.542791] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-16T18:31:09.598467] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:31:10.342823] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-16T18:31:10.372212] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:31:10.817229] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:31:10.871753] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-16T18:31:11.142838] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-16T18:31:11.942854] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-16T18:31:12.499692] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:31:12.742819] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-16T18:31:12.995864] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:31:13.320129] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T18:31:13.542840] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-16T18:31:14.342840] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-16T18:31:15.142818] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-16T18:31:15.218280] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:31:15.942802] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-16T18:31:16.053586] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:31:16.108394] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:31:16.742820] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-16T18:31:17.320768] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T18:31:17.542816] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-16T18:31:17.655571] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:31:18.035469] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:31:18.342826] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-16T18:31:18.951074] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:31:19.142817] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-16T18:31:19.646132] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T18:31:19.942825] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-16T18:31:20.418467] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T18:31:20.742842] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-16T18:31:21.383793] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:31:21.385474] [INFO ] [REMOTE ] DTB: Full fetch complete (6651 records). [2025-10-16T18:31:21.385581] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-16T18:31:21.547767] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-16T18:31:21.750360] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-16T18:31:21.750435] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-16T18:31:21.750625] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-16T18:31:21.750700] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-16T18:31:21.751128] [DEBUG] [LOCAL ] DTB: Trimmed 6651 records to 5017 (keeping 200 days of data) [2025-10-16T18:31:21.785380] [DEBUG] [LOCAL ] DTB: Primary data saved (5017 records). [2025-10-16T18:31:21.785542] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-16T18:31:21.785669] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DTB took 19.7s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:21.955570] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:21.955791] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-16T18:31:21.955834] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-16T18:31:21.955945] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-16T18:31:21.955985] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-16T18:31:21.956025] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-16T18:31:21.956057] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-16T18:31:22.314843] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:22.342773] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-16T18:31:22.931834] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T18:31:23.137397] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:31:23.147465] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-16T18:31:23.942820] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-16T18:31:24.549926] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:31:24.748012] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-16T18:31:24.769943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T18:31:25.542812] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-16T18:31:26.342810] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-16T18:31:26.650998] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T18:31:26.871293] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:31:27.142839] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-16T18:31:27.621035] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T18:31:27.942861] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-16T18:31:28.742780] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-16T18:31:29.024962] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-16T18:31:29.082023] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:31:29.555511] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-16T18:31:29.586272] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:31:29.990439] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:31:30.342883] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-16T18:31:31.142837] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-16T18:31:31.194841] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T18:31:31.573241] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:31:31.942855] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-16T18:31:32.742811] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-16T18:31:32.876713] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:31:32.880928] [INFO ] [REMOTE ] DSX: Full fetch complete (35841 records). [2025-10-16T18:31:32.881043] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-16T18:31:33.264034] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-16T18:31:33.264138] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-16T18:31:33.264847] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-16T18:31:33.264911] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-16T18:31:33.265942] [DEBUG] [LOCAL ] DSX: Trimmed 35841 records to 24160 (keeping 200 days of data) [2025-10-16T18:31:33.411256] [DEBUG] [LOCAL ] DSX: Primary data saved (24160 records). [2025-10-16T18:31:33.411396] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-16T18:31:33.411478] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSX took 48.1s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:33.551123] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-16T18:31:33.585689] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:33.594938] [DEBUG] [LOCAL ] DTG: Loaded 5805 existing records from primary storage. [2025-10-16T18:31:33.595188] [INFO ] [MAIN ] DTG: Loaded 5805 existing records. [2025-10-16T18:31:33.771222] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:33.771417] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-16T18:31:33.771464] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-16T18:31:33.771627] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-16T18:31:33.771712] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-16T18:31:34.130956] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:34.345014] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-16T18:31:34.345200] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T18:31:34.581727] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T18:31:35.142840] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-16T18:31:35.490971] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-16T18:31:35.702407] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T18:31:35.942846] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-16T18:31:36.721104] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-16T18:31:36.742797] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-16T18:31:37.416370] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:31:37.542795] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-16T18:31:37.874930] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:31:38.342810] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-16T18:31:39.142840] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-16T18:31:39.434526] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-16T18:31:39.942796] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-16T18:31:40.054395] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:31:40.212960] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-16T18:31:40.742882] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-16T18:31:41.284115] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T18:31:41.542878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-16T18:31:41.981458] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T18:31:41.982225] [INFO ] [REMOTE ] DTF: Full fetch complete (1779 records). [2025-10-16T18:31:41.982293] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-16T18:31:42.175276] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-16T18:31:42.175479] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:42.175549] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:42.175624] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-16T18:31:42.175728] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-16T18:31:42.175775] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-16T18:31:42.175821] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-16T18:31:42.175878] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DTF took 20.4s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-16T18:31:42.348151] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-16T18:31:42.351132] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:42.351995] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-16T18:31:42.352039] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-16T18:31:42.352149] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-16T18:31:42.352191] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-16T18:31:42.352234] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-16T18:31:42.352266] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-16T18:31:42.728743] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:43.142832] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-16T18:31:43.332284] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:31:43.332638] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-16T18:31:43.332760] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:31:43.332809] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-16T18:31:43.332845] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:31:43.332913] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-16T18:31:43.332977] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-16T18:31:43.333015] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-16T18:31:43.333058] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-16T18:31:43.333121] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTK took 1.2s. Estimated remaining: 3h 57m 51s. Rate: 7.2 symbols/min [2025-10-16T18:31:43.536087] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:43.585280] [DEBUG] [LOCAL ] DTM: Loaded 43930 existing records from primary storage. [2025-10-16T18:31:43.585587] [INFO ] [MAIN ] DTM: Loaded 43930 existing records. [2025-10-16T18:31:43.796186] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:43.796419] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-16T18:31:43.796467] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-16T18:31:43.796682] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-16T18:31:43.796739] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-16T18:31:43.947973] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-16T18:31:44.199373] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:44.228613] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:31:44.742818] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-16T18:31:45.542839] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-16T18:31:45.953751] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T18:31:45.960711] [INFO ] [REMOTE ] DT: Full fetch complete (76867 records). [2025-10-16T18:31:45.960864] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-16T18:31:46.354169] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-16T18:31:46.358839] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-16T18:31:46.360398] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-16T18:31:46.361717] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-16T18:31:46.362039] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-16T18:31:46.363893] [DEBUG] [LOCAL ] DT: Trimmed 76867 records to 53331 (keeping 200 days of data) [2025-10-16T18:31:46.492187] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:31:46.719730] [DEBUG] [LOCAL ] DT: Primary data saved (53331 records). [2025-10-16T18:31:46.719889] [INFO ] [MAIN ] DT: Full history saved. [2025-10-16T18:31:46.720020] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DT took 53.9s. Estimated remaining: 3h 57m 30s. Rate: 7.2 symbols/min [2025-10-16T18:31:46.900382] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:46.935063] [DEBUG] [LOCAL ] DTW: Loaded 4821 existing records from primary storage. [2025-10-16T18:31:46.932223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T18:31:46.935381] [INFO ] [MAIN ] DTW: Loaded 4821 existing records. [2025-10-16T18:31:47.118993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T18:31:47.148043] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-16T18:31:47.156046] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:47.158042] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-16T18:31:47.158098] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-16T18:31:47.158263] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-16T18:31:47.158322] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-16T18:31:47.517536] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:47.942819] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-16T18:31:48.506892] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T18:31:48.742798] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-16T18:31:48.837219] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:31:49.223610] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T18:31:49.542829] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-16T18:31:50.342813] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-16T18:31:50.801428] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T18:31:51.065250] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:31:51.142814] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-16T18:31:51.942821] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-16T18:31:52.742785] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-16T18:31:52.777561] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:31:52.841458] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:31:53.320442] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T18:31:53.542827] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-16T18:31:54.225002] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T18:31:54.342851] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-16T18:31:55.142827] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-16T18:31:55.863149] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:31:55.869580] [INFO ] [REMOTE ] DTE: Full fetch complete (69004 records). [2025-10-16T18:31:55.869790] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-16T18:31:55.947910] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-16T18:31:56.267425] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T18:31:56.330080] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-16T18:31:56.330578] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-16T18:31:56.331528] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-16T18:31:56.331601] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-16T18:31:56.333007] [DEBUG] [LOCAL ] DTE: Trimmed 69004 records to 47720 (keeping 200 days of data) [2025-10-16T18:31:56.617537] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:31:56.644448] [DEBUG] [LOCAL ] DTE: Primary data saved (47720 records). [2025-10-16T18:31:56.644596] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-16T18:31:56.644693] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTE took 52.4s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-16T18:31:56.751395] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-16T18:31:56.832195] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:56.884711] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-16T18:31:56.885057] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-16T18:31:57.067133] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:31:57.067412] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-16T18:31:57.067472] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-16T18:31:57.067847] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-16T18:31:57.067903] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-16T18:31:57.427722] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:57.429061] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T18:31:57.542822] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-16T18:31:58.342818] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-16T18:31:59.142783] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-16T18:31:59.192726] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:31:59.194126] [INFO ] [REMOTE ] DTG: Full fetch complete (8669 records). [2025-10-16T18:31:59.194197] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-16T18:31:59.194555] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:31:59.194637] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:31:59.194718] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:31:59.194759] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-16T18:31:59.194812] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-16T18:31:59.194847] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-16T18:31:59.194960] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-16T18:31:59.195023] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 25.8s. Estimated remaining: 3h 57m 2s. Rate: 7.2 symbols/min [2025-10-16T18:31:59.376722] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:31:59.377092] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-16T18:31:59.377280] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-16T18:31:59.377442] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-16T18:31:59.377490] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-16T18:31:59.377586] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-16T18:31:59.377700] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-16T18:31:59.699373] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T18:31:59.794241] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:31:59.942829] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-16T18:32:00.671975] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T18:32:00.742825] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-16T18:32:00.923234] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:32:01.542891] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-16T18:32:01.580278] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:32:02.342859] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-16T18:32:02.991491] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T18:32:03.115197] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:32:03.142788] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-16T18:32:03.942885] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-16T18:32:04.419494] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T18:32:04.744677] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-16T18:32:04.747360] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:32:05.402084] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-16T18:32:05.542838] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-16T18:32:06.342823] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-16T18:32:06.903948] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:32:07.142844] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-16T18:32:07.364127] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T18:32:07.748176] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:32:07.942836] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-16T18:32:08.538091] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:32:08.742822] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-16T18:32:09.542802] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-16T18:32:10.142722] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-16T18:32:10.333256] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:32:10.342792] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-16T18:32:10.992573] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-16T18:32:11.142857] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-16T18:32:11.942837] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-16T18:32:12.033754] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T18:32:12.742801] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-16T18:32:13.318909] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:32:13.542827] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-16T18:32:13.826746] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:32:14.342814] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-16T18:32:14.837766] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:32:15.142811] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-16T18:32:15.702842] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:32:15.942852] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-16T18:32:16.296397] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:32:16.742844] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-16T18:32:17.297357] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:32:17.528064] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:32:17.542767] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-16T18:32:18.231042] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T18:32:18.342830] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-16T18:32:19.142835] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-16T18:32:19.615503] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T18:32:19.942884] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-16T18:32:20.140483] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:32:20.146542] [INFO ] [REMOTE ] DTM: Full fetch complete (65047 records). [2025-10-16T18:32:20.146727] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-16T18:32:20.560208] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-16T18:32:20.560279] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-16T18:32:20.561235] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-16T18:32:20.561299] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-16T18:32:20.562495] [DEBUG] [LOCAL ] DTM: Trimmed 65047 records to 44243 (keeping 200 days of data) [2025-10-16T18:32:20.749905] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-16T18:32:20.841220] [DEBUG] [LOCAL ] DTM: Primary data saved (44243 records). [2025-10-16T18:32:20.841347] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-16T18:32:20.841423] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 37.5s. Estimated remaining: 3h 57m 28s. Rate: 7.2 symbols/min [2025-10-16T18:32:21.008583] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:21.059275] [DEBUG] [LOCAL ] DV: Loaded 51301 existing records from primary storage. [2025-10-16T18:32:21.059613] [INFO ] [MAIN ] DV: Loaded 51301 existing records. [2025-10-16T18:32:21.237978] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:21.238262] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-16T18:32:21.238311] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-16T18:32:21.238835] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-16T18:32:21.238893] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-16T18:32:21.365495] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:32:21.546556] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-16T18:32:21.612039] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:21.748558] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T18:32:22.109136] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T18:32:22.342833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-16T18:32:22.874405] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:32:22.875865] [INFO ] [REMOTE ] DTW: Full fetch complete (7199 records). [2025-10-16T18:32:22.875957] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-16T18:32:23.148183] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-16T18:32:23.281487] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-16T18:32:23.281571] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-16T18:32:23.281833] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-16T18:32:23.281896] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-16T18:32:23.282336] [DEBUG] [LOCAL ] DTW: Trimmed 7199 records to 4840 (keeping 200 days of data) [2025-10-16T18:32:23.315246] [DEBUG] [LOCAL ] DTW: Primary data saved (4840 records). [2025-10-16T18:32:23.315396] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-16T18:32:23.315484] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DTW took 36.6s. Estimated remaining: 3h 57m 5s. Rate: 7.2 symbols/min [2025-10-16T18:32:23.509924] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:23.551976] [DEBUG] [LOCAL ] DVA: Loaded 41059 existing records from primary storage. [2025-10-16T18:32:23.552268] [INFO ] [MAIN ] DVA: Loaded 41059 existing records. [2025-10-16T18:32:23.728926] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:23.729206] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-16T18:32:23.729255] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-16T18:32:23.729427] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-16T18:32:23.729465] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-16T18:32:23.861550] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T18:32:23.895526] [INFO ] [REMOTE ] DUKB: Full fetch complete (9292 records). [2025-10-16T18:32:23.948103] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-16T18:32:23.920738] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-16T18:32:24.263726] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:24.528242] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-16T18:32:24.528324] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-16T18:32:24.528628] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-16T18:32:24.528804] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-16T18:32:24.529300] [DEBUG] [LOCAL ] DUKB: Trimmed 9292 records to 6305 (keeping 200 days of data) [2025-10-16T18:32:24.570287] [DEBUG] [LOCAL ] DUKB: Primary data saved (6305 records). [2025-10-16T18:32:24.570422] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-16T18:32:24.570495] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUKB took 25.4s. Estimated remaining: 3h 56m 38s. Rate: 7.2 symbols/min [2025-10-16T18:32:24.741526] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:24.741696] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-16T18:32:24.741782] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-16T18:32:24.741894] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-16T18:32:24.741936] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-16T18:32:24.742020] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-16T18:32:24.742059] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-16T18:32:24.753022] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-16T18:32:25.096494] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:25.542835] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-16T18:32:25.706835] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:32:26.134867] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:32:26.342832] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-16T18:32:27.142835] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-16T18:32:27.349109] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:32:27.614068] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T18:32:27.942861] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-16T18:32:28.593985] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:32:28.742874] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-16T18:32:29.542829] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-16T18:32:29.693122] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:32:29.965283] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:32:30.342870] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-16T18:32:31.142898] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-16T18:32:31.368382] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-16T18:32:31.942788] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-16T18:32:32.057584] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T18:32:32.742882] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-16T18:32:32.906618] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T18:32:33.455006] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T18:32:33.542888] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-16T18:32:34.342881] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-16T18:32:34.549190] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:32:35.142833] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-16T18:32:35.315434] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:32:35.470876] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:32:35.942860] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-16T18:32:36.742807] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-16T18:32:36.901004] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:32:37.542911] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-16T18:32:37.590523] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:32:38.342824] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-16T18:32:38.692360] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-16T18:32:39.142829] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-16T18:32:39.315466] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:32:39.544166] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T18:32:39.942835] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-16T18:32:40.378871] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-16T18:32:40.385714] [INFO ] [REMOTE ] DUK: Full fetch complete (77566 records). [2025-10-16T18:32:40.385840] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-16T18:32:40.747981] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-16T18:32:40.768395] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-16T18:32:40.768548] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-16T18:32:40.769628] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-16T18:32:40.769916] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-16T18:32:40.771825] [DEBUG] [LOCAL ] DUK: Trimmed 77566 records to 53827 (keeping 200 days of data) [2025-10-16T18:32:40.911375] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:32:41.156624] [DEBUG] [LOCAL ] DUK: Primary data saved (53827 records). [2025-10-16T18:32:41.156794] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-16T18:32:41.157373] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DUK took 44.5s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-16T18:32:41.326441] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:41.383251] [DEBUG] [LOCAL ] DX: Loaded 52502 existing records from primary storage. [2025-10-16T18:32:41.383607] [INFO ] [MAIN ] DX: Loaded 52502 existing records. [2025-10-16T18:32:41.552937] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-16T18:32:41.558894] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:41.559996] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-16T18:32:41.560048] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-16T18:32:41.560248] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-16T18:32:41.560304] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-16T18:32:41.913164] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:42.272459] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:32:42.342791] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-16T18:32:43.142866] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-16T18:32:43.294860] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:32:43.534299] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T18:32:43.942817] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-16T18:32:44.742783] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-16T18:32:44.819943] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:32:45.542852] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-16T18:32:46.342884] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-16T18:32:46.470152] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T18:32:46.885202] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.94 seconds). [2025-10-16T18:32:47.142840] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-16T18:32:47.808460] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-16T18:32:47.942821] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-16T18:32:48.742805] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-16T18:32:49.151115] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:32:49.542905] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-16T18:32:50.129254] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (3.79 seconds). [2025-10-16T18:32:50.181402] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-16T18:32:50.342817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-16T18:32:50.810913] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-16T18:32:50.903559] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:32:51.142821] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-16T18:32:51.942837] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-16T18:32:52.073501] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:32:52.742892] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-16T18:32:53.249880] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T18:32:53.542867] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-16T18:32:53.955451] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T18:32:54.342828] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-16T18:32:55.142802] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-16T18:32:55.396072] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T18:32:55.403109] [INFO ] [REMOTE ] DV: Full fetch complete (73872 records). [2025-10-16T18:32:55.403252] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-16T18:32:55.814339] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-16T18:32:55.814439] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-16T18:32:55.815967] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-16T18:32:55.816057] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-16T18:32:55.817497] [DEBUG] [LOCAL ] DV: Trimmed 73872 records to 51681 (keeping 200 days of data) [2025-10-16T18:32:56.129808] [DEBUG] [LOCAL ] DV: Primary data saved (51681 records). [2025-10-16T18:32:56.129940] [INFO ] [MAIN ] DV: Full history saved. [2025-10-16T18:32:56.130018] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 35.3s. Estimated remaining: 3h 56m 59s. Rate: 7.2 symbols/min [2025-10-16T18:32:56.307181] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:56.343406] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T18:32:56.355891] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-16T18:32:56.396078] [DEBUG] [LOCAL ] DXC: Loaded 49875 existing records from primary storage. [2025-10-16T18:32:56.396582] [INFO ] [MAIN ] DXC: Loaded 49875 existing records. [2025-10-16T18:32:56.579168] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:32:56.602307] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:56.606324] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-16T18:32:56.606468] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-16T18:32:56.606557] [INFO ] [REMOTE ] DVA: Full fetch complete (59807 records). [2025-10-16T18:32:56.606959] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-16T18:32:56.607233] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-16T18:32:56.607458] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-16T18:32:57.422214] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-16T18:32:57.425542] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:57.427817] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-16T18:32:57.427380] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (4.68 seconds). [2025-10-16T18:32:57.427878] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-16T18:32:57.429748] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-16T18:32:57.440523] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-16T18:32:57.442141] [DEBUG] [LOCAL ] DVA: Trimmed 59807 records to 41337 (keeping 200 days of data) [2025-10-16T18:32:57.544472] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-16T18:32:57.723876] [DEBUG] [LOCAL ] DVA: Primary data saved (41337 records). [2025-10-16T18:32:57.724030] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-16T18:32:57.724684] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVA took 34.4s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-16T18:32:57.947071] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:32:57.995157] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-16T18:32:57.995441] [INFO ] [MAIN ] DXYZ: Loaded 37126 existing records. [2025-10-16T18:32:58.179336] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:32:58.179609] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-16T18:32:58.179690] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-16T18:32:58.179912] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-16T18:32:58.179967] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-16T18:32:58.544696] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:32:58.562029] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-16T18:32:58.578239] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-16T18:32:58.611846] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:32:58.992580] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:32:59.142835] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-16T18:32:59.942847] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-16T18:33:00.742785] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-16T18:33:00.950855] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T18:33:01.016135] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-16T18:33:01.515792] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T18:33:01.542784] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-16T18:33:02.226901] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T18:33:02.342802] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-16T18:33:03.083754] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:33:03.149503] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-16T18:33:03.153743] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T18:33:03.161058] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-16T18:33:03.161187] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-16T18:33:03.544614] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-16T18:33:03.544725] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-16T18:33:03.545741] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-16T18:33:03.545805] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-16T18:33:03.547365] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 54089 (keeping 200 days of data) [2025-10-16T18:33:03.870669] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-16T18:33:03.870807] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-16T18:33:03.870882] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DVN took 39.3s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-16T18:33:03.947895] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-16T18:33:04.039755] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:04.068623] [DEBUG] [LOCAL ] DY: Loaded 28456 existing records from primary storage. [2025-10-16T18:33:04.068952] [INFO ] [MAIN ] DY: Loaded 28456 existing records. [2025-10-16T18:33:04.244169] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:04.244427] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-16T18:33:04.244487] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-16T18:33:04.244782] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-16T18:33:04.244840] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-16T18:33:04.584816] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:04.742891] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-16T18:33:05.467374] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-16T18:33:05.542795] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-16T18:33:06.007858] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T18:33:06.340624] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T18:33:06.354435] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-16T18:33:07.142786] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-16T18:33:07.251486] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T18:33:07.884863] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:33:07.942789] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-16T18:33:08.742815] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-16T18:33:08.809529] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T18:33:09.042904] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:33:09.542815] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-16T18:33:10.342782] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-16T18:33:10.529182] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:33:11.142791] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-16T18:33:11.304048] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:33:11.942781] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-16T18:33:12.267275] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:33:12.743592] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-16T18:33:12.746006] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:33:12.856037] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:33:13.542827] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-16T18:33:14.342810] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-16T18:33:14.726688] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T18:33:15.044885] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:33:15.142801] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-16T18:33:15.942879] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-16T18:33:15.980919] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:33:16.616814] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T18:33:16.742788] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-16T18:33:17.542830] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-16T18:33:17.763992] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:33:17.829140] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T18:33:17.835362] [INFO ] [REMOTE ] DX: Full fetch complete (75428 records). [2025-10-16T18:33:17.835486] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-16T18:33:17.836323] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:33:17.836413] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:33:17.836456] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:33:17.836494] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-16T18:33:17.836548] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-16T18:33:17.836597] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-16T18:33:17.836795] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-16T18:33:17.837324] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DX took 36.7s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-16T18:33:18.009215] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:18.043215] [DEBUG] [LOCAL ] E: Loaded 33280 existing records from primary storage. [2025-10-16T18:33:18.043489] [INFO ] [MAIN ] E: Loaded 33280 existing records. [2025-10-16T18:33:18.215831] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:18.216060] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-16T18:33:18.216107] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-16T18:33:18.216309] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-16T18:33:18.216377] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-16T18:33:18.353341] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-16T18:33:18.569737] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:19.089383] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T18:33:19.142776] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-16T18:33:19.226501] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:33:19.942818] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-16T18:33:20.337426] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T18:33:20.742835] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-16T18:33:21.355966] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T18:33:21.542834] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-16T18:33:21.875441] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T18:33:22.342858] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-16T18:33:23.144336] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-16T18:33:23.157283] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T18:33:23.464109] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T18:33:23.942818] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-16T18:33:24.742784] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-16T18:33:24.919533] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T18:33:25.374280] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:33:25.543131] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-16T18:33:25.546573] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:33:26.342832] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-16T18:33:27.142819] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-16T18:33:27.416540] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T18:33:27.942813] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-16T18:33:28.076477] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:33:28.355493] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T18:33:28.742817] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-16T18:33:29.542820] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-16T18:33:29.713433] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T18:33:29.720130] [INFO ] [REMOTE ] DXC: Full fetch complete (70064 records). [2025-10-16T18:33:29.720303] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-16T18:33:30.137398] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-16T18:33:30.137568] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-16T18:33:30.138521] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-16T18:33:30.138597] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-16T18:33:30.168385] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:33:30.178286] [DEBUG] [LOCAL ] DXC: Trimmed 70064 records to 50260 (keeping 200 days of data) [2025-10-16T18:33:30.345706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-16T18:33:30.476184] [DEBUG] [LOCAL ] DXC: Primary data saved (50260 records). [2025-10-16T18:33:30.476331] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-16T18:33:30.476411] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXC took 34.3s. Estimated remaining: 3h 56m 28s. Rate: 7.2 symbols/min [2025-10-16T18:33:30.644774] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:30.663781] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T18:33:30.705390] [DEBUG] [LOCAL ] EAF: Loaded 41701 existing records from primary storage. [2025-10-16T18:33:30.705718] [INFO ] [MAIN ] EAF: Loaded 41701 existing records. [2025-10-16T18:33:30.876136] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:30.876405] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-16T18:33:30.876459] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-16T18:33:30.876700] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-16T18:33:30.876758] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-16T18:33:31.149257] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-16T18:33:31.255998] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:31.942848] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-16T18:33:32.177115] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:33:32.611534] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:33:32.742802] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-16T18:33:33.240151] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T18:33:33.542812] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-16T18:33:33.983491] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:33:34.342881] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-16T18:33:35.004541] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:33:35.142808] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-16T18:33:35.942817] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-16T18:33:36.007263] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:33:36.626416] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:33:36.742818] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-16T18:33:36.940849] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T18:33:36.944432] [INFO ] [REMOTE ] DY: Full fetch complete (43507 records). [2025-10-16T18:33:36.944598] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-16T18:33:37.343902] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-16T18:33:37.343979] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-16T18:33:37.344728] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-16T18:33:37.344790] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-16T18:33:37.345683] [DEBUG] [LOCAL ] DY: Trimmed 43507 records to 28641 (keeping 200 days of data) [2025-10-16T18:33:37.522635] [DEBUG] [LOCAL ] DY: Primary data saved (28641 records). [2025-10-16T18:33:37.522820] [INFO ] [MAIN ] DY: Full history saved. [2025-10-16T18:33:37.522906] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DY took 33.7s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-16T18:33:37.554442] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-16T18:33:37.693877] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:37.694070] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-16T18:33:37.694111] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-16T18:33:37.694232] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-16T18:33:37.694312] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-16T18:33:37.694364] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-16T18:33:37.694398] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-16T18:33:38.055297] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:38.342836] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-16T18:33:38.703774] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:33:38.710239] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57244 records). [2025-10-16T18:33:38.710423] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-16T18:33:39.104741] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-16T18:33:39.104836] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-16T18:33:39.105897] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-16T18:33:39.123935] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-16T18:33:39.126024] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:33:39.134016] [DEBUG] [LOCAL ] DXYZ: Trimmed 57244 records to 37483 (keeping 200 days of data) [2025-10-16T18:33:39.187412] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-16T18:33:39.360348] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37483 records). [2025-10-16T18:33:39.360524] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-16T18:33:39.360631] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DXYZ took 41.6s. Estimated remaining: 3h 55m 52s. Rate: 7.2 symbols/min [2025-10-16T18:33:39.536072] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:39.565172] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:33:39.596476] [DEBUG] [LOCAL ] EARN: Loaded 28609 existing records from primary storage. [2025-10-16T18:33:39.596784] [INFO ] [MAIN ] EARN: Loaded 28609 existing records. [2025-10-16T18:33:39.767930] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:39.768173] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-16T18:33:39.768221] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-16T18:33:39.768411] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-16T18:33:39.768467] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-16T18:33:39.952607] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-16T18:33:40.121614] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:40.540344] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T18:33:40.742837] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-16T18:33:41.315061] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T18:33:41.542812] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-16T18:33:42.221735] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:33:42.342792] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-16T18:33:43.142805] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-16T18:33:43.287092] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:33:43.695296] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:33:43.942869] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-16T18:33:44.625539] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:33:44.742833] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-16T18:33:45.354819] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:33:45.542865] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-16T18:33:46.162731] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:33:46.342792] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-16T18:33:47.142790] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-16T18:33:47.188064] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:33:47.192283] [INFO ] [REMOTE ] E: Full fetch complete (47860 records). [2025-10-16T18:33:47.192407] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-16T18:33:47.564402] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-16T18:33:47.564495] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-16T18:33:47.565243] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-16T18:33:47.565307] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-16T18:33:47.566398] [DEBUG] [LOCAL ] E: Trimmed 47860 records to 33514 (keeping 200 days of data) [2025-10-16T18:33:47.778144] [DEBUG] [LOCAL ] E: Primary data saved (33514 records). [2025-10-16T18:33:47.778312] [INFO ] [MAIN ] E: Full history saved. [2025-10-16T18:33:47.778446] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. E took 29.9s. Estimated remaining: 3h 55m 44s. Rate: 7.2 symbols/min [2025-10-16T18:33:47.955709] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-16T18:33:47.958619] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:47.959717] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-16T18:33:47.959774] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-16T18:33:47.959927] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-16T18:33:47.959984] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-16T18:33:47.960029] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-16T18:33:47.960063] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-16T18:33:48.240060] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:33:48.330031] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-16T18:33:48.392275] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:48.742874] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-16T18:33:49.409738] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:33:49.542779] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-16T18:33:50.342918] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-16T18:33:50.772080] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-16T18:33:50.846346] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:33:51.142852] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-16T18:33:51.942856] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-16T18:33:52.055823] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:33:52.249054] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:33:52.370131] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T18:33:52.742792] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-16T18:33:53.542779] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-16T18:33:53.855967] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:33:54.342855] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-16T18:33:54.957847] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T18:33:55.142846] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-16T18:33:55.284225] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T18:33:55.505358] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T18:33:55.942842] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-16T18:33:56.506096] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T18:33:56.742824] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-16T18:33:57.542820] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-16T18:33:58.230845] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T18:33:58.235350] [INFO ] [REMOTE ] EAF: Full fetch complete (62663 records). [2025-10-16T18:33:58.235506] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-16T18:33:58.347987] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-16T18:33:58.637151] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-16T18:33:58.637256] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-16T18:33:58.638126] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-16T18:33:58.638187] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-16T18:33:58.639459] [DEBUG] [LOCAL ] EAF: Trimmed 62663 records to 41935 (keeping 200 days of data) [2025-10-16T18:33:58.872132] [DEBUG] [LOCAL ] EAF: Primary data saved (41935 records). [2025-10-16T18:33:58.872427] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-16T18:33:58.872520] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAF took 28.4s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-16T18:33:59.040174] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:33:59.073160] [DEBUG] [LOCAL ] EB: Loaded 36538 existing records from primary storage. [2025-10-16T18:33:59.073487] [INFO ] [MAIN ] EB: Loaded 36538 existing records. [2025-10-16T18:33:59.153451] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-16T18:33:59.258904] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:33:59.259435] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-16T18:33:59.259547] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-16T18:33:59.259974] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-16T18:33:59.260108] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-16T18:33:59.596064] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-16T18:33:59.693940] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T18:33:59.693590] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:33:59.698034] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:33:59.942878] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-16T18:34:00.742819] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-16T18:34:01.235094] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:34:01.341192] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:34:01.542809] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-16T18:34:02.342815] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-16T18:34:02.935015] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:34:03.018136] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:34:03.142822] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-16T18:34:03.942835] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-16T18:34:04.742856] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-16T18:34:04.785427] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:34:04.814851] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:34:05.542813] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-16T18:34:06.119453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:34:06.342801] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-16T18:34:06.625801] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:34:07.142815] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-16T18:34:07.897809] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:34:07.942803] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-16T18:34:08.724021] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T18:34:08.742776] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-16T18:34:08.937024] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:34:09.542842] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-16T18:34:10.008363] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:34:10.012481] [INFO ] [REMOTE ] EARN: Full fetch complete (45523 records). [2025-10-16T18:34:10.012609] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-16T18:34:10.273087] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T18:34:10.345222] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-16T18:34:10.434263] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-16T18:34:10.434360] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-16T18:34:10.435066] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-16T18:34:10.435130] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-16T18:34:10.436201] [DEBUG] [LOCAL ] EARN: Trimmed 45523 records to 28794 (keeping 200 days of data) [2025-10-16T18:34:10.608044] [DEBUG] [LOCAL ] EARN: Primary data saved (28794 records). [2025-10-16T18:34:10.608343] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-16T18:34:10.608448] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 31.2s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-16T18:34:10.776016] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:10.776273] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-16T18:34:10.776319] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-16T18:34:10.776398] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-16T18:34:10.776435] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-16T18:34:10.776475] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-16T18:34:10.776508] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-16T18:34:11.124456] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:11.142780] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-16T18:34:11.898400] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T18:34:11.899565] [INFO ] [REMOTE ] EAI: Full fetch complete (6020 records). [2025-10-16T18:34:11.899636] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-16T18:34:11.955017] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-16T18:34:12.275752] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-16T18:34:12.275847] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-16T18:34:12.276025] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-16T18:34:12.276064] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-16T18:34:12.276431] [DEBUG] [LOCAL ] EAI: Trimmed 6020 records to 3998 (keeping 200 days of data) [2025-10-16T18:34:12.332639] [DEBUG] [LOCAL ] EAI: Primary data saved (3998 records). [2025-10-16T18:34:12.332791] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-16T18:34:12.332990] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAI took 34.8s. Estimated remaining: 3h 55m 17s. Rate: 7.2 symbols/min [2025-10-16T18:34:12.335331] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T18:34:12.742924] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-16T18:34:13.547248] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-16T18:34:13.550685] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T18:34:14.195179] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:34:14.342817] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-16T18:34:14.917850] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:34:15.142860] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-16T18:34:15.948121] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-16T18:34:15.969100] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:34:16.126316] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:34:16.742876] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-16T18:34:17.484500] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T18:34:17.542967] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-16T18:34:17.886698] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T18:34:18.342909] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-16T18:34:18.689044] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:34:19.142887] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-16T18:34:19.575483] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:34:19.942873] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-16T18:34:20.742787] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-16T18:34:20.930151] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:34:21.289255] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:34:21.543526] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-16T18:34:21.545766] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T18:34:22.342822] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-16T18:34:22.961923] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:34:23.142817] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-16T18:34:23.757967] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:34:23.942849] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-16T18:34:24.200163] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T18:34:24.742880] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-16T18:34:25.465446] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T18:34:25.471853] [INFO ] [REMOTE ] EAT: Full fetch complete (72382 records). [2025-10-16T18:34:25.471984] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-16T18:34:25.547978] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-16T18:34:25.853290] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-16T18:34:25.853382] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-16T18:34:25.854313] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-16T18:34:25.854379] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-16T18:34:25.855797] [DEBUG] [LOCAL ] EAT: Trimmed 72382 records to 50215 (keeping 200 days of data) [2025-10-16T18:34:26.180728] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T18:34:26.205904] [DEBUG] [LOCAL ] EAT: Primary data saved (50215 records). [2025-10-16T18:34:26.206010] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-16T18:34:26.206072] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EAT took 38.4s. Estimated remaining: 3h 55m 23s. Rate: 7.2 symbols/min [2025-10-16T18:34:26.342779] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-16T18:34:26.643569] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:34:27.142835] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-16T18:34:27.931364] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:34:27.935482] [INFO ] [REMOTE ] EB: Full fetch complete (55075 records). [2025-10-16T18:34:27.935571] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-16T18:34:27.936332] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:34:27.936417] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:34:27.936461] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:34:27.936500] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-16T18:34:27.936556] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-16T18:34:27.936593] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-16T18:34:27.936784] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-16T18:34:27.936877] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EB took 29.1s. Estimated remaining: 3h 54m 58s. Rate: 7.2 symbols/min [2025-10-16T18:34:28.199572] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T18:34:28.204133] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-16T18:34:29.368485] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:34:29.373559] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-16T18:34:30.403764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:34:30.408064] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-16T18:34:31.473499] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T18:34:31.477519] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-16T18:34:32.515155] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T18:34:32.518053] [INFO ] [REMOTE ] EBF: Full fetch complete (27716 records). [2025-10-16T18:34:32.518123] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-16T18:34:32.518606] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:34:32.518753] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:34:32.518883] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:34:32.518973] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-16T18:34:32.519038] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-16T18:34:32.519072] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-16T18:34:32.519110] [DEBUG] [LOCAL ] EBF: No derivative data file found to delete. [2025-10-16T18:34:32.519161] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBF took 21.9s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-16T18:34:33.045799] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.186916] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.212378] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.233854] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:33.269846] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-16T18:34:33.279381] [INFO ] [MAIN ] ECAT: Loaded 29496 existing records. [2025-10-16T18:34:33.387490] [DEBUG] [LOCAL ] EBR: Loaded 43297 existing records from primary storage. [2025-10-16T18:34:33.421699] [INFO ] [MAIN ] EBR: Loaded 43297 existing records. [2025-10-16T18:34:33.449315] [DEBUG] [LOCAL ] EC: Loaded 49000 existing records from primary storage. [2025-10-16T18:34:33.495933] [INFO ] [MAIN ] EC: Loaded 49000 existing records. [2025-10-16T18:34:33.603841] [DEBUG] [LOCAL ] EBS: Loaded 46759 existing records from primary storage. [2025-10-16T18:34:33.649888] [INFO ] [MAIN ] EBS: Loaded 46759 existing records. [2025-10-16T18:34:33.740926] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:33.872582] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-16T18:34:33.918684] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:33.924045] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-16T18:34:33.952301] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-16T18:34:33.934743] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-16T18:34:33.967845] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-16T18:34:33.973047] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-16T18:34:33.997226] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-16T18:34:34.073717] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-16T18:34:34.099537] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:34.205065] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-16T18:34:34.179765] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:34:34.224046] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-16T18:34:34.256595] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-16T18:34:34.269680] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-16T18:34:34.281968] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-16T18:34:34.275187] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-16T18:34:34.287685] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-16T18:34:34.287244] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-16T18:34:35.515029] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.584927] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-16T18:34:35.596437] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.589453] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.602009] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-16T18:34:35.603690] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-16T18:34:35.686881] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:35.687221] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-16T18:34:36.973744] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T18:34:36.979280] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-16T18:34:37.335517] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:34:37.345983] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-16T18:34:37.414365] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:34:37.423665] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-16T18:34:37.785781] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T18:34:37.795825] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-16T18:34:37.892635] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T18:34:37.898598] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-16T18:34:38.559971] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:34:38.569133] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-16T18:34:38.622373] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:34:39.116188] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:34:39.143181] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-16T18:34:39.143996] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:34:39.942824] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-16T18:34:39.982882] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:34:40.607115] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T18:34:40.742852] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-16T18:34:41.257910] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:34:41.542858] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-16T18:34:42.238358] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:34:42.342795] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-16T18:34:42.821391] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:34:43.142819] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-16T18:34:43.942790] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-16T18:34:44.287964] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:34:44.356491] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T18:34:44.742808] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-16T18:34:45.185155] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:34:45.542829] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-16T18:34:46.088023] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:34:46.342888] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-16T18:34:46.696298] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:34:47.142815] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-16T18:34:47.906355] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:34:47.942767] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-16T18:34:48.232826] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:34:48.742819] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-16T18:34:49.542845] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-16T18:34:49.636160] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:34:50.342793] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-16T18:34:50.809668] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-16T18:34:50.878174] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:34:51.142807] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-16T18:34:51.696406] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:34:51.942798] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-16T18:34:52.742825] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-16T18:34:53.019047] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T18:34:53.238514] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T18:34:53.542807] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-16T18:34:54.083730] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:34:54.342823] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-16T18:34:54.527388] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T18:34:55.142843] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-16T18:34:55.942794] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-16T18:34:55.982872] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:34:56.731828] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T18:34:56.742774] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-16T18:34:57.295171] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:34:57.542821] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-16T18:34:58.333148] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T18:34:58.339735] [INFO ] [REMOTE ] EBR: Full fetch complete (62597 records). [2025-10-16T18:34:58.339882] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-16T18:34:58.353436] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-16T18:34:58.720853] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-16T18:34:58.720931] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-16T18:34:58.721759] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-16T18:34:58.721834] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-16T18:34:58.723085] [DEBUG] [LOCAL ] EBR: Trimmed 62597 records to 43627 (keeping 200 days of data) [2025-10-16T18:34:58.981283] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T18:34:59.014901] [DEBUG] [LOCAL ] EBR: Primary data saved (43627 records). [2025-10-16T18:34:59.015045] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-16T18:34:59.015160] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBR took 26.5s. Estimated remaining: 3h 55m 17s. Rate: 7.2 symbols/min [2025-10-16T18:34:59.149881] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-16T18:34:59.180930] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:34:59.181071] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-16T18:34:59.181108] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-16T18:34:59.181214] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-16T18:34:59.181254] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-16T18:34:59.181296] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-16T18:34:59.181340] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-16T18:34:59.521719] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:34:59.942781] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-16T18:35:00.289242] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-16T18:35:00.506612] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:35:00.742787] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-16T18:35:01.542826] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-16T18:35:02.066977] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-16T18:35:02.212260] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:35:02.342820] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-16T18:35:02.776956] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T18:35:02.780619] [INFO ] [REMOTE ] ECAT: Full fetch complete (42815 records). [2025-10-16T18:35:02.780733] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-16T18:35:02.781305] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:02.781411] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:02.781458] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:02.781504] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-16T18:35:02.781569] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-16T18:35:02.781671] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-16T18:35:02.781892] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-16T18:35:02.781980] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECAT took 30.3s. Estimated remaining: 3h 54m 57s. Rate: 7.2 symbols/min [2025-10-16T18:35:02.947050] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:02.947245] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-16T18:35:02.947282] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-16T18:35:02.947391] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-16T18:35:02.947431] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-16T18:35:02.947472] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-16T18:35:02.947503] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-16T18:35:03.153601] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-16T18:35:03.298775] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:03.942854] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-16T18:35:03.997723] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:35:04.588241] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T18:35:04.742801] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-16T18:35:04.924230] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:35:05.542815] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-16T18:35:06.132078] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:35:06.342815] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-16T18:35:06.932065] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:35:06.937995] [INFO ] [REMOTE ] EBS: Full fetch complete (67444 records). [2025-10-16T18:35:06.938148] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-16T18:35:07.148063] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-16T18:35:07.328081] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-16T18:35:07.328169] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-16T18:35:07.329083] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-16T18:35:07.329153] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-16T18:35:07.330499] [DEBUG] [LOCAL ] EBS: Trimmed 67444 records to 47095 (keeping 200 days of data) [2025-10-16T18:35:07.583232] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:35:07.597097] [DEBUG] [LOCAL ] EBS: Primary data saved (47095 records). [2025-10-16T18:35:07.597237] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-16T18:35:07.597343] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EBS took 35.1s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-16T18:35:07.771386] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:07.777451] [DEBUG] [LOCAL ] ECCU: Loaded 2218 existing records from primary storage. [2025-10-16T18:35:07.777716] [INFO ] [MAIN ] ECCU: Loaded 2218 existing records. [2025-10-16T18:35:07.954988] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-16T18:35:07.958023] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:07.958465] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-16T18:35:07.958749] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-16T18:35:07.959600] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-16T18:35:07.959687] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-16T18:35:08.359940] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T18:35:08.405602] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:08.521213] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T18:35:08.742876] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-16T18:35:09.066034] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-16T18:35:09.542869] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-16T18:35:09.868331] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-16T18:35:10.342828] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-16T18:35:11.142803] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-16T18:35:11.560131] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:35:11.942815] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-16T18:35:12.251854] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T18:35:12.474765] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-16T18:35:12.742801] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-16T18:35:13.073310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:35:13.542842] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-16T18:35:14.342824] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-16T18:35:15.142811] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-16T18:35:15.454254] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T18:35:15.616322] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T18:35:15.942782] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-16T18:35:16.131526] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:35:16.212105] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-16T18:35:16.742805] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-16T18:35:17.542862] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-16T18:35:18.342824] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-16T18:35:18.415276] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:35:18.830320] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:35:18.940664] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T18:35:19.142822] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-16T18:35:19.942903] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-16T18:35:20.502245] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:35:20.742857] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-16T18:35:20.827924] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T18:35:20.834243] [INFO ] [REMOTE ] EC: Full fetch complete (71927 records). [2025-10-16T18:35:20.834389] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-16T18:35:21.237027] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-16T18:35:21.237100] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-16T18:35:21.238081] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-16T18:35:21.238144] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-16T18:35:21.239447] [DEBUG] [LOCAL ] EC: Trimmed 71927 records to 49335 (keeping 200 days of data) [2025-10-16T18:35:21.327870] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:35:21.525199] [DEBUG] [LOCAL ] EC: Primary data saved (49335 records). [2025-10-16T18:35:21.525334] [INFO ] [MAIN ] EC: Full history saved. [2025-10-16T18:35:21.525412] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 49.0s. Estimated remaining: 3h 54m 46s. Rate: 7.2 symbols/min [2025-10-16T18:35:21.547922] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-16T18:35:21.703753] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:21.704987] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-16T18:35:21.705162] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-16T18:35:21.705351] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-16T18:35:21.705405] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-16T18:35:21.705450] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-16T18:35:21.705482] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-16T18:35:22.063751] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T18:35:22.070017] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:22.071103] [INFO ] [REMOTE ] ECCC: Full fetch complete (1296 records). [2025-10-16T18:35:22.071174] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-16T18:35:22.243408] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T18:35:22.243571] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:22.243638] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:22.243728] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-16T18:35:22.243790] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-16T18:35:22.243825] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-16T18:35:22.243864] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-16T18:35:22.243917] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCC took 19.5s. Estimated remaining: 3h 54m 18s. Rate: 7.2 symbols/min [2025-10-16T18:35:22.347934] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-16T18:35:22.410506] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:22.410765] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-16T18:35:22.410814] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-16T18:35:22.410920] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-16T18:35:22.410960] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-16T18:35:22.411003] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-16T18:35:22.411034] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-16T18:35:22.787005] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:22.985630] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T18:35:23.142802] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-16T18:35:23.783685] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T18:35:23.942836] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-16T18:35:24.384299] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:35:24.742832] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-16T18:35:25.024538] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-16T18:35:25.542842] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-16T18:35:25.898991] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T18:35:26.342833] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-16T18:35:27.142817] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-16T18:35:27.782331] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T18:35:27.942822] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-16T18:35:28.054376] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:35:28.351691] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T18:35:28.742883] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-16T18:35:29.073169] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:35:29.542861] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-16T18:35:30.072226] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-16T18:35:30.342833] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-16T18:35:30.657393] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:35:31.142810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-16T18:35:31.474540] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T18:35:31.942816] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-16T18:35:32.282258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T18:35:32.742861] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-16T18:35:33.542863] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-16T18:35:34.056580] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:35:34.328162] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T18:35:34.342770] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-16T18:35:35.142832] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-16T18:35:35.493303] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-16T18:35:35.942785] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-16T18:35:36.046150] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:35:36.226103] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-16T18:35:36.742915] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-16T18:35:37.542858] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-16T18:35:37.849083] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T18:35:38.342788] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-16T18:35:38.446102] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T18:35:38.712029] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-16T18:35:39.142812] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-16T18:35:39.506158] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-16T18:35:39.942870] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-16T18:35:40.488292] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T18:35:40.742831] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-16T18:35:41.217461] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T18:35:41.542820] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-16T18:35:41.842283] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T18:35:42.342803] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-16T18:35:42.656408] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T18:35:43.142813] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-16T18:35:43.512191] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T18:35:43.512980] [INFO ] [REMOTE ] ECCU: Full fetch complete (4357 records). [2025-10-16T18:35:43.513048] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-16T18:35:43.513401] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:43.513481] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:43.513524] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:43.513590] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-16T18:35:43.513674] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-16T18:35:43.513729] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-16T18:35:43.513946] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-10-16T18:35:43.514032] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCU took 35.9s. Estimated remaining: 3h 54m 42s. Rate: 7.2 symbols/min [2025-10-16T18:35:43.682354] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:43.714383] [DEBUG] [LOCAL ] ECG: Loaded 33179 existing records from primary storage. [2025-10-16T18:35:43.714729] [INFO ] [MAIN ] ECG: Loaded 33179 existing records. [2025-10-16T18:35:43.890490] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:43.890717] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-16T18:35:43.890772] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-16T18:35:43.890961] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-16T18:35:43.891015] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-16T18:35:43.949891] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-16T18:35:44.257600] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:44.742826] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-16T18:35:45.542802] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-16T18:35:45.637983] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T18:35:45.644129] [INFO ] [REMOTE ] ECC: Full fetch complete (61459 records). [2025-10-16T18:35:45.644248] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-16T18:35:45.992896] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:35:46.041139] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-16T18:35:46.041236] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-16T18:35:46.042212] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-16T18:35:46.042285] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-16T18:35:46.043695] [DEBUG] [LOCAL ] ECC: Trimmed 61459 records to 43644 (keeping 200 days of data) [2025-10-16T18:35:46.302660] [DEBUG] [LOCAL ] ECC: Primary data saved (43644 records). [2025-10-16T18:35:46.302805] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-16T18:35:46.302897] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECC took 47.3s. Estimated remaining: 3h 54m 20s. Rate: 7.2 symbols/min [2025-10-16T18:35:46.348025] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-16T18:35:46.484148] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:46.507829] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T18:35:46.557690] [DEBUG] [LOCAL ] ECL: Loaded 46668 existing records from primary storage. [2025-10-16T18:35:46.558011] [INFO ] [MAIN ] ECL: Loaded 46668 existing records. [2025-10-16T18:35:46.732412] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:46.732667] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-16T18:35:46.732730] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-16T18:35:46.733016] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-16T18:35:46.733072] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-16T18:35:46.907512] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T18:35:47.092388] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:47.142802] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-16T18:35:47.942890] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-16T18:35:48.599982] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:35:48.742831] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-16T18:35:49.084274] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T18:35:49.542862] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-16T18:35:49.888124] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-16T18:35:49.899516] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-16T18:35:50.342875] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-16T18:35:50.852349] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T18:35:51.142866] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-16T18:35:51.675741] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T18:35:51.676453] [INFO ] [REMOTE ] ECCW: Full fetch complete (1412 records). [2025-10-16T18:35:51.676520] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-16T18:35:51.854151] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-16T18:35:51.854355] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:51.854403] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:51.854469] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-16T18:35:51.854533] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-16T18:35:51.854568] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-16T18:35:51.854608] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-16T18:35:51.854686] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 30.3s. Estimated remaining: 3h 54m 5s. Rate: 7.2 symbols/min [2025-10-16T18:35:51.948072] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-16T18:35:52.027398] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:52.027579] [DEBUG] [LOCAL ] ECO: No existing data file found in primary storage. [2025-10-16T18:35:52.027621] [WARN ] [MAIN ] ECO: No existing data found, performing full refresh instead. [2025-10-16T18:35:52.027754] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-16T18:35:52.027796] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-16T18:35:52.027884] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-16T18:35:52.027924] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-16T18:35:52.382223] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:52.742864] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-16T18:35:53.542852] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-16T18:35:53.703067] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:35:54.037444] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:35:54.038170] [INFO ] [REMOTE ] ECCX: Full fetch complete (1453 records). [2025-10-16T18:35:54.038238] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-16T18:35:54.038560] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:35:54.038639] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:35:54.038745] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:35:54.038811] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-16T18:35:54.038872] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-16T18:35:54.038905] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-16T18:35:54.038943] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-16T18:35:54.038992] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECCX took 31.8s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-16T18:35:54.214132] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:35:54.237708] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:35:54.284472] [DEBUG] [LOCAL ] ECVT: Loaded 43302 existing records from primary storage. [2025-10-16T18:35:54.284807] [INFO ] [MAIN ] ECVT: Loaded 43302 existing records. [2025-10-16T18:35:54.348369] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-16T18:35:54.466545] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:35:54.466788] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-16T18:35:54.466839] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-16T18:35:54.467039] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-16T18:35:54.467096] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-16T18:35:54.810983] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:35:55.142855] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-16T18:35:55.942806] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-16T18:35:56.090543] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:35:56.291961] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:35:56.742827] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-16T18:35:57.441434] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:35:57.542832] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-16T18:35:57.966751] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-16T18:35:58.342821] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-16T18:35:59.142840] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-16T18:35:59.183151] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:35:59.773788] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T18:35:59.942797] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-16T18:36:00.581602] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T18:36:00.742811] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-16T18:36:01.290080] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:36:01.542822] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-16T18:36:02.342848] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-16T18:36:02.614343] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T18:36:02.979331] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T18:36:03.142810] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-16T18:36:03.477950] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T18:36:03.942812] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-16T18:36:04.742784] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-16T18:36:04.928521] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:36:05.180853] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T18:36:05.542802] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-16T18:36:05.787677] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:36:06.342831] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-16T18:36:06.892635] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:36:07.142798] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-16T18:36:07.837964] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T18:36:07.942812] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-16T18:36:08.092410] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-16T18:36:08.742803] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-16T18:36:09.377507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:36:09.542804] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-16T18:36:09.777755] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T18:36:10.342866] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-16T18:36:10.983531] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:36:11.069336] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:36:11.142856] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-16T18:36:11.942786] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-16T18:36:12.422441] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:36:12.742818] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-16T18:36:12.886607] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-16T18:36:13.542835] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-16T18:36:14.019215] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:36:14.023525] [INFO ] [REMOTE ] ECG: Full fetch complete (51029 records). [2025-10-16T18:36:14.023618] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-16T18:36:14.348096] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-16T18:36:14.420828] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-16T18:36:14.420937] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-16T18:36:14.421948] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-16T18:36:14.422070] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-16T18:36:14.423442] [DEBUG] [LOCAL ] ECG: Trimmed 51029 records to 33440 (keeping 200 days of data) [2025-10-16T18:36:14.616370] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:36:14.644099] [DEBUG] [LOCAL ] ECG: Primary data saved (33440 records). [2025-10-16T18:36:14.644256] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-16T18:36:14.644343] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 31.1s. Estimated remaining: 3h 54m 3s. Rate: 7.2 symbols/min [2025-10-16T18:36:14.812495] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:14.812754] [DEBUG] [LOCAL ] ED: No existing data file found in primary storage. [2025-10-16T18:36:14.812808] [WARN ] [MAIN ] ED: No existing data found, performing full refresh instead. [2025-10-16T18:36:14.812929] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-16T18:36:14.812970] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-16T18:36:14.813011] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-16T18:36:14.813044] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-16T18:36:15.153534] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-16T18:36:15.173546] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:15.942834] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-16T18:36:16.175729] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T18:36:16.742825] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-16T18:36:16.900736] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:36:17.542887] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-16T18:36:17.749721] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-16T18:36:18.296255] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:36:18.342800] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-16T18:36:18.734379] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:36:19.142856] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-16T18:36:19.917857] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:36:19.942877] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-16T18:36:20.467063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:36:20.742867] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-16T18:36:20.791873] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T18:36:21.542794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-16T18:36:22.275674] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T18:36:22.342908] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-16T18:36:22.979141] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:36:23.142887] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-16T18:36:23.942820] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-16T18:36:24.033412] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:36:24.742799] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-16T18:36:24.844449] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:36:25.109839] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T18:36:25.112695] [INFO ] [REMOTE ] ECO: Full fetch complete (28440 records). [2025-10-16T18:36:25.112797] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-16T18:36:25.482889] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-16T18:36:25.482979] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-16T18:36:25.483556] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-16T18:36:25.483598] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-16T18:36:25.484435] [DEBUG] [LOCAL ] ECO: Trimmed 28440 records to 18306 (keeping 200 days of data) [2025-10-16T18:36:25.561599] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-16T18:36:25.597142] [DEBUG] [LOCAL ] ECO: Primary data saved (18306 records). [2025-10-16T18:36:25.597301] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-16T18:36:25.597376] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECO took 33.7s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-16T18:36:25.762314] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:25.792001] [DEBUG] [LOCAL ] EDD: Loaded 26779 existing records from primary storage. [2025-10-16T18:36:25.792348] [INFO ] [MAIN ] EDD: Loaded 26779 existing records. [2025-10-16T18:36:25.978091] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:25.978310] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-16T18:36:25.978357] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-16T18:36:25.978565] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-16T18:36:25.978621] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-16T18:36:26.334257] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:26.347920] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-16T18:36:26.362167] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:36:27.038076] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T18:36:27.142810] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-16T18:36:27.942860] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-16T18:36:27.975415] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:36:28.742858] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-16T18:36:28.761148] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-16T18:36:28.767277] [INFO ] [REMOTE ] ECL: Full fetch complete (68286 records). [2025-10-16T18:36:28.767488] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-16T18:36:29.144780] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-16T18:36:29.144877] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-16T18:36:29.145756] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-16T18:36:29.145823] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-16T18:36:29.147226] [DEBUG] [LOCAL ] ECL: Trimmed 68286 records to 47037 (keeping 200 days of data) [2025-10-16T18:36:29.455287] [DEBUG] [LOCAL ] ECL: Primary data saved (47037 records). [2025-10-16T18:36:29.455451] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-16T18:36:29.455564] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECL took 43.2s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-16T18:36:29.544422] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-16T18:36:29.650217] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:29.671033] [DEBUG] [LOCAL ] EDF: Loaded 13052 existing records from primary storage. [2025-10-16T18:36:29.671296] [INFO ] [MAIN ] EDF: Loaded 13052 existing records. [2025-10-16T18:36:29.872240] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:29.872699] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-16T18:36:29.872763] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-16T18:36:29.872948] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-16T18:36:29.873005] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-16T18:36:30.310426] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:30.313006] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-16T18:36:30.346326] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-16T18:36:30.369665] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T18:36:30.386997] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:36:31.142876] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-16T18:36:31.629965] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T18:36:31.942831] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-16T18:36:32.742864] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-16T18:36:32.910402] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:36:32.957350] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T18:36:33.542847] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-16T18:36:33.890576] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:36:34.342825] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-16T18:36:34.553541] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:36:35.142841] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-16T18:36:35.502665] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T18:36:35.655518] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:36:35.942782] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-16T18:36:36.742834] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-16T18:36:37.093007] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:36:37.349578] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:36:37.542819] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-16T18:36:38.342834] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-16T18:36:38.478947] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T18:36:39.142861] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-16T18:36:39.942804] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-16T18:36:40.096114] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T18:36:40.157068] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T18:36:40.742865] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-16T18:36:41.542883] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-16T18:36:41.599993] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:36:42.342839] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-16T18:36:42.373120] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T18:36:42.378875] [INFO ] [REMOTE ] ECVT: Full fetch complete (60246 records). [2025-10-16T18:36:42.378988] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-16T18:36:42.505930] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:36:42.781710] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-16T18:36:42.781795] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-16T18:36:42.782581] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-16T18:36:42.782622] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-16T18:36:42.783819] [DEBUG] [LOCAL ] ECVT: Trimmed 60246 records to 43630 (keeping 200 days of data) [2025-10-16T18:36:43.025691] [DEBUG] [LOCAL ] ECVT: Primary data saved (43630 records). [2025-10-16T18:36:43.025838] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-16T18:36:43.026375] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 49.0s. Estimated remaining: 3h 53m 46s. Rate: 7.2 symbols/min [2025-10-16T18:36:43.147956] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-16T18:36:43.210465] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:43.233012] [DEBUG] [LOCAL ] EDN: Loaded 19013 existing records from primary storage. [2025-10-16T18:36:43.233270] [INFO ] [MAIN ] EDN: Loaded 19013 existing records. [2025-10-16T18:36:43.406967] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:43.407238] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-16T18:36:43.407309] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-16T18:36:43.412749] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-16T18:36:43.421087] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-16T18:36:43.461022] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T18:36:43.793024] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:43.942802] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-16T18:36:44.742814] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-16T18:36:45.010120] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T18:36:45.343619] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T18:36:45.542815] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-16T18:36:45.637521] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:36:46.021717] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T18:36:46.342829] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-16T18:36:46.990723] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T18:36:47.142846] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-16T18:36:47.942848] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-16T18:36:47.994079] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T18:36:47.995939] [INFO ] [REMOTE ] EDF: Full fetch complete (20440 records). [2025-10-16T18:36:47.996009] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-16T18:36:48.347853] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-16T18:36:48.347930] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-16T18:36:48.348357] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-16T18:36:48.348397] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-16T18:36:48.348999] [DEBUG] [LOCAL ] EDF: Trimmed 20440 records to 13171 (keeping 200 days of data) [2025-10-16T18:36:48.423792] [DEBUG] [LOCAL ] EDF: Primary data saved (13171 records). [2025-10-16T18:36:48.423926] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-16T18:36:48.424004] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. EDF took 19.0s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-16T18:36:48.593157] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:48.636193] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-16T18:36:48.636475] [INFO ] [MAIN ] EDU: Loaded 44813 existing records. [2025-10-16T18:36:48.742873] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-16T18:36:48.822492] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:48.822732] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-16T18:36:48.822790] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-16T18:36:48.822997] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-16T18:36:48.823056] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-16T18:36:49.208935] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:49.210483] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T18:36:49.542807] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-16T18:36:50.342824] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-16T18:36:50.560309] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:36:50.968714] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:36:51.142779] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-16T18:36:51.516964] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:36:51.942827] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-16T18:36:52.520142] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:36:52.742819] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-16T18:36:53.542793] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-16T18:36:53.684363] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:36:53.691449] [INFO ] [REMOTE ] ED: Full fetch complete (76437 records). [2025-10-16T18:36:53.691587] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-16T18:36:54.007483] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:36:54.109768] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-16T18:36:54.109849] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-16T18:36:54.110809] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-16T18:36:54.110871] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-16T18:36:54.112259] [DEBUG] [LOCAL ] ED: Trimmed 76437 records to 53052 (keeping 200 days of data) [2025-10-16T18:36:54.316632] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T18:36:54.347774] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-16T18:36:54.471546] [DEBUG] [LOCAL ] ED: Primary data saved (53052 records). [2025-10-16T18:36:54.471736] [INFO ] [MAIN ] ED: Full history saved. [2025-10-16T18:36:54.471825] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. ED took 39.8s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-16T18:36:54.637378] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:36:54.669809] [DEBUG] [LOCAL ] EE: Loaded 32990 existing records from primary storage. [2025-10-16T18:36:54.670096] [INFO ] [MAIN ] EE: Loaded 32990 existing records. [2025-10-16T18:36:54.846787] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:36:54.847068] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-16T18:36:54.847116] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-16T18:36:54.847290] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-16T18:36:54.847328] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-16T18:36:55.148013] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-16T18:36:55.200991] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:36:55.885576] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T18:36:55.942808] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-16T18:36:56.267949] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:36:56.742857] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-16T18:36:57.439494] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T18:36:57.542835] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-16T18:36:57.729965] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:36:58.342825] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-16T18:36:59.030467] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:36:59.142770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-16T18:36:59.522176] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:36:59.942823] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-16T18:37:00.742823] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-16T18:37:00.775189] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:37:00.918573] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:37:01.542836] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-16T18:37:01.692889] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T18:37:01.696506] [INFO ] [REMOTE ] EDD: Full fetch complete (38631 records). [2025-10-16T18:37:01.696594] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-16T18:37:02.062014] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-16T18:37:02.062147] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-16T18:37:02.062811] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-16T18:37:02.062873] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-16T18:37:02.063767] [DEBUG] [LOCAL ] EDD: Trimmed 38631 records to 27000 (keeping 200 days of data) [2025-10-16T18:37:02.219088] [DEBUG] [LOCAL ] EDD: Primary data saved (27000 records). [2025-10-16T18:37:02.219231] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-16T18:37:02.219311] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDD took 36.6s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-16T18:37:02.344015] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-16T18:37:02.388594] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:02.388782] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-16T18:37:02.388825] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-16T18:37:02.388950] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-16T18:37:02.388992] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-16T18:37:02.389032] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-16T18:37:02.389064] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-16T18:37:02.700068] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:37:02.760274] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:03.132884] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:37:03.142765] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-16T18:37:03.942815] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-16T18:37:03.992389] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:37:04.742863] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-16T18:37:04.825534] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T18:37:05.542859] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-16T18:37:05.959162] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:37:06.101984] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:37:06.342848] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-16T18:37:07.142829] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-16T18:37:07.936366] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T18:37:07.942762] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-16T18:37:08.091013] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:37:08.742872] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-16T18:37:08.898026] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:37:09.542869] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-16T18:37:10.071129] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:37:10.342845] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-16T18:37:10.954892] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T18:37:10.958560] [INFO ] [REMOTE ] EDN: Full fetch complete (30015 records). [2025-10-16T18:37:10.958680] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-16T18:37:11.145461] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-16T18:37:11.329404] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-16T18:37:11.329565] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-16T18:37:11.330205] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-16T18:37:11.330278] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-16T18:37:11.346569] [DEBUG] [LOCAL ] EDN: Trimmed 30015 records to 19176 (keeping 200 days of data) [2025-10-16T18:37:11.359087] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:37:11.478828] [DEBUG] [LOCAL ] EDN: Primary data saved (19176 records). [2025-10-16T18:37:11.478986] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-16T18:37:11.479070] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDN took 28.5s. Estimated remaining: 3h 53m 0s. Rate: 7.2 symbols/min [2025-10-16T18:37:11.696272] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T18:37:11.704730] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:11.721325] [DEBUG] [LOCAL ] EEX: Loaded 10208 existing records from primary storage. [2025-10-16T18:37:11.721616] [INFO ] [MAIN ] EEX: Loaded 10208 existing records. [2025-10-16T18:37:11.944222] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-16T18:37:11.979274] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:11.980044] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-16T18:37:11.980166] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-16T18:37:11.980383] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-16T18:37:11.980444] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-16T18:37:12.510632] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:12.742915] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-16T18:37:13.325601] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T18:37:13.542853] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-16T18:37:13.867984] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:37:14.116384] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T18:37:14.342885] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-16T18:37:15.097822] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T18:37:15.142834] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-16T18:37:15.942804] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-16T18:37:16.290103] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T18:37:16.450828] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:37:16.742813] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-16T18:37:17.542812] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-16T18:37:18.342789] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-16T18:37:18.371281] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:37:18.845796] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:37:18.868595] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T18:37:19.142836] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-16T18:37:19.692298] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T18:37:19.942819] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-16T18:37:20.742822] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-16T18:37:21.202434] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:37:21.382216] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:37:21.542812] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-16T18:37:21.920079] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T18:37:22.342861] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-16T18:37:23.142874] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-16T18:37:23.942807] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-16T18:37:24.311876] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T18:37:24.340992] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T18:37:24.742813] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-16T18:37:24.814576] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:37:25.542825] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-16T18:37:26.024286] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:37:26.028866] [INFO ] [REMOTE ] EE: Full fetch complete (43906 records). [2025-10-16T18:37:26.028979] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-16T18:37:26.029622] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:37:26.029725] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:37:26.029768] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:37:26.029807] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-16T18:37:26.029865] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-16T18:37:26.029915] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-16T18:37:26.030079] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-16T18:37:26.030166] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 31.6s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-16T18:37:26.203431] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:26.250141] [DEBUG] [LOCAL ] EFC: Loaded 46431 existing records from primary storage. [2025-10-16T18:37:26.250462] [INFO ] [MAIN ] EFC: Loaded 46431 existing records. [2025-10-16T18:37:26.350162] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-16T18:37:26.436358] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:26.436543] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-16T18:37:26.436590] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-16T18:37:26.436791] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-16T18:37:26.436856] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-16T18:37:26.791756] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:27.063280] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:37:27.102432] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T18:37:27.142765] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-16T18:37:27.942900] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-16T18:37:28.646061] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:37:28.742784] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-16T18:37:28.936633] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-16T18:37:29.315051] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T18:37:29.315830] [INFO ] [REMOTE ] EEA: Full fetch complete (3810 records). [2025-10-16T18:37:29.315899] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-16T18:37:29.491349] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:37:29.491547] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:37:29.491612] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:37:29.491713] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-16T18:37:29.491798] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-16T18:37:29.491835] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-16T18:37:29.491894] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-16T18:37:29.491950] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EEA took 27.3s. Estimated remaining: 3h 52m 46s. Rate: 7.2 symbols/min [2025-10-16T18:37:29.552347] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-16T18:37:29.660532] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:29.676330] [DEBUG] [LOCAL ] EFR: Loaded 15060 existing records from primary storage. [2025-10-16T18:37:29.676564] [INFO ] [MAIN ] EFR: Loaded 15060 existing records. [2025-10-16T18:37:29.846339] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:29.846528] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-16T18:37:29.846573] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-16T18:37:29.846765] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-16T18:37:29.846822] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-16T18:37:30.193161] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:30.342790] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-16T18:37:31.142787] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-16T18:37:31.214613] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:37:31.220844] [INFO ] [REMOTE ] EDU: Full fetch complete (66987 records). [2025-10-16T18:37:31.220964] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-16T18:37:31.600292] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:37:31.625764] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-16T18:37:31.625851] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-16T18:37:31.626790] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-16T18:37:31.626854] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-16T18:37:31.628119] [DEBUG] [LOCAL ] EDU: Trimmed 66987 records to 45172 (keeping 200 days of data) [2025-10-16T18:37:31.889416] [DEBUG] [LOCAL ] EDU: Primary data saved (45172 records). [2025-10-16T18:37:31.889546] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-16T18:37:31.889623] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EDU took 43.5s. Estimated remaining: 3h 52m 24s. Rate: 7.2 symbols/min [2025-10-16T18:37:31.951902] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-16T18:37:32.064289] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:32.079472] [DEBUG] [LOCAL ] EFT: Loaded 13087 existing records from primary storage. [2025-10-16T18:37:32.079717] [INFO ] [MAIN ] EFT: Loaded 13087 existing records. [2025-10-16T18:37:32.251067] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:32.251278] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-16T18:37:32.251334] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-16T18:37:32.251556] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-16T18:37:32.251621] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-16T18:37:32.597837] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:32.660165] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:37:32.742779] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-16T18:37:32.842487] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:37:33.542787] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-16T18:37:33.769752] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T18:37:34.118370] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:37:34.342831] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-16T18:37:35.142862] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-16T18:37:35.942829] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-16T18:37:35.984414] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:37:36.070179] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:37:36.742862] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-16T18:37:37.069206] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:37:37.526791] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:37:37.542816] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-16T18:37:38.342836] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-16T18:37:38.425943] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:37:38.934605] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T18:37:39.142828] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-16T18:37:39.722334] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:37:39.942872] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-16T18:37:40.742870] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-16T18:37:41.217503] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T18:37:41.525205] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:37:41.542769] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-16T18:37:42.342827] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-16T18:37:43.142841] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-16T18:37:43.166535] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T18:37:43.348488] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:37:43.619516] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-16T18:37:43.942800] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-16T18:37:44.742884] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-16T18:37:45.542873] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-16T18:37:45.703279] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-16T18:37:45.727502] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:37:45.729021] [INFO ] [REMOTE ] EEX: Full fetch complete (18627 records). [2025-10-16T18:37:45.729093] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-16T18:37:46.087315] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-16T18:37:46.087391] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-16T18:37:46.087805] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-16T18:37:46.087867] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-16T18:37:46.088361] [DEBUG] [LOCAL ] EEX: Trimmed 18627 records to 10294 (keeping 200 days of data) [2025-10-16T18:37:46.146756] [DEBUG] [LOCAL ] EEX: Primary data saved (10294 records). [2025-10-16T18:37:46.146888] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-16T18:37:46.146975] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EEX took 34.7s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-16T18:37:46.316570] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:46.329067] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:37:46.342766] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-16T18:37:46.376624] [DEBUG] [LOCAL ] EFX: Loaded 44637 existing records from primary storage. [2025-10-16T18:37:46.377076] [INFO ] [MAIN ] EFX: Loaded 44637 existing records. [2025-10-16T18:37:46.547353] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:46.547543] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-16T18:37:46.547593] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-16T18:37:46.547944] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-16T18:37:46.548003] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-16T18:37:46.902181] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:47.113315] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:37:47.142776] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-16T18:37:47.942815] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-16T18:37:48.742884] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-16T18:37:48.868144] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:37:49.482635] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:37:49.517713] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:37:49.542775] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-16T18:37:50.342812] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-16T18:37:51.070263] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:37:51.142801] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-16T18:37:51.306742] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:37:51.883160] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:37:51.942865] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-16T18:37:52.681283] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T18:37:52.742831] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-16T18:37:53.542828] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-16T18:37:53.809342] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T18:37:54.342845] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-16T18:37:55.029372] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:37:55.048164] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:37:55.142787] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-16T18:37:55.942813] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-16T18:37:56.184276] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T18:37:56.187357] [INFO ] [REMOTE ] EFR: Full fetch complete (19448 records). [2025-10-16T18:37:56.187459] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-16T18:37:56.544435] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-16T18:37:56.544529] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-16T18:37:56.544980] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-16T18:37:56.545042] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-16T18:37:56.545601] [DEBUG] [LOCAL ] EFR: Trimmed 19448 records to 15165 (keeping 200 days of data) [2025-10-16T18:37:56.635120] [DEBUG] [LOCAL ] EFR: Primary data saved (15165 records). [2025-10-16T18:37:56.635256] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-16T18:37:56.635331] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFR took 27.1s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-16T18:37:56.747989] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-16T18:37:56.813143] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:37:56.843674] [DEBUG] [LOCAL ] EFXT: Loaded 29684 existing records from primary storage. [2025-10-16T18:37:56.843975] [INFO ] [MAIN ] EFXT: Loaded 29684 existing records. [2025-10-16T18:37:57.024916] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:37:57.025161] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-16T18:37:57.025209] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-16T18:37:57.025826] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-16T18:37:57.025885] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-16T18:37:57.428866] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:37:57.542851] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-16T18:37:57.597587] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T18:37:58.342819] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-16T18:37:58.437915] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T18:37:58.564277] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T18:37:59.142831] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-16T18:37:59.942808] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-16T18:38:00.022993] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T18:38:00.742861] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-16T18:38:00.987869] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T18:38:01.016093] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T18:38:01.542933] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-16T18:38:02.342799] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-16T18:38:02.500197] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:38:02.673454] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T18:38:03.142817] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-16T18:38:03.942850] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-16T18:38:04.260215] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T18:38:04.574432] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T18:38:04.743334] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-16T18:38:04.751864] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:38:05.542859] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-16T18:38:06.106762] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-16T18:38:06.342824] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-16T18:38:07.142827] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-16T18:38:07.197979] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-16T18:38:07.564458] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T18:38:07.942847] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-16T18:38:07.975673] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-16T18:38:08.742881] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-16T18:38:09.542906] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-16T18:38:09.758277] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T18:38:09.765216] [INFO ] [REMOTE ] EFC: Full fetch complete (66794 records). [2025-10-16T18:38:09.765412] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-16T18:38:09.872108] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:38:09.894883] [INFO ] [REMOTE ] EFT: Full fetch complete (17995 records). [2025-10-16T18:38:09.907787] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-16T18:38:10.353596] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-16T18:38:10.613858] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-16T18:38:10.614025] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-16T18:38:10.614101] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-16T18:38:10.615067] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-16T18:38:10.614178] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-16T18:38:10.615372] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-16T18:38:10.615446] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-16T18:38:10.615664] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-16T18:38:10.616819] [DEBUG] [LOCAL ] EFT: Trimmed 17995 records to 13160 (keeping 200 days of data) [2025-10-16T18:38:10.617953] [DEBUG] [LOCAL ] EFC: Trimmed 66794 records to 46757 (keeping 200 days of data) [2025-10-16T18:38:10.800857] [DEBUG] [LOCAL ] EFT: Primary data saved (13160 records). [2025-10-16T18:38:10.815371] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-16T18:38:10.817053] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFT took 38.9s. Estimated remaining: 3h 52m 32s. Rate: 7.2 symbols/min [2025-10-16T18:38:11.136621] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:11.179336] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:38:11.220972] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-16T18:38:11.253350] [DEBUG] [LOCAL ] EFC: Primary data saved (46757 records). [2025-10-16T18:38:11.253852] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-16T18:38:11.254500] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFC took 45.2s. Estimated remaining: 3h 52m 4s. Rate: 7.2 symbols/min [2025-10-16T18:38:11.255175] [DEBUG] [LOCAL ] EG: Loaded 27797 existing records from primary storage. [2025-10-16T18:38:11.318045] [INFO ] [MAIN ] EG: Loaded 27797 existing records. [2025-10-16T18:38:11.498809] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:11.623775] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:11.624280] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-16T18:38:11.624375] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-16T18:38:11.643235] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-16T18:38:11.644220] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-16T18:38:11.644351] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-16T18:38:11.899540] [DEBUG] [LOCAL ] EGO: Loaded 51726 existing records from primary storage. [2025-10-16T18:38:11.943298] [INFO ] [MAIN ] EGO: Loaded 51726 existing records. [2025-10-16T18:38:11.959152] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-16T18:38:12.160727] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:12.238604] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:12.238847] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-16T18:38:12.238895] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-16T18:38:12.239880] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-16T18:38:12.239938] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-16T18:38:12.600895] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:12.742786] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-16T18:38:12.848525] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:38:13.236444] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:38:13.542838] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-16T18:38:14.342851] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-16T18:38:14.370558] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:38:15.142791] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-16T18:38:15.527274] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:38:15.655283] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-16T18:38:15.942801] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-16T18:38:16.654600] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T18:38:16.742822] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-16T18:38:17.261904] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T18:38:17.542828] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-16T18:38:18.316375] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:38:18.342772] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-16T18:38:18.682671] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:38:19.142851] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-16T18:38:19.741998] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:38:19.948414] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-16T18:38:19.957305] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:38:20.742819] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-16T18:38:21.542890] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-16T18:38:21.851905] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T18:38:21.858242] [INFO ] [REMOTE ] EFX: Full fetch complete (64966 records). [2025-10-16T18:38:21.858358] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-16T18:38:22.290404] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-16T18:38:22.290522] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-16T18:38:22.291404] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-16T18:38:22.291477] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-16T18:38:22.292793] [DEBUG] [LOCAL ] EFX: Trimmed 64966 records to 45004 (keeping 200 days of data) [2025-10-16T18:38:22.353276] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-16T18:38:22.587199] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:38:22.649978] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T18:38:22.651688] [DEBUG] [LOCAL ] EFX: Primary data saved (45004 records). [2025-10-16T18:38:22.651896] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-16T18:38:22.652822] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFX took 36.5s. Estimated remaining: 3h 52m 3s. Rate: 7.2 symbols/min [2025-10-16T18:38:22.827076] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:22.861477] [DEBUG] [LOCAL ] EGP: Loaded 30418 existing records from primary storage. [2025-10-16T18:38:22.861811] [INFO ] [MAIN ] EGP: Loaded 30418 existing records. [2025-10-16T18:38:23.039540] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:23.039779] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-16T18:38:23.039832] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-16T18:38:23.040500] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-16T18:38:23.040557] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-16T18:38:23.147915] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-16T18:38:23.402758] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:23.799815] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:38:23.942841] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-16T18:38:24.718836] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T18:38:24.742767] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-16T18:38:25.212028] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:38:25.542860] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-16T18:38:26.342849] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-16T18:38:26.560117] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:38:26.719780] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:38:27.142822] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-16T18:38:27.798071] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:38:27.942827] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-16T18:38:28.494021] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:38:28.742811] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-16T18:38:29.122515] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T18:38:29.127265] [INFO ] [REMOTE ] EFXT: Full fetch complete (44354 records). [2025-10-16T18:38:29.127409] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-16T18:38:29.522379] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-16T18:38:29.522461] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-16T18:38:29.523238] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-16T18:38:29.523308] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-16T18:38:29.524385] [DEBUG] [LOCAL ] EFXT: Trimmed 44354 records to 29940 (keeping 200 days of data) [2025-10-16T18:38:29.573221] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-16T18:38:29.699575] [DEBUG] [LOCAL ] EFXT: Primary data saved (29940 records). [2025-10-16T18:38:29.699900] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-16T18:38:29.700002] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EFXT took 33.1s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-16T18:38:29.869309] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:29.904772] [DEBUG] [LOCAL ] EGY: Loaded 41558 existing records from primary storage. [2025-10-16T18:38:29.905055] [INFO ] [MAIN ] EGY: Loaded 41558 existing records. [2025-10-16T18:38:30.094968] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:30.095297] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-16T18:38:30.095374] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-16T18:38:30.102756] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-16T18:38:30.113108] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-16T18:38:30.119713] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T18:38:30.350262] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-16T18:38:30.475615] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:30.942401] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:38:31.142813] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-16T18:38:31.711758] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T18:38:31.942815] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-16T18:38:32.174411] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:38:32.742867] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-16T18:38:33.542795] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-16T18:38:33.706576] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-16T18:38:34.083593] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T18:38:34.342843] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-16T18:38:35.036531] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:38:35.142852] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-16T18:38:35.942887] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-16T18:38:35.974278] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:38:36.742860] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-16T18:38:36.892576] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:38:37.280543] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:38:37.542823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-16T18:38:38.081695] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:38:38.342807] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-16T18:38:38.675239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T18:38:39.142821] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-16T18:38:39.746524] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:38:39.942815] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-16T18:38:40.742788] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-16T18:38:40.779867] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:38:41.206319] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:38:41.542804] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-16T18:38:42.080481] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T18:38:42.342870] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-16T18:38:42.891031] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:38:43.142801] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-16T18:38:43.756090] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T18:38:43.942777] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-16T18:38:44.405151] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:38:44.742830] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-16T18:38:45.248811] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T18:38:45.542868] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-16T18:38:46.269040] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T18:38:46.342798] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-16T18:38:47.001500] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T18:38:47.142803] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-16T18:38:47.183237] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T18:38:47.942820] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-16T18:38:48.743144] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-16T18:38:48.745730] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:38:48.910770] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T18:38:49.542790] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-16T18:38:50.079920] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T18:38:50.083790] [INFO ] [REMOTE ] EGP: Full fetch complete (45621 records). [2025-10-16T18:38:50.083914] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-16T18:38:50.352148] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-16T18:38:50.468024] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-16T18:38:50.468109] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-16T18:38:50.468859] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-16T18:38:50.468925] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-16T18:38:50.469974] [DEBUG] [LOCAL ] EGP: Trimmed 45621 records to 30655 (keeping 200 days of data) [2025-10-16T18:38:50.663202] [DEBUG] [LOCAL ] EGP: Primary data saved (30655 records). [2025-10-16T18:38:50.663327] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-16T18:38:50.663405] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EGP took 28.0s. Estimated remaining: 3h 52m 13s. Rate: 7.2 symbols/min [2025-10-16T18:38:50.833160] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:50.861900] [DEBUG] [LOCAL ] EHAB: Loaded 29337 existing records from primary storage. [2025-10-16T18:38:50.862158] [INFO ] [MAIN ] EHAB: Loaded 29337 existing records. [2025-10-16T18:38:51.043237] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:51.043678] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-16T18:38:51.043754] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-16T18:38:51.043984] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-16T18:38:51.044057] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-16T18:38:51.150843] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-16T18:38:51.170153] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T18:38:51.436587] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:51.942867] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-16T18:38:52.598937] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T18:38:52.742785] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-16T18:38:52.946882] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:38:52.950293] [INFO ] [REMOTE ] EG: Full fetch complete (43191 records). [2025-10-16T18:38:52.950381] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-16T18:38:53.301343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T18:38:53.359414] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-16T18:38:53.359524] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-16T18:38:53.360471] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-16T18:38:53.360542] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-16T18:38:53.361734] [DEBUG] [LOCAL ] EG: Trimmed 43191 records to 27993 (keeping 200 days of data) [2025-10-16T18:38:53.541212] [DEBUG] [LOCAL ] EG: Primary data saved (27993 records). [2025-10-16T18:38:53.541374] [INFO ] [MAIN ] EG: Full history saved. [2025-10-16T18:38:53.541474] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EG took 42.7s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-16T18:38:53.552582] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-16T18:38:53.718790] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:53.718959] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-10-16T18:38:53.718997] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-10-16T18:38:53.719133] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-16T18:38:53.719197] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-16T18:38:53.719246] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-16T18:38:53.719278] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-16T18:38:54.077035] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:54.316810] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:38:54.323541] [INFO ] [REMOTE ] EGO: Full fetch complete (74383 records). [2025-10-16T18:38:54.323732] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-16T18:38:54.354548] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-16T18:38:54.710260] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-16T18:38:54.710367] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-16T18:38:54.711313] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-16T18:38:54.711375] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-16T18:38:54.712732] [DEBUG] [LOCAL ] EGO: Trimmed 74383 records to 52116 (keeping 200 days of data) [2025-10-16T18:38:54.846438] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:38:55.051103] [DEBUG] [LOCAL ] EGO: Primary data saved (52116 records). [2025-10-16T18:38:55.051251] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-16T18:38:55.051335] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGO took 43.8s. Estimated remaining: 3h 51m 27s. Rate: 7.2 symbols/min [2025-10-16T18:38:55.148482] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-16T18:38:55.218137] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:38:55.230524] [DEBUG] [LOCAL ] EHI: Loaded 10605 existing records from primary storage. [2025-10-16T18:38:55.230786] [INFO ] [MAIN ] EHI: Loaded 10605 existing records. [2025-10-16T18:38:55.404372] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:38:55.404614] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-16T18:38:55.404692] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-16T18:38:55.404853] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-16T18:38:55.404891] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-16T18:38:55.698436] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:38:55.779450] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:38:55.942822] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-16T18:38:56.444604] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T18:38:56.742815] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-16T18:38:56.959994] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:38:57.542811] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-16T18:38:58.126446] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:38:58.342804] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-16T18:38:58.895408] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:38:59.142809] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-16T18:38:59.942789] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-16T18:38:59.978756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-16T18:39:00.076571] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:39:00.742805] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-16T18:39:00.847774] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:39:01.542855] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-16T18:39:01.667948] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:39:02.342829] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-16T18:39:03.085107] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:39:03.142823] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-16T18:39:03.557863] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:39:03.583303] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:39:03.942818] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-16T18:39:04.742820] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-16T18:39:05.185820] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:39:05.542797] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-16T18:39:06.145941] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:39:06.171766] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T18:39:06.342868] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-16T18:39:07.123333] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:39:07.142769] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-16T18:39:07.859112] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T18:39:07.942772] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-16T18:39:08.719539] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T18:39:08.742790] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-16T18:39:09.542852] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-16T18:39:09.634935] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T18:39:10.342818] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-16T18:39:10.520979] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T18:39:11.142896] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-16T18:39:11.942845] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-16T18:39:11.990266] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T18:39:11.995993] [INFO ] [REMOTE ] EGY: Full fetch complete (61039 records). [2025-10-16T18:39:11.996172] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-16T18:39:12.555409] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-16T18:39:12.555617] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-16T18:39:12.556995] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-16T18:39:12.557110] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-16T18:39:12.558791] [DEBUG] [LOCAL ] EGY: Trimmed 61039 records to 41864 (keeping 200 days of data) [2025-10-16T18:39:12.694930] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T18:39:12.700484] [INFO ] [REMOTE ] EHI: Full fetch complete (16095 records). [2025-10-16T18:39:12.701103] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-16T18:39:12.743895] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-16T18:39:13.208989] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:39:13.265295] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-16T18:39:13.265738] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-16T18:39:13.266469] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-16T18:39:13.267632] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-16T18:39:13.270348] [DEBUG] [LOCAL ] EHI: Trimmed 16095 records to 10710 (keeping 200 days of data) [2025-10-16T18:39:13.366837] [DEBUG] [LOCAL ] EGY: Primary data saved (41864 records). [2025-10-16T18:39:13.366912] [DEBUG] [LOCAL ] EHI: Primary data saved (10710 records). [2025-10-16T18:39:13.367079] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-16T18:39:13.367190] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EGY took 43.7s. Estimated remaining: 3h 51m 42s. Rate: 7.2 symbols/min [2025-10-16T18:39:13.367275] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-16T18:39:13.378840] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHI took 18.3s. Estimated remaining: 3h 51m 14s. Rate: 7.2 symbols/min [2025-10-16T18:39:13.545793] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-16T18:39:13.646031] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:13.723070] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:13.723562] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-16T18:39:13.723709] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-16T18:39:13.723901] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-16T18:39:13.723963] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-16T18:39:13.724016] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-16T18:39:13.724056] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-16T18:39:13.933790] [DEBUG] [LOCAL ] EIC: Loaded 22908 existing records from primary storage. [2025-10-16T18:39:13.983206] [INFO ] [MAIN ] EIC: Loaded 22908 existing records. [2025-10-16T18:39:14.073629] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:39:14.319223] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:14.314287] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:14.319680] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-16T18:39:14.319768] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-16T18:39:14.319953] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-16T18:39:14.319992] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-16T18:39:14.349824] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-16T18:39:14.675767] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:15.142797] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-16T18:39:15.211009] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:39:15.565252] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:39:15.567284] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T18:39:15.942817] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-16T18:39:16.742793] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-16T18:39:17.077848] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T18:39:17.166448] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:39:17.542791] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-16T18:39:18.342785] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-16T18:39:18.662101] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T18:39:19.142821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-16T18:39:19.457216] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-16T18:39:19.474371] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:39:19.942838] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-16T18:39:20.742820] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-16T18:39:21.082913] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T18:39:21.542822] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-16T18:39:21.923400] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T18:39:22.335610] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:39:22.339353] [INFO ] [REMOTE ] EHAB: Full fetch complete (40939 records). [2025-10-16T18:39:22.339572] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-16T18:39:22.352688] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-16T18:39:22.753282] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-16T18:39:22.753402] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-16T18:39:22.754490] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-16T18:39:22.754561] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-16T18:39:22.756087] [DEBUG] [LOCAL ] EHAB: Trimmed 40939 records to 29476 (keeping 200 days of data) [2025-10-16T18:39:22.937348] [DEBUG] [LOCAL ] EHAB: Primary data saved (29476 records). [2025-10-16T18:39:22.937551] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-16T18:39:22.937680] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHAB took 32.3s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-16T18:39:23.115756] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:23.116026] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-16T18:39:23.116079] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-16T18:39:23.116204] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-16T18:39:23.116245] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-16T18:39:23.116287] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-16T18:39:23.116319] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-16T18:39:23.148066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-16T18:39:23.492828] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:23.507794] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:39:23.942813] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-16T18:39:24.660002] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:39:24.742823] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-16T18:39:24.950070] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T18:39:25.542881] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-16T18:39:26.009793] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T18:39:26.342840] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-16T18:39:26.492251] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:39:27.142823] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-16T18:39:27.560563] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:39:27.770507] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T18:39:27.942817] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-16T18:39:28.742815] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-16T18:39:29.113740] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-16T18:39:29.230901] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T18:39:29.542812] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-16T18:39:30.342859] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-16T18:39:30.624922] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-16T18:39:30.669914] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T18:39:31.142821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-16T18:39:31.476898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T18:39:31.942930] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-16T18:39:32.742802] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-16T18:39:33.045980] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:39:33.148903] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T18:39:33.542849] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-16T18:39:33.890873] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-16T18:39:34.342817] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-16T18:39:34.661606] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-16T18:39:35.142825] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-16T18:39:35.942852] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-16T18:39:36.389946] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T18:39:36.742918] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-16T18:39:37.048121] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:39:37.155630] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T18:39:37.542830] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-16T18:39:38.342824] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-16T18:39:38.752477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-16T18:39:38.755004] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:39:38.762698] [INFO ] [REMOTE ] EHC: Full fetch complete (58844 records). [2025-10-16T18:39:38.762879] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-16T18:39:39.132116] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-16T18:39:39.132193] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-16T18:39:39.132976] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-16T18:39:39.133041] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-16T18:39:39.134178] [DEBUG] [LOCAL ] EHC: Trimmed 58844 records to 41314 (keeping 200 days of data) [2025-10-16T18:39:39.188339] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-16T18:39:39.394171] [DEBUG] [LOCAL ] EHC: Primary data saved (41314 records). [2025-10-16T18:39:39.394329] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-16T18:39:39.394448] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EHC took 45.9s. Estimated remaining: 3h 51m 19s. Rate: 7.2 symbols/min [2025-10-16T18:39:39.564747] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:39.564932] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-16T18:39:39.564969] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-16T18:39:39.565081] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-16T18:39:39.565121] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-16T18:39:39.565161] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-16T18:39:39.565193] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-16T18:39:39.814381] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T18:39:39.833298] [INFO ] [REMOTE ] EICA: Full fetch complete (1284 records). [2025-10-16T18:39:39.835503] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-16T18:39:39.943729] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-16T18:39:40.020805] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:40.099891] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-16T18:39:40.100088] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:39:40.100157] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:39:40.100210] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-16T18:39:40.100284] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-16T18:39:40.100372] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-16T18:39:40.100441] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-16T18:39:40.100501] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICA took 26.7s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-16T18:39:40.268148] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:40.289031] [DEBUG] [LOCAL ] EIG: Loaded 20221 existing records from primary storage. [2025-10-16T18:39:40.289333] [INFO ] [MAIN ] EIG: Loaded 20221 existing records. [2025-10-16T18:39:40.463366] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:40.463621] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-16T18:39:40.463706] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-16T18:39:40.463934] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-16T18:39:40.463989] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-16T18:39:40.565309] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T18:39:40.748034] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-16T18:39:40.825064] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:41.542805] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-16T18:39:41.733294] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:39:42.172401] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T18:39:42.342810] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-16T18:39:43.142843] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-16T18:39:43.296357] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T18:39:43.752227] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T18:39:43.942798] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-16T18:39:44.742798] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-16T18:39:44.974049] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:39:45.011812] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-16T18:39:45.542821] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-16T18:39:45.950380] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:39:46.342849] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-16T18:39:46.847466] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T18:39:47.142835] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-16T18:39:47.942842] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-16T18:39:48.022856] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T18:39:48.742805] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-16T18:39:48.936140] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T18:39:48.938874] [INFO ] [REMOTE ] EIC: Full fetch complete (34411 records). [2025-10-16T18:39:48.938951] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-16T18:39:49.321130] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-16T18:39:49.321212] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-16T18:39:49.321934] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-16T18:39:49.321999] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-16T18:39:49.322851] [DEBUG] [LOCAL ] EIC: Trimmed 34411 records to 23019 (keeping 200 days of data) [2025-10-16T18:39:49.465232] [DEBUG] [LOCAL ] EIC: Primary data saved (23019 records). [2025-10-16T18:39:49.465370] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-16T18:39:49.465476] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 36.1s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-16T18:39:49.550537] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-16T18:39:49.640104] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:49.654088] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T18:39:49.702702] [DEBUG] [LOCAL ] EIX: Loaded 53375 existing records from primary storage. [2025-10-16T18:39:49.703024] [INFO ] [MAIN ] EIX: Loaded 53375 existing records. [2025-10-16T18:39:49.878371] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:39:49.878571] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-16T18:39:49.878662] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-16T18:39:49.879577] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-16T18:39:49.879634] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-16T18:39:50.156047] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T18:39:50.231809] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:39:50.342774] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-16T18:39:51.142822] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-16T18:39:51.672808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:39:51.942787] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-16T18:39:52.076116] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:39:52.401182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T18:39:52.742805] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-16T18:39:53.281115] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-16T18:39:53.542826] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-16T18:39:53.990960] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:39:54.342814] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-16T18:39:54.947968] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:39:55.142827] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-16T18:39:55.815323] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-16T18:39:55.942807] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-16T18:39:56.742811] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-16T18:39:57.149270] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-16T18:39:57.542796] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-16T18:39:57.803212] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T18:39:58.342816] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-16T18:39:58.474772] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T18:39:59.142866] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-16T18:39:59.509079] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-16T18:39:59.509958] [INFO ] [REMOTE ] EICB: Full fetch complete (2728 records). [2025-10-16T18:39:59.510026] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-16T18:39:59.686145] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T18:39:59.686389] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:39:59.686468] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:39:59.686525] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-16T18:39:59.686601] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-16T18:39:59.686695] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-16T18:39:59.686768] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-16T18:39:59.686846] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 36.7s. Estimated remaining: 3h 50m 43s. Rate: 7.2 symbols/min [2025-10-16T18:39:59.878800] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:39:59.930212] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-16T18:39:59.930504] [INFO ] [MAIN ] EL: Loaded 53376 existing records. [2025-10-16T18:39:59.950993] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-16T18:40:00.132218] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:00.140325] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-16T18:40:00.149395] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-16T18:40:00.149720] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-16T18:40:00.150118] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-16T18:40:00.151016] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T18:40:00.517044] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:00.742784] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-16T18:40:01.085771] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:40:01.542816] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-16T18:40:02.342876] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-16T18:40:03.087798] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:40:03.141090] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-16T18:40:03.151234] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-16T18:40:03.641753] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T18:40:03.942813] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-16T18:40:04.729927] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-16T18:40:04.742766] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-16T18:40:05.542888] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-16T18:40:05.883606] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T18:40:06.265950] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T18:40:06.342811] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-16T18:40:06.814841] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-16T18:40:07.142815] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-16T18:40:07.942801] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-16T18:40:08.121172] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T18:40:08.676372] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T18:40:08.742795] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-16T18:40:08.921043] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T18:40:09.542814] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-16T18:40:10.342847] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-16T18:40:10.671415] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-16T18:40:10.933359] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T18:40:11.142866] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-16T18:40:11.746026] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:40:11.942782] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-16T18:40:12.742793] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-16T18:40:12.992214] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:40:13.334571] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-16T18:40:13.542819] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-16T18:40:14.342792] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-16T18:40:14.751158] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:40:15.142821] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-16T18:40:15.543223] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:40:15.545629] [INFO ] [REMOTE ] EIG: Full fetch complete (27162 records). [2025-10-16T18:40:15.545769] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-16T18:40:15.917686] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-16T18:40:15.918045] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-16T18:40:15.918759] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-16T18:40:15.918820] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-16T18:40:15.919637] [DEBUG] [LOCAL ] EIG: Trimmed 27162 records to 20357 (keeping 200 days of data) [2025-10-16T18:40:15.974454] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-16T18:40:16.054381] [DEBUG] [LOCAL ] EIG: Primary data saved (20357 records). [2025-10-16T18:40:16.054516] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-16T18:40:16.054590] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 36.0s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-16T18:40:16.589425] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-16T18:40:16.646430] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-10-16T18:40:16.742828] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-16T18:40:16.929375] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T18:40:17.542844] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-16T18:40:18.342813] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-16T18:40:18.516460] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:40:18.980347] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:40:18.981874] [INFO ] [REMOTE ] EICC: Full fetch complete (8472 records). [2025-10-16T18:40:18.981944] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-16T18:40:18.982334] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:40:18.982415] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:40:18.982476] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:40:18.982560] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-16T18:40:18.982637] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-16T18:40:18.982733] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-16T18:40:18.982796] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-16T18:40:18.982869] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EICC took 39.6s. Estimated remaining: 3h 50m 32s. Rate: 7.2 symbols/min [2025-10-16T18:40:19.143099] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-16T18:40:19.317745] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:40:19.942869] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-16T18:40:20.928012] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T18:40:20.937501] [INFO ] [REMOTE ] EIX: Full fetch complete (77423 records). [2025-10-16T18:40:20.937725] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-16T18:40:21.386792] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-16T18:40:21.441487] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-16T18:40:21.441591] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-16T18:40:21.442676] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-16T18:40:21.442820] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-16T18:40:21.443379] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-16T18:40:21.445383] [DEBUG] [LOCAL ] EIX: Trimmed 77423 records to 53763 (keeping 200 days of data) [2025-10-16T18:40:21.777363] [DEBUG] [LOCAL ] EIX: Primary data saved (53763 records). [2025-10-16T18:40:21.777507] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-16T18:40:21.777589] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.3s. Estimated remaining: 3h 50m 11s. Rate: 7.2 symbols/min [2025-10-16T18:40:23.500485] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T18:40:23.511676] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-16T18:40:25.276860] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T18:40:25.288012] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-16T18:40:25.776398] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:40:25.783176] [INFO ] [REMOTE ] EL: Full fetch complete (77435 records). [2025-10-16T18:40:25.783301] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-16T18:40:26.182013] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-16T18:40:26.182135] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-16T18:40:26.183571] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-16T18:40:26.183686] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-16T18:40:26.185861] [DEBUG] [LOCAL ] EL: Trimmed 77435 records to 53766 (keeping 200 days of data) [2025-10-16T18:40:26.511107] [DEBUG] [LOCAL ] EL: Primary data saved (53766 records). [2025-10-16T18:40:26.511250] [INFO ] [MAIN ] EL: Full history saved. [2025-10-16T18:40:26.511986] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 26.8s. Estimated remaining: 3h 49m 54s. Rate: 7.2 symbols/min [2025-10-16T18:40:27.143243] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.200393] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.198869] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.256354] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:27.262536] [DEBUG] [LOCAL ] ELC: Loaded 3506 existing records from primary storage. [2025-10-16T18:40:27.262957] [INFO ] [MAIN ] ELC: Loaded 3506 existing records. [2025-10-16T18:40:27.486744] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:27.498394] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-16T18:40:27.498635] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-16T18:40:27.499488] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-16T18:40:27.499427] [DEBUG] [LOCAL ] ELME: Loaded 39404 existing records from primary storage. [2025-10-16T18:40:27.499709] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-16T18:40:27.534627] [INFO ] [MAIN ] ELME: Loaded 39404 existing records. [2025-10-16T18:40:27.602395] [DEBUG] [LOCAL ] ELF: Loaded 52028 existing records from primary storage. [2025-10-16T18:40:27.661506] [DEBUG] [LOCAL ] ELAN: Loaded 53301 existing records from primary storage. [2025-10-16T18:40:27.691722] [INFO ] [MAIN ] ELF: Loaded 52028 existing records. [2025-10-16T18:40:27.700287] [INFO ] [MAIN ] ELAN: Loaded 53301 existing records. [2025-10-16T18:40:28.216215] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.312966] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.325695] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-16T18:40:28.353041] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.358861] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:28.364762] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-16T18:40:28.370240] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.375496] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-16T18:40:28.380714] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-16T18:40:28.364850] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-16T18:40:28.418248] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-16T18:40:28.502706] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-16T18:40:28.488930] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:28.508156] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-16T18:40:28.508405] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-16T18:40:28.502786] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-16T18:40:28.513866] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-16T18:40:29.346159] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.388185] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-16T18:40:29.433218] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:40:29.455800] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-16T18:40:29.567443] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.546226] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:29.568276] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-16T18:40:29.568601] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-16T18:40:30.056851] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-16T18:40:30.058394] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-16T18:40:30.532292] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T18:40:30.533579] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-16T18:40:30.871924] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:40:30.880499] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-16T18:40:30.923842] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T18:40:30.925320] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-16T18:40:31.186871] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:40:31.197409] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-16T18:40:31.323225] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:40:31.336137] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-16T18:40:31.537635] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T18:40:31.933621] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:40:31.942773] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-16T18:40:32.644417] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:40:32.742771] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-16T18:40:33.051090] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T18:40:33.159246] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T18:40:33.542869] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-16T18:40:34.132095] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:40:34.342870] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-16T18:40:35.021105] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T18:40:35.142807] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-16T18:40:35.942816] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-16T18:40:36.179301] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-16T18:40:36.269907] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:40:36.742850] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-16T18:40:37.313881] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T18:40:37.542881] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-16T18:40:37.774471] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T18:40:38.342884] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-16T18:40:38.900727] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T18:40:39.142788] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-16T18:40:39.698463] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-16T18:40:39.942845] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-16T18:40:40.532344] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T18:40:40.656572] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-16T18:40:40.742798] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-16T18:40:41.287425] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:40:41.542807] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-16T18:40:42.342809] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-16T18:40:42.891983] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T18:40:43.142809] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-16T18:40:43.753029] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-16T18:40:43.942893] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-16T18:40:44.674469] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:40:44.742794] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-16T18:40:45.542839] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-16T18:40:45.681171] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T18:40:46.274041] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:40:46.342778] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-16T18:40:46.557733] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:40:47.142837] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-16T18:40:47.789021] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T18:40:47.942812] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-16T18:40:48.742844] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-16T18:40:49.127016] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T18:40:49.542848] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-16T18:40:49.652919] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:40:49.924131] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:40:50.107907] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-16T18:40:50.108864] [INFO ] [REMOTE ] ELC: Full fetch complete (5025 records). [2025-10-16T18:40:50.108936] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-16T18:40:50.348026] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-16T18:40:50.468588] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-16T18:40:50.468714] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-16T18:40:50.468870] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-16T18:40:50.468910] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-16T18:40:50.469256] [DEBUG] [LOCAL ] ELC: Trimmed 5025 records to 3525 (keeping 200 days of data) [2025-10-16T18:40:50.490102] [DEBUG] [LOCAL ] ELC: Primary data saved (3525 records). [2025-10-16T18:40:50.490174] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-16T18:40:50.490272] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 24.0s. Estimated remaining: 3h 50m 21s. Rate: 7.2 symbols/min [2025-10-16T18:40:50.656232] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:50.679792] [DEBUG] [LOCAL ] ELP: Loaded 25680 existing records from primary storage. [2025-10-16T18:40:50.680041] [INFO ] [MAIN ] ELP: Loaded 25680 existing records. [2025-10-16T18:40:50.854495] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:40:50.854691] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-16T18:40:50.854747] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-16T18:40:50.855199] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-16T18:40:50.855255] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-16T18:40:51.148042] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-16T18:40:51.208524] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:51.942830] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-16T18:40:52.156678] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:40:52.594885] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:40:52.742820] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-16T18:40:52.960604] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:40:53.542861] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-16T18:40:53.876027] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:40:53.880885] [INFO ] [REMOTE ] ELME: Full fetch complete (55839 records). [2025-10-16T18:40:53.880968] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-16T18:40:53.881547] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:40:53.881630] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:40:53.881708] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:40:53.881758] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-16T18:40:53.881812] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-16T18:40:53.881846] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-16T18:40:53.882008] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-16T18:40:53.882091] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELME took 27.4s. Estimated remaining: 3h 50m 1s. Rate: 7.2 symbols/min [2025-10-16T18:40:54.047069] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:40:54.047244] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-16T18:40:54.047280] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-16T18:40:54.047385] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-16T18:40:54.047425] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-16T18:40:54.047464] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-16T18:40:54.047496] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-16T18:40:54.347901] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-16T18:40:54.405510] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:40:55.142842] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-16T18:40:55.373557] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T18:40:55.942790] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-16T18:40:56.238435] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T18:40:56.742809] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-16T18:40:56.786341] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-16T18:40:57.542826] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-16T18:40:57.724135] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T18:40:57.904636] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:40:58.342880] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-16T18:40:58.789529] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T18:40:59.142885] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-16T18:40:59.440249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:40:59.942868] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-16T18:41:00.742818] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-16T18:41:00.843776] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-16T18:41:00.850709] [INFO ] [REMOTE ] ELAN: Full fetch complete (77068 records). [2025-10-16T18:41:00.850846] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-16T18:41:01.242175] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-16T18:41:01.242291] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-16T18:41:01.243340] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-16T18:41:01.243406] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-16T18:41:01.245021] [DEBUG] [LOCAL ] ELAN: Trimmed 77068 records to 53690 (keeping 200 days of data) [2025-10-16T18:41:01.547133] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-16T18:41:01.565496] [DEBUG] [LOCAL ] ELAN: Primary data saved (53690 records). [2025-10-16T18:41:01.565614] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-16T18:41:01.565721] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELAN took 35.1s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-16T18:41:01.738019] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:01.784785] [DEBUG] [LOCAL ] ELS: Loaded 49862 existing records from primary storage. [2025-10-16T18:41:01.785319] [INFO ] [MAIN ] ELS: Loaded 49862 existing records. [2025-10-16T18:41:01.983499] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:01.983923] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-16T18:41:01.984105] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-16T18:41:01.984385] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-16T18:41:01.984567] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-16T18:41:02.096570] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:41:02.249904] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-16T18:41:02.251435] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T18:41:02.344040] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-16T18:41:02.453858] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:03.142856] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-16T18:41:03.483511] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-16T18:41:03.692676] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:41:03.942827] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-16T18:41:04.742861] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-16T18:41:05.542840] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-16T18:41:06.018419] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:41:06.024844] [INFO ] [REMOTE ] ELF: Full fetch complete (75507 records). [2025-10-16T18:41:06.024963] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-16T18:41:06.346907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-16T18:41:06.440182] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-16T18:41:06.440335] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-16T18:41:06.441524] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-16T18:41:06.441692] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-16T18:41:06.469285] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:41:06.468003] [DEBUG] [LOCAL ] ELF: Trimmed 75507 records to 52376 (keeping 200 days of data) [2025-10-16T18:41:06.775614] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T18:41:06.800131] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T18:41:06.821359] [DEBUG] [LOCAL ] ELF: Primary data saved (52376 records). [2025-10-16T18:41:06.821466] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-16T18:41:06.821536] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELF took 40.3s. Estimated remaining: 3h 49m 36s. Rate: 7.2 symbols/min [2025-10-16T18:41:06.989084] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:07.054627] [DEBUG] [LOCAL ] ELV: Loaded 50691 existing records from primary storage. [2025-10-16T18:41:07.054974] [INFO ] [MAIN ] ELV: Loaded 50691 existing records. [2025-10-16T18:41:07.150091] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-16T18:41:07.232203] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:07.232667] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-16T18:41:07.232815] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-16T18:41:07.233035] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-16T18:41:07.233090] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-16T18:41:07.509347] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T18:41:07.586188] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:07.942811] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-16T18:41:08.742804] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-16T18:41:09.542963] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-16T18:41:09.788230] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T18:41:09.883517] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:41:09.913141] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:41:10.342919] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-16T18:41:11.142914] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-16T18:41:11.411496] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-16T18:41:11.942819] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-16T18:41:12.153626] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T18:41:12.216406] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-16T18:41:12.742832] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-16T18:41:13.542820] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-16T18:41:13.817971] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-16T18:41:14.163046] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:41:14.342827] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-16T18:41:15.142826] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-16T18:41:15.942800] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-16T18:41:16.010220] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:41:16.234905] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-16T18:41:16.746852] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-16T18:41:16.763902] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:41:17.150846] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T18:41:17.152055] [INFO ] [REMOTE ] ELPC: Full fetch complete (1394 records). [2025-10-16T18:41:17.152430] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-16T18:41:17.328781] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-16T18:41:17.328999] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:41:17.329071] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:41:17.329144] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-16T18:41:17.329209] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-16T18:41:17.329246] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-16T18:41:17.329287] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-16T18:41:17.329346] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELPC took 23.4s. Estimated remaining: 3h 49m 33s. Rate: 7.2 symbols/min [2025-10-16T18:41:17.498342] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:17.498555] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-16T18:41:17.498630] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-16T18:41:17.498766] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-16T18:41:17.498808] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-16T18:41:17.498848] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-16T18:41:17.498879] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-16T18:41:17.549754] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-16T18:41:17.845932] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:18.342820] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-16T18:41:18.542209] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:41:18.542508] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-16T18:41:18.542633] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:41:18.542729] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-16T18:41:18.542805] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:41:18.542875] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-16T18:41:18.542938] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-16T18:41:18.542974] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-16T18:41:18.543011] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-16T18:41:18.543056] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 1.2s. Estimated remaining: 3h 49m 8s. Rate: 7.2 symbols/min [2025-10-16T18:41:18.719253] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:18.740278] [DEBUG] [LOCAL ] EMD: Loaded 20863 existing records from primary storage. [2025-10-16T18:41:18.740520] [INFO ] [MAIN ] EMD: Loaded 20863 existing records. [2025-10-16T18:41:18.913550] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:18.913770] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-16T18:41:18.913819] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-16T18:41:18.913999] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-16T18:41:18.914038] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-16T18:41:19.147922] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-16T18:41:19.296100] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:19.364899] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:41:19.942846] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-16T18:41:20.597296] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:41:20.742799] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-16T18:41:21.542875] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-16T18:41:21.785333] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:41:22.112750] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:41:22.237244] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T18:41:22.342810] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-16T18:41:23.142786] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-16T18:41:23.487546] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T18:41:23.942812] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-16T18:41:24.742824] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-16T18:41:24.961611] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:41:25.006893] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:41:25.542793] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-16T18:41:25.887896] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T18:41:26.342814] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-16T18:41:27.143782] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-16T18:41:27.148599] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T18:41:27.681208] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:41:27.854826] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-16T18:41:27.942826] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-16T18:41:28.742815] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-16T18:41:29.038713] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:41:29.042268] [INFO ] [REMOTE ] ELP: Full fetch complete (36894 records). [2025-10-16T18:41:29.042379] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-16T18:41:29.437191] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-16T18:41:29.437270] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-16T18:41:29.437916] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-16T18:41:29.437977] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-16T18:41:29.438852] [DEBUG] [LOCAL ] ELP: Trimmed 36894 records to 25881 (keeping 200 days of data) [2025-10-16T18:41:29.544063] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-16T18:41:29.589780] [DEBUG] [LOCAL ] ELP: Primary data saved (25881 records). [2025-10-16T18:41:29.589945] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-16T18:41:29.590046] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELP took 39.1s. Estimated remaining: 3h 49m 6s. Rate: 7.2 symbols/min [2025-10-16T18:41:29.764569] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:41:29.836081] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:29.870614] [DEBUG] [LOCAL ] EME: Loaded 30952 existing records from primary storage. [2025-10-16T18:41:29.870995] [INFO ] [MAIN ] EME: Loaded 30952 existing records. [2025-10-16T18:41:30.045921] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:30.046172] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-16T18:41:30.046219] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-16T18:41:30.046421] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-16T18:41:30.046477] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-16T18:41:30.354464] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-16T18:41:30.394696] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:31.142870] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-16T18:41:31.803757] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:41:31.942802] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-16T18:41:32.211280] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-16T18:41:32.262169] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:41:32.742830] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-16T18:41:33.542795] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-16T18:41:33.653277] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:41:34.263157] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:41:34.342826] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-16T18:41:34.520067] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:41:35.142837] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-16T18:41:35.942783] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-16T18:41:35.985421] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:41:36.326097] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:41:36.747903] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-16T18:41:36.754704] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T18:41:37.542841] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-16T18:41:38.342934] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-16T18:41:38.503682] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:41:38.575797] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T18:41:39.142802] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-16T18:41:39.735709] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T18:41:39.942818] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-16T18:41:40.742834] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-16T18:41:40.772905] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-16T18:41:41.150799] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T18:41:41.157290] [INFO ] [REMOTE ] ELV: Full fetch complete (73272 records). [2025-10-16T18:41:41.157403] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-16T18:41:41.541038] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-16T18:41:41.541114] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-16T18:41:41.542018] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-16T18:41:41.542080] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-16T18:41:41.542803] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-16T18:41:41.544376] [DEBUG] [LOCAL ] ELV: Trimmed 73272 records to 51042 (keeping 200 days of data) [2025-10-16T18:41:41.867142] [DEBUG] [LOCAL ] ELV: Primary data saved (51042 records). [2025-10-16T18:41:41.867251] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-16T18:41:41.867332] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELV took 35.0s. Estimated remaining: 3h 49m 6s. Rate: 7.2 symbols/min [2025-10-16T18:41:42.035227] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:42.041320] [DEBUG] [LOCAL ] EMF: Loaded 3211 existing records from primary storage. [2025-10-16T18:41:42.041468] [INFO ] [MAIN ] EMF: Loaded 3211 existing records. [2025-10-16T18:41:42.215140] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:42.215368] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-16T18:41:42.215439] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-16T18:41:42.215673] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-16T18:41:42.215748] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-16T18:41:42.313688] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T18:41:42.347882] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-16T18:41:42.591417] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:43.073441] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T18:41:43.142775] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-16T18:41:43.762808] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:41:43.942829] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-16T18:41:44.742796] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-16T18:41:44.886729] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-16T18:41:44.910426] [INFO ] [REMOTE ] ELS: Full fetch complete (71209 records). [2025-10-16T18:41:44.910588] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-16T18:41:44.911799] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T18:41:45.294988] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-16T18:41:45.295062] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-16T18:41:45.295948] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-16T18:41:45.296009] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-16T18:41:45.297284] [DEBUG] [LOCAL ] ELS: Trimmed 71209 records to 50226 (keeping 200 days of data) [2025-10-16T18:41:45.564794] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-16T18:41:45.602774] [DEBUG] [LOCAL ] ELS: Primary data saved (50226 records). [2025-10-16T18:41:45.602916] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-16T18:41:45.603415] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. ELS took 44.0s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-16T18:41:45.766150] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:45.815234] [DEBUG] [LOCAL ] EMN: Loaded 50780 existing records from primary storage. [2025-10-16T18:41:45.815558] [INFO ] [MAIN ] EMN: Loaded 50780 existing records. [2025-10-16T18:41:45.985446] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:45.985725] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-16T18:41:45.985779] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-16T18:41:45.986008] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-16T18:41:45.986063] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-16T18:41:46.340666] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:46.350374] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-16T18:41:46.368148] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:41:46.678530] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:41:47.142823] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-16T18:41:47.885089] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T18:41:47.917386] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-16T18:41:47.942771] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-16T18:41:48.652306] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:41:48.742855] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-16T18:41:49.542868] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-16T18:41:50.267387] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:41:50.266852] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T18:41:50.342870] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-16T18:41:51.143005] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-16T18:41:51.934724] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:41:51.944706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-16T18:41:51.949188] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T18:41:52.742859] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-16T18:41:53.542826] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-16T18:41:53.884780] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:41:54.342816] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-16T18:41:54.970916] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-16T18:41:55.150608] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-16T18:41:55.155839] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:41:55.565754] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:41:55.651570] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (3.71 seconds). [2025-10-16T18:41:55.654731] [INFO ] [REMOTE ] EMD: Full fetch complete (32118 records). [2025-10-16T18:41:55.654820] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-16T18:41:55.947919] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-16T18:41:56.064124] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-16T18:41:56.064200] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-16T18:41:56.064850] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-16T18:41:56.064910] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-16T18:41:56.065637] [DEBUG] [LOCAL ] EMD: Trimmed 32118 records to 21065 (keeping 200 days of data) [2025-10-16T18:41:56.191570] [DEBUG] [LOCAL ] EMD: Primary data saved (21065 records). [2025-10-16T18:41:56.191723] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-16T18:41:56.191808] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMD took 37.6s. Estimated remaining: 3h 48m 44s. Rate: 7.2 symbols/min [2025-10-16T18:41:56.356117] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:41:56.370720] [DEBUG] [LOCAL ] EMO: Loaded 13265 existing records from primary storage. [2025-10-16T18:41:56.370945] [INFO ] [MAIN ] EMO: Loaded 13265 existing records. [2025-10-16T18:41:56.543622] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:41:56.543836] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-16T18:41:56.543886] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-16T18:41:56.544036] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-16T18:41:56.544074] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-16T18:41:56.747912] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-16T18:41:56.899873] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:41:57.252904] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T18:41:57.542843] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-16T18:41:58.229764] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:41:58.302989] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T18:41:58.342894] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-16T18:41:59.142832] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-16T18:41:59.944824] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-16T18:41:59.950204] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:41:59.978599] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:42:00.339619] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-16T18:42:00.742771] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-16T18:42:01.450343] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T18:42:01.542805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-16T18:42:02.141592] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:42:02.342831] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-16T18:42:03.142865] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-16T18:42:03.478418] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-16T18:42:03.947459] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-16T18:42:03.951181] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T18:42:04.742866] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-16T18:42:05.401600] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:42:05.405722] [INFO ] [REMOTE ] EME: Full fetch complete (47125 records). [2025-10-16T18:42:05.405847] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-16T18:42:05.527160] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:42:05.545992] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-16T18:42:05.791393] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-16T18:42:05.791468] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-16T18:42:05.792164] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-16T18:42:05.792226] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-16T18:42:05.793169] [DEBUG] [LOCAL ] EME: Trimmed 47125 records to 31206 (keeping 200 days of data) [2025-10-16T18:42:05.985233] [DEBUG] [LOCAL ] EME: Primary data saved (31206 records). [2025-10-16T18:42:05.985367] [INFO ] [MAIN ] EME: Full history saved. [2025-10-16T18:42:05.985460] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EME took 36.4s. Estimated remaining: 3h 48m 39s. Rate: 7.2 symbols/min [2025-10-16T18:42:06.160681] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:06.165885] [DEBUG] [LOCAL ] EMP: Loaded 3037 existing records from primary storage. [2025-10-16T18:42:06.166178] [INFO ] [MAIN ] EMP: Loaded 3037 existing records. [2025-10-16T18:42:06.241305] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T18:42:06.350151] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-16T18:42:06.350073] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:06.351149] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-16T18:42:06.351203] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-16T18:42:06.351337] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-16T18:42:06.351374] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-16T18:42:06.706031] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:07.112475] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:42:07.142808] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-16T18:42:07.942826] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-16T18:42:08.044598] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T18:42:08.630920] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T18:42:08.631920] [INFO ] [REMOTE ] EMF: Full fetch complete (6447 records). [2025-10-16T18:42:08.631988] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-16T18:42:08.747969] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-16T18:42:08.991287] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-16T18:42:08.991363] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-16T18:42:08.991556] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-16T18:42:08.991626] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-16T18:42:08.992046] [DEBUG] [LOCAL ] EMF: Trimmed 6447 records to 3235 (keeping 200 days of data) [2025-10-16T18:42:09.012204] [DEBUG] [LOCAL ] EMF: Primary data saved (3235 records). [2025-10-16T18:42:09.012335] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-16T18:42:09.012418] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMF took 27.1s. Estimated remaining: 3h 48m 18s. Rate: 7.2 symbols/min [2025-10-16T18:42:09.193087] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:09.245537] [DEBUG] [LOCAL ] EMR: Loaded 53206 existing records from primary storage. [2025-10-16T18:42:09.245908] [INFO ] [MAIN ] EMR: Loaded 53206 existing records. [2025-10-16T18:42:09.419842] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:09.420058] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-16T18:42:09.420120] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-16T18:42:09.420315] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-16T18:42:09.420352] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-16T18:42:09.557006] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-16T18:42:09.797919] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:10.342867] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-16T18:42:10.583628] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-16T18:42:10.584293] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:42:11.142815] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-16T18:42:11.582604] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-16T18:42:11.942790] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-16T18:42:12.136738] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T18:42:12.390099] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T18:42:12.742933] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-16T18:42:13.542806] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-16T18:42:13.611872] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:42:14.342826] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-16T18:42:15.142820] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-16T18:42:15.313685] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:42:15.692375] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:42:15.942783] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-16T18:42:16.103340] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T18:42:16.742813] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-16T18:42:17.542791] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-16T18:42:17.601242] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:42:18.002695] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T18:42:18.131584] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T18:42:18.342828] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-16T18:42:18.771909] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T18:42:19.142843] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-16T18:42:19.942860] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-16T18:42:20.742840] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-16T18:42:21.055298] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:42:21.365311] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T18:42:21.384454] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T18:42:21.542844] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-16T18:42:22.342861] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-16T18:42:22.593822] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:42:23.142882] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-16T18:42:23.942819] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-16T18:42:24.114884] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T18:42:24.330422] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:42:24.332915] [INFO ] [REMOTE ] EMO: Full fetch complete (17751 records). [2025-10-16T18:42:24.332986] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-16T18:42:24.622133] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T18:42:24.697382] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-16T18:42:24.697454] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-16T18:42:24.697864] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-16T18:42:24.697926] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-16T18:42:24.698437] [DEBUG] [LOCAL ] EMO: Trimmed 17751 records to 13368 (keeping 200 days of data) [2025-10-16T18:42:24.755548] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-16T18:42:24.783060] [DEBUG] [LOCAL ] EMO: Primary data saved (13368 records). [2025-10-16T18:42:24.783196] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-16T18:42:24.783280] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMO took 28.6s. Estimated remaining: 3h 48m 26s. Rate: 7.2 symbols/min [2025-10-16T18:42:24.952507] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:25.007597] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-10-16T18:42:25.007963] [INFO ] [MAIN ] ENB: Loaded 53513 existing records. [2025-10-16T18:42:25.218756] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:25.219035] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-16T18:42:25.219089] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-16T18:42:25.219408] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-16T18:42:25.219478] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-16T18:42:25.544471] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-16T18:42:25.571621] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:25.954098] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:42:26.248853] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:42:26.342797] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-16T18:42:26.986638] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T18:42:27.142841] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-16T18:42:27.607055] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:42:27.942816] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-16T18:42:28.508597] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T18:42:28.742873] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-16T18:42:29.542848] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-16T18:42:30.230708] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T18:42:30.342807] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-16T18:42:30.934167] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:42:30.935012] [INFO ] [REMOTE ] EMP: Full fetch complete (4208 records). [2025-10-16T18:42:30.935082] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-16T18:42:31.144420] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-16T18:42:31.292311] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-16T18:42:31.292486] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-16T18:42:31.292637] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-16T18:42:31.292725] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-16T18:42:31.293074] [DEBUG] [LOCAL ] EMP: Trimmed 4208 records to 3045 (keeping 200 days of data) [2025-10-16T18:42:31.311632] [DEBUG] [LOCAL ] EMP: Primary data saved (3045 records). [2025-10-16T18:42:31.311741] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-16T18:42:31.311815] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMP took 25.3s. Estimated remaining: 3h 48m 14s. Rate: 7.2 symbols/min [2025-10-16T18:42:31.487741] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:31.523728] [DEBUG] [LOCAL ] ENIC: Loaded 36700 existing records from primary storage. [2025-10-16T18:42:31.524175] [INFO ] [MAIN ] ENIC: Loaded 36700 existing records. [2025-10-16T18:42:31.732227] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:31.733035] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-16T18:42:31.734871] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T18:42:31.734990] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-16T18:42:31.746356] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-16T18:42:31.746451] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-16T18:42:31.949746] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-16T18:42:32.105281] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:32.732686] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T18:42:32.742947] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-16T18:42:33.542773] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-16T18:42:33.604691] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T18:42:34.342818] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-16T18:42:34.578191] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-16T18:42:35.142819] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-16T18:42:35.233271] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:42:35.378824] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T18:42:35.942816] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-16T18:42:36.527162] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T18:42:36.742811] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-16T18:42:37.376792] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T18:42:37.383464] [INFO ] [REMOTE ] EMN: Full fetch complete (72376 records). [2025-10-16T18:42:37.383712] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-16T18:42:37.556806] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-16T18:42:37.776563] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-16T18:42:37.776688] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-16T18:42:37.777680] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-16T18:42:37.777743] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-16T18:42:37.779304] [DEBUG] [LOCAL ] EMN: Trimmed 72376 records to 51134 (keeping 200 days of data) [2025-10-16T18:42:38.085305] [DEBUG] [LOCAL ] EMN: Primary data saved (51134 records). [2025-10-16T18:42:38.085440] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-16T18:42:38.085918] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. EMN took 52.5s. Estimated remaining: 3h 48m 2s. Rate: 7.2 symbols/min [2025-10-16T18:42:38.254993] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:38.259570] [DEBUG] [LOCAL ] ENO: Loaded 1855 existing records from primary storage. [2025-10-16T18:42:38.259766] [INFO ] [MAIN ] ENO: Loaded 1855 existing records. [2025-10-16T18:42:38.358954] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-16T18:42:38.442030] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:38.442565] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-16T18:42:38.469714] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-16T18:42:38.473082] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-16T18:42:38.475040] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T18:42:38.473557] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-16T18:42:38.832864] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:39.142858] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-16T18:42:39.452038] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T18:42:39.573863] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:42:39.942839] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-16T18:42:40.742778] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-16T18:42:41.116477] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-16T18:42:41.197969] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T18:42:41.228208] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-16T18:42:41.542821] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-16T18:42:42.342791] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-16T18:42:42.996711] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T18:42:43.142810] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-16T18:42:43.942812] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-16T18:42:44.192827] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-16T18:42:44.276779] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:42:44.742869] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-16T18:42:45.542879] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-16T18:42:46.020363] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:42:46.021979] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:42:46.031052] [INFO ] [REMOTE ] EMR: Full fetch complete (77242 records). [2025-10-16T18:42:46.031227] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-16T18:42:46.347017] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-16T18:42:46.435702] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-16T18:42:46.435852] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-16T18:42:46.436971] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-16T18:42:46.437096] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-16T18:42:46.438904] [DEBUG] [LOCAL ] EMR: Trimmed 77242 records to 53592 (keeping 200 days of data) [2025-10-16T18:42:46.467559] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T18:42:46.769041] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:42:46.821083] [DEBUG] [LOCAL ] EMR: Primary data saved (53592 records). [2025-10-16T18:42:46.821251] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-16T18:42:46.821335] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 37.8s. Estimated remaining: 3h 47m 54s. Rate: 7.2 symbols/min [2025-10-16T18:42:46.986596] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:47.026424] [DEBUG] [LOCAL ] ENOV: Loaded 44851 existing records from primary storage. [2025-10-16T18:42:47.026761] [INFO ] [MAIN ] ENOV: Loaded 44851 existing records. [2025-10-16T18:42:47.148031] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-16T18:42:47.212132] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:47.212345] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-16T18:42:47.212394] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-16T18:42:47.212591] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-16T18:42:47.212671] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-16T18:42:47.563353] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:47.942822] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-16T18:42:48.742876] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-16T18:42:49.060354] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T18:42:49.244190] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-16T18:42:49.328980] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T18:42:49.542812] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-16T18:42:49.909617] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T18:42:50.342866] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-16T18:42:50.771629] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T18:42:51.142805] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-16T18:42:51.642620] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-16T18:42:51.942831] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-16T18:42:52.420896] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:42:52.742806] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-16T18:42:53.164665] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T18:42:53.542818] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-16T18:42:53.974571] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T18:42:54.342816] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-16T18:42:55.142803] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-16T18:42:55.590843] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:42:55.591576] [INFO ] [REMOTE ] ENO: Full fetch complete (3038 records). [2025-10-16T18:42:55.591682] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-16T18:42:55.944386] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-16T18:42:55.944816] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-16T18:42:55.945631] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-16T18:42:55.945819] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-16T18:42:55.946006] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-16T18:42:55.946772] [DEBUG] [LOCAL ] ENO: Trimmed 3038 records to 1865 (keeping 200 days of data) [2025-10-16T18:42:55.980332] [DEBUG] [LOCAL ] ENO: Primary data saved (1865 records). [2025-10-16T18:42:55.981759] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T18:42:55.981873] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-16T18:42:55.990623] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENO took 17.9s. Estimated remaining: 3h 47m 48s. Rate: 7.2 symbols/min [2025-10-16T18:42:56.152607] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:42:56.193692] [DEBUG] [LOCAL ] ENR: Loaded 43703 existing records from primary storage. [2025-10-16T18:42:56.193983] [INFO ] [MAIN ] ENR: Loaded 43703 existing records. [2025-10-16T18:42:56.371932] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:42:56.372159] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-16T18:42:56.372212] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-16T18:42:56.372405] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-16T18:42:56.372463] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-16T18:42:56.716984] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:42:56.742774] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-16T18:42:57.542888] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-16T18:42:57.827167] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T18:42:58.156805] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:42:58.342812] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-16T18:42:59.038345] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:42:59.142851] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-16T18:42:59.942790] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-16T18:43:00.118196] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T18:43:00.180984] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T18:43:00.742855] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-16T18:43:01.254137] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:43:01.542828] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-16T18:43:02.266373] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T18:43:02.342778] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-16T18:43:03.078494] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:43:03.142774] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-16T18:43:03.627374] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:43:03.942804] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-16T18:43:04.735527] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:43:04.743932] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-16T18:43:05.091926] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T18:43:05.542824] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-16T18:43:06.342789] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-16T18:43:06.673824] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:43:06.799485] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:43:06.809042] [INFO ] [REMOTE ] ENB: Full fetch complete (77656 records). [2025-10-16T18:43:06.809242] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-16T18:43:07.148048] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-16T18:43:07.224720] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-16T18:43:07.224811] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-16T18:43:07.225797] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-16T18:43:07.225860] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-16T18:43:07.227441] [DEBUG] [LOCAL ] ENB: Trimmed 77656 records to 53902 (keeping 200 days of data) [2025-10-16T18:43:07.564513] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T18:43:07.592546] [DEBUG] [LOCAL ] ENB: Primary data saved (53902 records). [2025-10-16T18:43:07.592672] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-16T18:43:07.593273] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 42.8s. Estimated remaining: 3h 47m 47s. Rate: 7.2 symbols/min [2025-10-16T18:43:07.758165] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:07.789199] [DEBUG] [LOCAL ] ENS: Loaded 29689 existing records from primary storage. [2025-10-16T18:43:07.789475] [INFO ] [MAIN ] ENS: Loaded 29689 existing records. [2025-10-16T18:43:07.946914] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-16T18:43:07.968150] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:07.969314] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-16T18:43:07.969436] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-16T18:43:07.969802] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-16T18:43:07.969906] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-16T18:43:08.317294] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:08.747980] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-16T18:43:08.761163] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:43:09.367916] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T18:43:09.542830] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-16T18:43:09.751453] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T18:43:10.342874] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-16T18:43:10.909122] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:43:11.142861] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-16T18:43:11.591241] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T18:43:11.942813] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-16T18:43:12.748809] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-16T18:43:12.761743] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T18:43:13.168507] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:43:13.542859] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-16T18:43:14.342799] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-16T18:43:14.417748] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:43:14.886411] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T18:43:15.142823] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-16T18:43:15.515502] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T18:43:15.942886] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-16T18:43:16.540677] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T18:43:16.742900] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-16T18:43:17.541831] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:43:17.550371] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-16T18:43:17.655373] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T18:43:18.342809] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-16T18:43:18.736945] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:43:18.741461] [INFO ] [REMOTE ] ENIC: Full fetch complete (51519 records). [2025-10-16T18:43:18.741588] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-16T18:43:19.118868] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-16T18:43:19.118965] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-16T18:43:19.119761] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-16T18:43:19.119823] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-16T18:43:19.120954] [DEBUG] [LOCAL ] ENIC: Trimmed 51519 records to 36937 (keeping 200 days of data) [2025-10-16T18:43:19.170392] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-16T18:43:19.337099] [DEBUG] [LOCAL ] ENIC: Primary data saved (36937 records). [2025-10-16T18:43:19.337258] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-16T18:43:19.337339] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENIC took 48.0s. Estimated remaining: 3h 47m 46s. Rate: 7.2 symbols/min [2025-10-16T18:43:19.508482] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:19.533764] [DEBUG] [LOCAL ] ENVA: Loaded 25474 existing records from primary storage. [2025-10-16T18:43:19.534160] [INFO ] [MAIN ] ENVA: Loaded 25474 existing records. [2025-10-16T18:43:19.714384] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:19.714740] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-16T18:43:19.714816] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-16T18:43:19.722554] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-16T18:43:19.722631] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-16T18:43:19.832448] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T18:43:19.947976] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-16T18:43:20.085794] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:20.742863] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-16T18:43:20.907845] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:43:21.270219] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T18:43:21.542840] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-16T18:43:21.707394] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T18:43:22.342832] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-16T18:43:22.864845] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:43:23.142894] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-16T18:43:23.703447] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T18:43:23.942851] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-16T18:43:24.209732] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:43:24.742849] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-16T18:43:25.342367] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:43:25.542886] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-16T18:43:25.736157] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:43:26.342820] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-16T18:43:26.710430] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:43:27.142817] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-16T18:43:27.637793] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T18:43:27.942802] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-16T18:43:28.714537] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:43:28.719631] [INFO ] [REMOTE ] ENOV: Full fetch complete (63468 records). [2025-10-16T18:43:28.719781] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-16T18:43:28.750557] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-16T18:43:29.110813] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-16T18:43:29.110910] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-16T18:43:29.125737] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-16T18:43:29.125943] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-16T18:43:29.127404] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:43:29.133862] [DEBUG] [LOCAL ] ENOV: Trimmed 63468 records to 45134 (keeping 200 days of data) [2025-10-16T18:43:29.393369] [DEBUG] [LOCAL ] ENOV: Primary data saved (45134 records). [2025-10-16T18:43:29.393560] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-16T18:43:29.393681] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 42.6s. Estimated remaining: 3h 47m 41s. Rate: 7.2 symbols/min [2025-10-16T18:43:29.558994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-16T18:43:29.561858] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:29.578922] [DEBUG] [LOCAL ] EOD: Loaded 15054 existing records from primary storage. [2025-10-16T18:43:29.579195] [INFO ] [MAIN ] EOD: Loaded 15054 existing records. [2025-10-16T18:43:29.751099] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:29.751310] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-16T18:43:29.751365] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-16T18:43:29.751533] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-16T18:43:29.751588] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-16T18:43:30.109751] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:30.227447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:43:30.231953] [INFO ] [REMOTE ] ENS: Full fetch complete (42689 records). [2025-10-16T18:43:30.232034] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-16T18:43:30.347890] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-16T18:43:30.595583] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-16T18:43:30.595677] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-16T18:43:30.596276] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-16T18:43:30.596329] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-16T18:43:30.597224] [DEBUG] [LOCAL ] ENS: Trimmed 42689 records to 29991 (keeping 200 days of data) [2025-10-16T18:43:30.784257] [DEBUG] [LOCAL ] ENS: Primary data saved (29991 records). [2025-10-16T18:43:30.784384] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-16T18:43:30.784491] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENS took 23.2s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-16T18:43:30.957088] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:30.981045] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:43:31.043863] [DEBUG] [LOCAL ] EOG: Loaded 53373 existing records from primary storage. [2025-10-16T18:43:31.044186] [INFO ] [MAIN ] EOG: Loaded 53373 existing records. [2025-10-16T18:43:31.146245] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-16T18:43:31.223530] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:31.223739] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-16T18:43:31.223791] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-16T18:43:31.223987] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-16T18:43:31.224042] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-16T18:43:31.329710] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:43:31.596482] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:31.942829] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-16T18:43:32.145132] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T18:43:32.742876] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-16T18:43:33.253327] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T18:43:33.258788] [INFO ] [REMOTE ] ENR: Full fetch complete (59394 records). [2025-10-16T18:43:33.258922] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-16T18:43:33.549049] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-16T18:43:33.639788] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-16T18:43:33.639863] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-16T18:43:33.640666] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-16T18:43:33.640727] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-16T18:43:33.641856] [DEBUG] [LOCAL ] ENR: Trimmed 59394 records to 44023 (keeping 200 days of data) [2025-10-16T18:43:33.899926] [DEBUG] [LOCAL ] ENR: Primary data saved (44023 records). [2025-10-16T18:43:33.900038] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-16T18:43:33.900473] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENR took 37.9s. Estimated remaining: 3h 46m 57s. Rate: 7.2 symbols/min [2025-10-16T18:43:34.065480] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:34.078382] [DEBUG] [LOCAL ] EOI: Loaded 10670 existing records from primary storage. [2025-10-16T18:43:34.078599] [INFO ] [MAIN ] EOI: Loaded 10670 existing records. [2025-10-16T18:43:34.254409] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:34.254724] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-16T18:43:34.254778] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-16T18:43:34.255028] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-16T18:43:34.255083] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-16T18:43:34.350697] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-16T18:43:34.551511] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T18:43:34.628873] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:34.728420] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T18:43:35.142825] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-16T18:43:35.755113] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T18:43:35.942871] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-16T18:43:36.640822] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:43:36.742831] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-16T18:43:37.020371] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-16T18:43:37.396245] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-16T18:43:37.542780] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-16T18:43:38.342787] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-16T18:43:38.634060] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T18:43:39.142795] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-16T18:43:39.174850] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T18:43:39.942787] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-16T18:43:40.543177] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T18:43:40.742836] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-16T18:43:40.836962] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T18:43:41.542788] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-16T18:43:41.646598] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:43:42.342832] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-16T18:43:42.605011] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T18:43:43.131186] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T18:43:43.142776] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-16T18:43:43.884042] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T18:43:43.942769] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-16T18:43:44.729023] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T18:43:44.742802] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-16T18:43:45.298913] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:43:45.542864] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-16T18:43:46.288364] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T18:43:46.342794] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-16T18:43:47.142808] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-16T18:43:47.368081] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T18:43:47.942805] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-16T18:43:48.283424] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:43:48.437153] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-16T18:43:48.742816] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-16T18:43:49.530471] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T18:43:49.542767] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-16T18:43:50.342843] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-16T18:43:50.420879] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:43:50.422866] [INFO ] [REMOTE ] EOI: Full fetch complete (16248 records). [2025-10-16T18:43:50.422941] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-16T18:43:50.793901] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-16T18:43:50.793985] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-16T18:43:50.794397] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-16T18:43:50.794464] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-16T18:43:50.795160] [DEBUG] [LOCAL ] EOI: Trimmed 16248 records to 10738 (keeping 200 days of data) [2025-10-16T18:43:50.867901] [DEBUG] [LOCAL ] EOI: Primary data saved (10738 records). [2025-10-16T18:43:50.868093] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-16T18:43:50.868231] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. EOI took 17.0s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-16T18:43:51.109794] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:51.130808] [DEBUG] [LOCAL ] EOS: Loaded 15153 existing records from primary storage. [2025-10-16T18:43:51.131101] [INFO ] [MAIN ] EOS: Loaded 15153 existing records. [2025-10-16T18:43:51.148181] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-16T18:43:51.380298] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:51.380747] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-16T18:43:51.380850] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-16T18:43:51.381199] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-16T18:43:51.381280] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-16T18:43:51.583735] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:43:51.847209] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:51.856369] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T18:43:51.942823] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-16T18:43:52.742845] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-16T18:43:52.862223] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:43:53.542799] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-16T18:43:53.892994] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:43:54.342804] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-16T18:43:54.779987] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T18:43:55.142804] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-16T18:43:55.278869] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:43:55.942812] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-16T18:43:56.742851] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-16T18:43:57.062042] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:43:57.216077] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T18:43:57.219241] [INFO ] [REMOTE ] ENVA: Full fetch complete (36698 records). [2025-10-16T18:43:57.219334] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-16T18:43:57.563471] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-16T18:43:57.604594] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-16T18:43:57.604760] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-16T18:43:57.605671] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-16T18:43:57.605758] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-16T18:43:57.607018] [DEBUG] [LOCAL ] ENVA: Trimmed 36698 records to 25627 (keeping 200 days of data) [2025-10-16T18:43:57.708225] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T18:43:57.779424] [DEBUG] [LOCAL ] ENVA: Primary data saved (25627 records). [2025-10-16T18:43:57.779572] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-16T18:43:57.779681] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. ENVA took 38.4s. Estimated remaining: 3h 46m 56s. Rate: 7.2 symbols/min [2025-10-16T18:43:57.945540] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:43:57.955036] [DEBUG] [LOCAL ] EOT: Loaded 6957 existing records from primary storage. [2025-10-16T18:43:57.955255] [INFO ] [MAIN ] EOT: Loaded 6957 existing records. [2025-10-16T18:43:58.136663] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:43:58.136903] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-16T18:43:58.136958] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-16T18:43:58.137186] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-16T18:43:58.137243] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-16T18:43:58.348073] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-16T18:43:58.495771] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:43:58.550022] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:43:59.142861] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-16T18:43:59.942791] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-16T18:44:00.007893] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:44:00.381258] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:44:00.742867] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-16T18:44:01.102406] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T18:44:01.542824] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-16T18:44:01.637034] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T18:44:01.641238] [INFO ] [REMOTE ] EOD: Full fetch complete (20919 records). [2025-10-16T18:44:01.641471] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-16T18:44:01.642260] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-16). Symbol may be delisted or halted. [2025-10-16T18:44:01.642390] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:44:01.642452] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:44:01.642539] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-16T18:44:01.642630] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-16T18:44:01.642761] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-16T18:44:01.642975] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-16T18:44:01.643096] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOD took 32.2s. Estimated remaining: 3h 46m 38s. Rate: 7.2 symbols/min [2025-10-16T18:44:01.819344] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:01.845540] [DEBUG] [LOCAL ] EPAC: Loaded 26461 existing records from primary storage. [2025-10-16T18:44:01.845822] [INFO ] [MAIN ] EPAC: Loaded 26461 existing records. [2025-10-16T18:44:02.022802] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:02.023036] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-16T18:44:02.023084] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-16T18:44:02.023272] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-16T18:44:02.023329] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-16T18:44:02.359454] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T18:44:02.352989] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-16T18:44:02.403669] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:03.142819] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-16T18:44:03.942816] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-16T18:44:04.462749] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-16T18:44:04.545414] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:44:04.742821] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-16T18:44:05.049946] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:44:05.313584] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T18:44:05.542844] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-16T18:44:06.342806] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-16T18:44:06.726688] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-16T18:44:07.142811] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-16T18:44:07.858990] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T18:44:07.942825] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-16T18:44:08.182390] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:44:08.683741] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T18:44:08.742780] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-16T18:44:09.459027] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T18:44:09.542802] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-16T18:44:10.342809] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-16T18:44:10.604842] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T18:44:10.854828] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:44:11.142803] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-16T18:44:11.948317] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-16T18:44:11.950047] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T18:44:12.742832] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-16T18:44:12.882598] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:44:13.542805] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-16T18:44:14.342785] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-16T18:44:14.744342] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-16T18:44:15.032737] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:44:15.142803] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-16T18:44:15.165327] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T18:44:15.768889] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:44:15.942859] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-16T18:44:16.688469] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-16T18:44:16.742830] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-16T18:44:17.542932] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-16T18:44:17.644433] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T18:44:18.002613] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T18:44:18.342843] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-16T18:44:19.142783] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-16T18:44:19.580283] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-16T18:44:19.942866] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-16T18:44:20.742856] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-16T18:44:20.940954] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-16T18:44:20.979390] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T18:44:21.317442] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T18:44:21.542829] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-16T18:44:22.342798] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-16T18:44:22.441983] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-16T18:44:23.142849] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-16T18:44:23.942788] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-16T18:44:24.133788] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T18:44:24.186142] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T18:44:24.586025] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:44:24.588549] [INFO ] [REMOTE ] EOS: Full fetch complete (23061 records). [2025-10-16T18:44:24.588701] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-16T18:44:24.747109] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-16T18:44:24.957768] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-16T18:44:24.957840] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-16T18:44:24.958315] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-16T18:44:24.958377] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-16T18:44:24.959017] [DEBUG] [LOCAL ] EOS: Trimmed 23061 records to 15236 (keeping 200 days of data) [2025-10-16T18:44:25.050814] [DEBUG] [LOCAL ] EOS: Primary data saved (15236 records). [2025-10-16T18:44:25.050948] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-16T18:44:25.051024] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOS took 34.2s. Estimated remaining: 3h 47m 2s. Rate: 7.1 symbols/min [2025-10-16T18:44:25.216205] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:25.256844] [DEBUG] [LOCAL ] EPAM: Loaded 39462 existing records from primary storage. [2025-10-16T18:44:25.257105] [INFO ] [MAIN ] EPAM: Loaded 39462 existing records. [2025-10-16T18:44:25.434686] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:25.435282] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-16T18:44:25.435342] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-16T18:44:25.435708] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-16T18:44:25.435777] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-16T18:44:25.547946] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-16T18:44:25.796296] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:26.261756] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:44:26.342796] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-16T18:44:26.569344] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T18:44:26.577427] [INFO ] [REMOTE ] EOG: Full fetch complete (77463 records). [2025-10-16T18:44:26.577588] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-16T18:44:27.063307] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-16T18:44:27.063394] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-16T18:44:27.064458] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-16T18:44:27.064527] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-16T18:44:27.066191] [DEBUG] [LOCAL ] EOG: Trimmed 77463 records to 53763 (keeping 200 days of data) [2025-10-16T18:44:27.161120] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-16T18:44:27.408090] [DEBUG] [LOCAL ] EOG: Primary data saved (53763 records). [2025-10-16T18:44:27.408213] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-16T18:44:27.409163] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOG took 56.6s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-16T18:44:27.624612] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:27.655077] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T18:44:27.658750] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:44:27.704183] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-16T18:44:27.704502] [INFO ] [MAIN ] EPC: Loaded 39741 existing records. [2025-10-16T18:44:27.878886] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:27.879190] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-16T18:44:27.879240] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-16T18:44:27.879569] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-16T18:44:27.879625] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-16T18:44:27.952974] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-16T18:44:28.288975] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:28.740476] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:44:28.742262] [INFO ] [REMOTE ] EOT: Full fetch complete (10842 records). [2025-10-16T18:44:28.742348] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-16T18:44:28.747880] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-16T18:44:29.160356] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-16T18:44:29.160451] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-16T18:44:29.160901] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-16T18:44:29.160964] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-16T18:44:29.161571] [DEBUG] [LOCAL ] EOT: Trimmed 10842 records to 7040 (keeping 200 days of data) [2025-10-16T18:44:29.206719] [DEBUG] [LOCAL ] EOT: Primary data saved (7040 records). [2025-10-16T18:44:29.206839] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-16T18:44:29.206918] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOT took 31.4s. Estimated remaining: 3h 46m 18s. Rate: 7.2 symbols/min [2025-10-16T18:44:29.386259] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:29.437862] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-16T18:44:29.438204] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-16T18:44:29.547975] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-16T18:44:29.612524] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:29.612756] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-16T18:44:29.612811] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-16T18:44:29.613228] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-16T18:44:29.613269] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-16T18:44:29.966699] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:30.062897] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T18:44:30.342842] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-16T18:44:30.804901] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:44:31.142850] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-16T18:44:31.942825] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-16T18:44:32.201699] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-16T18:44:32.257796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T18:44:32.742850] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-16T18:44:33.308677] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T18:44:33.542868] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-16T18:44:34.024402] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:44:34.028140] [INFO ] [REMOTE ] EPAC: Full fetch complete (38784 records). [2025-10-16T18:44:34.028224] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-16T18:44:34.347879] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-16T18:44:34.419402] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-16T18:44:34.419819] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-16T18:44:34.420570] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-16T18:44:34.420631] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-16T18:44:34.421777] [DEBUG] [LOCAL ] EPAC: Trimmed 38784 records to 26765 (keeping 200 days of data) [2025-10-16T18:44:34.587615] [DEBUG] [LOCAL ] EPAC: Primary data saved (26765 records). [2025-10-16T18:44:34.587790] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-16T18:44:34.587876] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 32.9s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-16T18:44:34.759513] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:34.799694] [DEBUG] [LOCAL ] EPR: Loaded 43877 existing records from primary storage. [2025-10-16T18:44:34.800008] [INFO ] [MAIN ] EPR: Loaded 43877 existing records. [2025-10-16T18:44:34.992167] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:44:34.992602] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-16T18:44:34.992776] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-16T18:44:34.993255] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-16T18:44:35.006571] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-16T18:44:35.092943] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T18:44:35.147881] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-16T18:44:35.385151] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:44:35.855765] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T18:44:35.942852] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-16T18:44:36.742857] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-16T18:44:36.819302] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:44:36.975602] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:44:37.542845] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-16T18:44:38.342807] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-16T18:44:38.760795] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T18:44:38.826728] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:44:39.142817] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-16T18:44:39.374984] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:44:39.942821] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-16T18:44:40.305312] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:44:40.742865] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-16T18:44:41.542807] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-16T18:44:41.683198] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:44:42.078515] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T18:44:42.342812] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-16T18:44:43.142837] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-16T18:44:43.266894] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:44:43.942899] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-16T18:44:44.027758] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T18:44:44.432595] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:44:44.742829] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-16T18:44:45.542849] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-16T18:44:45.609859] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T18:44:46.013819] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T18:44:46.342837] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-16T18:44:47.147874] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-16T18:44:47.162747] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:44:47.789251] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T18:44:47.942789] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-16T18:44:48.433298] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T18:44:48.742803] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-16T18:44:49.003821] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:44:49.542847] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-16T18:44:49.889426] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:44:50.342815] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-16T18:44:51.142793] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-16T18:44:51.267518] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:44:51.942807] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-16T18:44:52.183298] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T18:44:52.227379] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:44:52.742857] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-16T18:44:53.542809] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-16T18:44:53.942863] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T18:44:54.163098] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:44:54.342779] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-16T18:44:55.142799] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-16T18:44:55.241423] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T18:44:55.463560] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T18:44:55.942782] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-16T18:44:56.680080] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T18:44:56.742785] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-16T18:44:57.207781] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T18:44:57.542807] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-16T18:44:58.342839] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-16T18:44:58.383492] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T18:44:58.904128] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T18:44:58.909701] [INFO ] [REMOTE ] EPC: Full fetch complete (57236 records). [2025-10-16T18:44:58.909836] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-16T18:44:59.150406] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-16T18:44:59.367803] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-16T18:44:59.367891] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-16T18:44:59.368936] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-16T18:44:59.369002] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-16T18:44:59.370314] [DEBUG] [LOCAL ] EPC: Trimmed 57236 records to 40042 (keeping 200 days of data) [2025-10-16T18:44:59.639027] [DEBUG] [LOCAL ] EPC: Primary data saved (40042 records). [2025-10-16T18:44:59.639153] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-16T18:44:59.639233] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPC took 32.2s. Estimated remaining: 3h 46m 31s. Rate: 7.1 symbols/min [2025-10-16T18:44:59.844880] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:44:59.845150] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-16T18:44:59.845219] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-16T18:44:59.845503] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-16T18:44:59.845576] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-16T18:44:59.845699] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-16T18:44:59.845826] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-16T18:44:59.949834] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-16T18:45:00.186083] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-16T18:45:00.273985] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:00.742867] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-16T18:45:00.895151] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:45:01.542794] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-16T18:45:01.557973] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:45:01.562791] [INFO ] [REMOTE ] EPAM: Full fetch complete (56315 records). [2025-10-16T18:45:01.562896] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-16T18:45:01.957053] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-16T18:45:01.957158] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-16T18:45:01.958098] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-16T18:45:01.958189] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-16T18:45:01.959603] [DEBUG] [LOCAL ] EPAM: Trimmed 56315 records to 39697 (keeping 200 days of data) [2025-10-16T18:45:02.229010] [DEBUG] [LOCAL ] EPAM: Primary data saved (39697 records). [2025-10-16T18:45:02.229159] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-16T18:45:02.229744] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPAM took 37.2s. Estimated remaining: 3h 46m 10s. Rate: 7.2 symbols/min [2025-10-16T18:45:02.346858] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-16T18:45:02.421945] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:02.436999] [DEBUG] [LOCAL ] EQBK: Loaded 11247 existing records from primary storage. [2025-10-16T18:45:02.437307] [INFO ] [MAIN ] EQBK: Loaded 11247 existing records. [2025-10-16T18:45:02.613574] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:02.613830] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-16T18:45:02.613878] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-16T18:45:02.614031] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-16T18:45:02.614068] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-16T18:45:02.964794] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:03.103738] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T18:45:03.142771] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-16T18:45:03.216363] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-16T18:45:03.656216] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:45:03.942847] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-16T18:45:04.737996] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:45:04.746853] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-16T18:45:05.548687] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-16T18:45:05.550729] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-16T18:45:05.556619] [INFO ] [REMOTE ] EPR: Full fetch complete (63250 records). [2025-10-16T18:45:05.556760] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-16T18:45:05.935426] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-16T18:45:05.935523] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-16T18:45:05.936414] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-16T18:45:05.936477] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-16T18:45:05.937809] [DEBUG] [LOCAL ] EPR: Trimmed 63250 records to 44181 (keeping 200 days of data) [2025-10-16T18:45:06.205460] [DEBUG] [LOCAL ] EPR: Primary data saved (44181 records). [2025-10-16T18:45:06.205630] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-16T18:45:06.205752] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPR took 31.6s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-16T18:45:06.320384] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T18:45:06.356349] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-16T18:45:06.393870] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:06.448231] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-16T18:45:06.448559] [INFO ] [MAIN ] EQH: Loaded 52699 existing records. [2025-10-16T18:45:06.626797] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:06.627060] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-16T18:45:06.627117] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-16T18:45:06.627849] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-16T18:45:06.627922] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-16T18:45:06.988763] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:07.021817] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:45:07.142811] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-16T18:45:07.224444] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:45:07.942820] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-16T18:45:08.693239] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T18:45:08.742785] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-16T18:45:08.939796] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-16T18:45:09.542811] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-16T18:45:10.342825] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-16T18:45:10.795417] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T18:45:11.017962] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T18:45:11.142838] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-16T18:45:11.195331] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T18:45:11.942864] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-16T18:45:12.742812] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-16T18:45:13.100708] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T18:45:13.110812] [INFO ] [REMOTE ] EPD: Full fetch complete (77780 records). [2025-10-16T18:45:13.110978] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-16T18:45:13.501883] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-16T18:45:13.501965] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-16T18:45:13.502927] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-16T18:45:13.503013] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-16T18:45:13.504664] [DEBUG] [LOCAL ] EPD: Trimmed 77780 records to 54001 (keeping 200 days of data) [2025-10-16T18:45:13.560479] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-16T18:45:13.755408] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T18:45:13.883210] [DEBUG] [LOCAL ] EPD: Primary data saved (54001 records). [2025-10-16T18:45:13.883367] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-16T18:45:13.884268] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 44.7s. Estimated remaining: 3h 45m 42s. Rate: 7.2 symbols/min [2025-10-16T18:45:14.057368] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:14.121756] [DEBUG] [LOCAL ] EQNR: Loaded 53047 existing records from primary storage. [2025-10-16T18:45:14.122158] [INFO ] [MAIN ] EQNR: Loaded 53047 existing records. [2025-10-16T18:45:14.328914] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:14.337809] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-16T18:45:14.338974] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T18:45:14.342163] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-16T18:45:14.343125] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-16T18:45:14.344550] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-16T18:45:14.344737] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-16T18:45:14.713585] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:45:14.781729] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:15.031222] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T18:45:15.142912] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-16T18:45:15.942819] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-16T18:45:16.742843] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-16T18:45:17.321181] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T18:45:17.542800] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-16T18:45:17.661200] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T18:45:18.138480] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T18:45:18.342858] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-16T18:45:18.935704] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T18:45:19.142889] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-16T18:45:19.942830] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-16T18:45:20.234677] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T18:45:20.742828] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-16T18:45:20.996258] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-16T18:45:21.283999] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T18:45:21.480368] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:45:21.542828] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-16T18:45:22.342786] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-16T18:45:22.538192] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:45:23.142840] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-16T18:45:23.942861] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-16T18:45:24.004530] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T18:45:24.742812] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-16T18:45:24.878916] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T18:45:24.922388] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T18:45:25.542933] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-16T18:45:26.342860] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-16T18:45:26.455125] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T18:45:26.921341] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T18:45:27.142827] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-16T18:45:27.556740] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:45:27.942844] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-16T18:45:28.742839] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-16T18:45:28.835180] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:45:29.277178] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:45:29.542820] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-16T18:45:29.610695] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:45:29.612852] [INFO ] [REMOTE ] EQBK: Full fetch complete (15619 records). [2025-10-16T18:45:29.612942] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-16T18:45:29.977789] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-16T18:45:29.977904] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-16T18:45:29.978283] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-16T18:45:29.978325] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-16T18:45:29.979101] [DEBUG] [LOCAL ] EQBK: Trimmed 15619 records to 11396 (keeping 200 days of data) [2025-10-16T18:45:30.045784] [DEBUG] [LOCAL ] EQBK: Primary data saved (11396 records). [2025-10-16T18:45:30.045909] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-16T18:45:30.045984] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 27.8s. Estimated remaining: 3h 45m 50s. Rate: 7.2 symbols/min [2025-10-16T18:45:30.209567] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:30.258199] [DEBUG] [LOCAL ] EQR: Loaded 51721 existing records from primary storage. [2025-10-16T18:45:30.258575] [INFO ] [MAIN ] EQR: Loaded 51721 existing records. [2025-10-16T18:45:30.352823] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-16T18:45:30.432081] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:30.432324] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-16T18:45:30.432372] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-16T18:45:30.432555] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-16T18:45:30.432593] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-16T18:45:30.803059] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:31.142791] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-16T18:45:31.552730] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T18:45:31.942872] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-16T18:45:32.128918] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T18:45:32.742810] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-16T18:45:32.832690] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T18:45:33.548815] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-16T18:45:33.564322] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:45:34.322189] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T18:45:34.342794] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-16T18:45:35.142899] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-16T18:45:35.324072] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T18:45:35.942817] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-16T18:45:36.266436] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T18:45:36.678595] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:45:36.742898] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-16T18:45:37.451545] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:45:37.542833] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-16T18:45:38.342822] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-16T18:45:38.402332] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T18:45:38.818109] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T18:45:38.824897] [INFO ] [REMOTE ] EPRT: Full fetch complete (69351 records). [2025-10-16T18:45:38.825020] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-16T18:45:39.157139] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-16T18:45:39.213268] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-16T18:45:39.213375] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-16T18:45:39.214480] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-16T18:45:39.214544] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-16T18:45:39.215984] [DEBUG] [LOCAL ] EPRT: Trimmed 69351 records to 48889 (keeping 200 days of data) [2025-10-16T18:45:39.534003] [DEBUG] [LOCAL ] EPRT: Primary data saved (48889 records). [2025-10-16T18:45:39.534288] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-16T18:45:39.534382] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPRT took 39.9s. Estimated remaining: 3h 45m 44s. Rate: 7.1 symbols/min [2025-10-16T18:45:39.701942] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:39.702093] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-16T18:45:39.702299] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-16T18:45:39.702461] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-16T18:45:39.702535] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-16T18:45:39.702697] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-16T18:45:39.702802] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-16T18:45:39.944738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-16T18:45:40.084240] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T18:45:40.108055] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:40.447388] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T18:45:40.742795] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-16T18:45:41.542921] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-16T18:45:41.906365] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T18:45:41.980349] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T18:45:42.342839] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-16T18:45:43.142783] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-16T18:45:43.456393] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T18:45:43.463307] [INFO ] [REMOTE ] EQH: Full fetch complete (76607 records). [2025-10-16T18:45:43.463464] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-16T18:45:43.567468] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:45:43.877875] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-16T18:45:43.877988] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-16T18:45:43.879115] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-16T18:45:43.879202] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-16T18:45:43.880990] [DEBUG] [LOCAL ] EQH: Trimmed 76607 records to 53088 (keeping 200 days of data) [2025-10-16T18:45:43.946888] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-16T18:45:44.008009] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T18:45:44.252898] [DEBUG] [LOCAL ] EQH: Primary data saved (53088 records). [2025-10-16T18:45:44.253032] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-16T18:45:44.253250] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQH took 38.0s. Estimated remaining: 3h 45m 28s. Rate: 7.2 symbols/min [2025-10-16T18:45:44.341487] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-16T18:45:44.454354] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:45:44.515677] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-16T18:45:44.516111] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-16T18:45:44.727692] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:45:44.727974] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-16T18:45:44.728024] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-16T18:45:44.728436] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-16T18:45:44.728496] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-16T18:45:44.751783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-16T18:45:45.125826] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:45:45.542805] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-16T18:45:46.351909] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-16T18:45:46.357416] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:45:46.649493] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:45:47.142833] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-16T18:45:47.403832] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:45:47.942817] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-16T18:45:48.286665] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T18:45:48.662049] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:45:48.742783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-16T18:45:49.542810] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-16T18:45:49.838970] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-16T18:45:50.342846] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-16T18:45:50.528724] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:45:51.142809] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-16T18:45:51.942974] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-16T18:45:52.309624] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:45:52.426851] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T18:45:52.433628] [INFO ] [REMOTE ] EQNR: Full fetch complete (77006 records). [2025-10-16T18:45:52.433807] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-16T18:45:52.747989] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-16T18:45:52.836925] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-16T18:45:52.837003] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-16T18:45:52.837990] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-16T18:45:52.838054] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-16T18:45:52.839490] [DEBUG] [LOCAL ] EQNR: Trimmed 77006 records to 53437 (keeping 200 days of data) [2025-10-16T18:45:53.158509] [DEBUG] [LOCAL ] EQNR: Primary data saved (53437 records). [2025-10-16T18:45:53.158813] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-16T18:45:53.159561] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 39.3s. Estimated remaining: 3h 45m 21s. Rate: 7.2 symbols/min [2025-10-16T18:45:53.338693] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-16T18:45:53.542837] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-16T18:45:53.903099] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-16T18:45:54.342808] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-16T18:45:54.452214] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T18:45:54.717051] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-16T18:45:55.142842] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-16T18:45:55.942816] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-16T18:45:56.590478] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-16T18:45:56.742789] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-16T18:45:56.915601] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T18:45:57.084585] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T18:45:57.542811] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-16T18:45:58.030137] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:45:58.031080] [INFO ] [REMOTE ] EQS: Full fetch complete (2394 records). [2025-10-16T18:45:58.031160] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-16T18:45:58.238887] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-16T18:45:58.239131] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:45:58.239204] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:45:58.239278] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-16T18:45:58.239343] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-16T18:45:58.239396] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-16T18:45:58.239465] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-16T18:45:58.239526] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQS took 18.7s. Estimated remaining: 3h 45m 6s. Rate: 7.2 symbols/min [2025-10-16T18:45:58.342904] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-16T18:45:59.142885] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-16T18:45:59.885457] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:45:59.942771] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-16T18:46:00.969046] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T18:46:00.980617] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-16T18:46:01.619543] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T18:46:01.631495] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-16T18:46:02.482064] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T18:46:02.489327] [INFO ] [REMOTE ] EQR: Full fetch complete (74439 records). [2025-10-16T18:46:02.489557] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-16T18:46:02.874522] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-16T18:46:02.874613] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-16T18:46:02.875630] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-16T18:46:02.875721] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-16T18:46:02.877215] [DEBUG] [LOCAL ] EQR: Trimmed 74439 records to 52109 (keeping 200 days of data) [2025-10-16T18:46:03.213431] [DEBUG] [LOCAL ] EQR: Primary data saved (52109 records). [2025-10-16T18:46:03.213594] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-16T18:46:03.214137] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQR took 33.2s. Estimated remaining: 3h 44m 50s. Rate: 7.2 symbols/min [2025-10-16T18:46:03.663903] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T18:46:03.678745] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-16T18:46:05.363555] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T18:46:05.375125] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-16T18:46:07.345069] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T18:46:07.355855] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-16T18:46:09.437150] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T18:46:09.448883] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-16T18:46:11.153966] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:46:11.166250] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-16T18:46:13.274400] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-16T18:46:13.286018] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-16T18:46:15.263331] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T18:46:15.272275] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-16T18:46:15.272441] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-16T18:46:15.690894] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-16T18:46:15.690987] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-16T18:46:15.692181] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-16T18:46:15.692287] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-16T18:46:15.694127] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54075 (keeping 200 days of data) [2025-10-16T18:46:16.027947] [DEBUG] [LOCAL ] EQT: Primary data saved (54075 records). [2025-10-16T18:46:16.028083] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-16T18:46:16.028166] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 31.8s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-16T18:46:16.695307] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.697696] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.752171] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.784567] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:16.791243] [DEBUG] [LOCAL ] EQV: Loaded 2688 existing records from primary storage. [2025-10-16T18:46:16.792023] [INFO ] [MAIN ] EQV: Loaded 2688 existing records. [2025-10-16T18:46:17.066063] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.066445] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.066513] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-16T18:46:17.067529] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-16T18:46:17.067365] [DEBUG] [LOCAL ] ERO: Loaded 41875 existing records from primary storage. [2025-10-16T18:46:17.069121] [DEBUG] [LOCAL ] ERJ: Loaded 50317 existing records from primary storage. [2025-10-16T18:46:17.067747] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-16T18:46:17.075495] [INFO ] [MAIN ] ERJ: Loaded 50317 existing records. [2025-10-16T18:46:17.075690] [INFO ] [MAIN ] ERO: Loaded 41875 existing records. [2025-10-16T18:46:17.233957] [DEBUG] [LOCAL ] ES: Loaded 52695 existing records from primary storage. [2025-10-16T18:46:17.278481] [INFO ] [MAIN ] ES: Loaded 52695 existing records. [2025-10-16T18:46:17.736797] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.849300] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.879223] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.888799] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-16T18:46:17.923925] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:17.919999] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.939816] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-16T18:46:17.945051] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-16T18:46:17.966025] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-16T18:46:17.950371] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-16T18:46:17.979148] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-16T18:46:17.974694] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-16T18:46:17.985084] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-16T18:46:18.049681] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-16T18:46:18.065377] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-16T18:46:18.294760] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:18.371502] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-16T18:46:19.096425] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.150960] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-16T18:46:19.161964] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.199979] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-16T18:46:19.207603] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:46:19.218441] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-16T18:46:19.242600] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:19.243464] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-16T18:46:20.005403] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T18:46:20.008041] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-16T18:46:20.558421] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T18:46:20.560598] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-16T18:46:20.598313] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T18:46:20.610337] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-16T18:46:20.720760] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T18:46:20.731197] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-16T18:46:20.799946] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:46:20.809123] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-16T18:46:21.123345] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T18:46:21.124761] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-16T18:46:21.594953] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:46:21.602776] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-16T18:46:21.643392] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T18:46:21.645378] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-16T18:46:22.202499] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-16T18:46:22.203978] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-16T18:46:22.357456] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T18:46:22.376896] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-16T18:46:22.393376] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T18:46:22.403227] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-16T18:46:22.532310] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T18:46:22.533869] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-16T18:46:22.910138] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T18:46:22.918247] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-16T18:46:22.987864] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:46:22.989209] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-16T18:46:23.392781] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-16T18:46:23.395029] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-16T18:46:23.774039] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T18:46:23.775311] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-16T18:46:23.818698] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T18:46:23.947877] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-16T18:46:23.965069] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:46:24.045825] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:46:24.155431] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-16T18:46:24.156328] [INFO ] [REMOTE ] EQV: Full fetch complete (5322 records). [2025-10-16T18:46:24.156418] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-16T18:46:24.509937] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-16T18:46:24.510015] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-16T18:46:24.510159] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-16T18:46:24.510198] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-16T18:46:24.510563] [DEBUG] [LOCAL ] EQV: Trimmed 5322 records to 2745 (keeping 200 days of data) [2025-10-16T18:46:24.526329] [DEBUG] [LOCAL ] EQV: Primary data saved (2745 records). [2025-10-16T18:46:24.526445] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-16T18:46:24.526548] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 8.5s. Estimated remaining: 3h 44m 43s. Rate: 7.2 symbols/min [2025-10-16T18:46:24.694417] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:24.723937] [DEBUG] [LOCAL ] ESAB: Loaded 26058 existing records from primary storage. [2025-10-16T18:46:24.724227] [INFO ] [MAIN ] ESAB: Loaded 26058 existing records. [2025-10-16T18:46:24.754276] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-16T18:46:24.900105] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:24.900315] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-16T18:46:24.900365] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-16T18:46:24.900585] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-16T18:46:24.900682] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-16T18:46:25.270960] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:25.392891] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T18:46:25.542788] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-16T18:46:25.871956] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:46:26.342889] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-16T18:46:27.142801] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-16T18:46:27.347939] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T18:46:27.397260] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T18:46:27.942842] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-16T18:46:28.742868] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-16T18:46:28.892463] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:46:29.543104] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-16T18:46:29.543026] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:46:29.726015] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T18:46:30.342807] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-16T18:46:30.747458] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T18:46:31.142818] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-16T18:46:31.942787] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-16T18:46:32.052846] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T18:46:32.742806] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-16T18:46:32.935579] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:46:32.975667] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:46:33.542824] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-16T18:46:34.342859] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-16T18:46:34.482536] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T18:46:34.725322] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:46:35.142802] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-16T18:46:35.476064] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:46:35.942873] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-16T18:46:36.742819] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-16T18:46:36.879881] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T18:46:37.299026] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T18:46:37.542826] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-16T18:46:38.311823] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:46:38.342778] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-16T18:46:38.889511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:46:39.142840] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-16T18:46:39.634389] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:46:39.942874] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-16T18:46:40.741526] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T18:46:40.750890] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-16T18:46:41.177709] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:46:41.542813] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-16T18:46:42.305994] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:46:42.342774] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-16T18:46:42.682845] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T18:46:43.142871] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-16T18:46:43.756491] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T18:46:43.762958] [INFO ] [REMOTE ] ERO: Full fetch complete (60389 records). [2025-10-16T18:46:43.763084] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-16T18:46:43.942818] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-16T18:46:44.245836] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-16T18:46:44.246130] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-16T18:46:44.247848] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-16T18:46:44.247957] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-16T18:46:44.273067] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T18:46:44.275566] [DEBUG] [LOCAL ] ERO: Trimmed 60389 records to 42256 (keeping 200 days of data) [2025-10-16T18:46:44.630105] [DEBUG] [LOCAL ] ERO: Primary data saved (42256 records). [2025-10-16T18:46:44.630387] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-16T18:46:44.630513] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 28.6s. Estimated remaining: 3h 44m 59s. Rate: 7.1 symbols/min [2025-10-16T18:46:44.743137] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-16T18:46:44.902209] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:44.924463] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:46:44.932518] [INFO ] [REMOTE ] ES: Full fetch complete (76477 records). [2025-10-16T18:46:44.932768] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-16T18:46:45.066153] [DEBUG] [LOCAL ] ESE: Loaded 16509 existing records from primary storage. [2025-10-16T18:46:45.071830] [INFO ] [MAIN ] ESE: Loaded 16509 existing records. [2025-10-16T18:46:45.544185] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-16T18:46:45.548526] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:45.566001] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-16T18:46:45.614123] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-16T18:46:45.654482] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-16T18:46:45.654538] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-16T18:46:45.654711] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-16T18:46:45.654856] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-16T18:46:45.655949] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-16T18:46:45.685735] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-16T18:46:45.794234] [DEBUG] [LOCAL ] ES: Trimmed 76477 records to 53077 (keeping 200 days of data) [2025-10-16T18:46:46.135120] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:46:46.202523] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:46.356354] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-16T18:46:46.402951] [DEBUG] [LOCAL ] ES: Primary data saved (53077 records). [2025-10-16T18:46:46.403060] [INFO ] [MAIN ] ES: Full history saved. [2025-10-16T18:46:46.403137] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ES took 30.4s. Estimated remaining: 3h 44m 37s. Rate: 7.2 symbols/min [2025-10-16T18:46:46.575489] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:46:46.625188] [DEBUG] [LOCAL ] ESI: Loaded 50648 existing records from primary storage. [2025-10-16T18:46:46.625502] [INFO ] [MAIN ] ESI: Loaded 50648 existing records. [2025-10-16T18:46:46.796750] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:46:46.796955] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-16T18:46:46.797002] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-16T18:46:46.797199] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-16T18:46:46.797254] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-16T18:46:47.146663] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-16T18:46:47.146582] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:46:47.224398] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:46:47.475440] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T18:46:47.942826] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-16T18:46:48.300845] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T18:46:48.415361] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T18:46:48.742816] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-16T18:46:49.542812] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-16T18:46:50.342793] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-16T18:46:50.433294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T18:46:50.480476] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:46:51.142861] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-16T18:46:51.700892] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T18:46:51.942789] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-16T18:46:52.253625] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:46:52.742874] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-16T18:46:53.124695] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T18:46:53.542895] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-16T18:46:54.055506] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:46:54.342859] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-16T18:46:54.586048] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:46:55.142868] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-16T18:46:55.657843] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:46:55.942817] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-16T18:46:56.704087] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T18:46:56.742772] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-16T18:46:57.026907] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T18:46:57.542878] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-16T18:46:58.264503] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:46:58.307315] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T18:46:58.342795] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-16T18:46:59.142786] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-16T18:46:59.156582] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-16T18:46:59.942877] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-16T18:47:00.742877] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-16T18:47:00.984721] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T18:47:01.146901] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:47:01.153281] [INFO ] [REMOTE ] ERJ: Full fetch complete (72845 records). [2025-10-16T18:47:01.153419] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-16T18:47:01.545762] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-16T18:47:01.545300] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-16T18:47:01.546264] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-16T18:47:01.548262] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-16T18:47:01.548442] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-16T18:47:01.550210] [DEBUG] [LOCAL ] ERJ: Trimmed 72845 records to 50694 (keeping 200 days of data) [2025-10-16T18:47:01.856667] [DEBUG] [LOCAL ] ERJ: Primary data saved (50694 records). [2025-10-16T18:47:01.856822] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-16T18:47:01.856906] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ERJ took 45.8s. Estimated remaining: 3h 44m 43s. Rate: 7.1 symbols/min [2025-10-16T18:47:02.029826] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:02.065814] [DEBUG] [LOCAL ] ESNT: Loaded 38289 existing records from primary storage. [2025-10-16T18:47:02.066101] [INFO ] [MAIN ] ESNT: Loaded 38289 existing records. [2025-10-16T18:47:02.187627] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T18:47:02.229210] [INFO ] [REMOTE ] ESAB: Full fetch complete (36155 records). [2025-10-16T18:47:02.256058] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-16T18:47:02.263132] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:02.264241] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-16T18:47:02.264554] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-16T18:47:02.280273] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-16T18:47:02.290432] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-16T18:47:02.370371] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-16T18:47:02.947956] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T18:47:02.984053] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-16T18:47:02.989664] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-16T18:47:02.995436] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-16T18:47:03.000627] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-16T18:47:03.039342] [DEBUG] [LOCAL ] ESAB: Trimmed 36155 records to 26243 (keeping 200 days of data) [2025-10-16T18:47:03.058309] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:03.150823] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-16T18:47:03.228828] [DEBUG] [LOCAL ] ESAB: Primary data saved (26243 records). [2025-10-16T18:47:03.228952] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-16T18:47:03.229030] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ESAB took 38.7s. Estimated remaining: 3h 44m 20s. Rate: 7.2 symbols/min [2025-10-16T18:47:03.398104] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:03.441161] [DEBUG] [LOCAL ] ESRT: Loaded 46481 existing records from primary storage. [2025-10-16T18:47:03.441480] [INFO ] [MAIN ] ESRT: Loaded 46481 existing records. [2025-10-16T18:47:03.615772] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:03.615960] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-16T18:47:03.616032] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-16T18:47:03.616625] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-16T18:47:03.616745] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-16T18:47:03.947882] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-16T18:47:03.983937] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:04.235755] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T18:47:04.604297] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:47:04.667306] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T18:47:04.669758] [INFO ] [REMOTE ] ESE: Full fetch complete (22666 records). [2025-10-16T18:47:04.669853] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-16T18:47:04.747961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-16T18:47:05.035688] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-16T18:47:05.035772] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-16T18:47:05.036241] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-16T18:47:05.036302] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-16T18:47:05.036930] [DEBUG] [LOCAL ] ESE: Trimmed 22666 records to 16630 (keeping 200 days of data) [2025-10-16T18:47:05.141326] [DEBUG] [LOCAL ] ESE: Primary data saved (16630 records). [2025-10-16T18:47:05.141480] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-16T18:47:05.141564] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 20.5s. Estimated remaining: 3h 43m 58s. Rate: 7.2 symbols/min [2025-10-16T18:47:05.307549] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:05.341795] [DEBUG] [LOCAL ] ESS: Loaded 30136 existing records from primary storage. [2025-10-16T18:47:05.342078] [INFO ] [MAIN ] ESS: Loaded 30136 existing records. [2025-10-16T18:47:05.515051] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:05.515303] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-16T18:47:05.515355] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-16T18:47:05.515576] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-16T18:47:05.515613] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-16T18:47:05.547984] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-16T18:47:05.869911] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:05.960322] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T18:47:06.342819] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-16T18:47:07.147911] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-16T18:47:07.162795] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T18:47:07.944360] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-16T18:47:07.947894] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:47:08.388907] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:47:08.742814] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-16T18:47:09.100520] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:47:09.542836] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-16T18:47:09.775434] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:47:10.342808] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-16T18:47:10.723053] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T18:47:11.142821] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-16T18:47:11.488191] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:47:11.942806] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-16T18:47:12.720296] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T18:47:12.742858] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-16T18:47:13.159307] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T18:47:13.542880] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-16T18:47:14.342805] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-16T18:47:14.398535] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:47:14.892429] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T18:47:15.142848] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-16T18:47:15.600139] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T18:47:15.942811] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-16T18:47:16.114240] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T18:47:16.742827] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-16T18:47:17.482844] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:47:17.542770] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-16T18:47:17.970149] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:47:18.342807] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-16T18:47:19.071671] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T18:47:19.142771] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-16T18:47:19.187895] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T18:47:19.942818] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-16T18:47:20.747941] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-16T18:47:20.766318] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T18:47:21.542786] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-16T18:47:21.651302] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:47:22.004753] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T18:47:22.342840] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-16T18:47:22.639158] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T18:47:23.142850] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-16T18:47:23.938408] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:47:23.945094] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-16T18:47:24.526442] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:47:24.742842] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-16T18:47:25.490883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:47:25.542772] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-16T18:47:25.897672] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T18:47:26.342817] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-16T18:47:26.959355] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T18:47:27.142822] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-16T18:47:27.938155] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T18:47:27.946042] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-16T18:47:27.947828] [INFO ] [REMOTE ] ESRT: Full fetch complete (66583 records). [2025-10-16T18:47:27.947957] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-16T18:47:28.342091] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-16T18:47:28.342280] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-16T18:47:28.343242] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-16T18:47:28.343320] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-16T18:47:28.344857] [DEBUG] [LOCAL ] ESRT: Trimmed 66583 records to 46834 (keeping 200 days of data) [2025-10-16T18:47:28.459375] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:47:28.647738] [DEBUG] [LOCAL ] ESRT: Primary data saved (46834 records). [2025-10-16T18:47:28.647879] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-16T18:47:28.647960] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESRT took 25.4s. Estimated remaining: 3h 44m 21s. Rate: 7.1 symbols/min [2025-10-16T18:47:28.748388] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-16T18:47:28.820610] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:28.868744] [DEBUG] [LOCAL ] ESTC: Loaded 50337 existing records from primary storage. [2025-10-16T18:47:28.869059] [INFO ] [MAIN ] ESTC: Loaded 50337 existing records. [2025-10-16T18:47:29.049128] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:29.049363] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-16T18:47:29.049413] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-16T18:47:29.049798] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-16T18:47:29.049872] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-16T18:47:29.406592] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:29.542821] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-16T18:47:29.624688] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:47:30.342799] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-16T18:47:30.537307] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:47:31.142792] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-16T18:47:31.195815] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:47:31.814550] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:47:31.821300] [INFO ] [REMOTE ] ESI: Full fetch complete (73174 records). [2025-10-16T18:47:31.821427] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-16T18:47:31.958230] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-16T18:47:32.214427] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-16T18:47:32.214538] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-16T18:47:32.215596] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-16T18:47:32.215733] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-16T18:47:32.217259] [DEBUG] [LOCAL ] ESI: Trimmed 73174 records to 51027 (keeping 200 days of data) [2025-10-16T18:47:32.334451] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:47:32.561617] [DEBUG] [LOCAL ] ESI: Primary data saved (51027 records). [2025-10-16T18:47:32.561785] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-16T18:47:32.561887] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 46.2s. Estimated remaining: 3h 44m 4s. Rate: 7.1 symbols/min [2025-10-16T18:47:32.725938] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:32.754625] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-16T18:47:32.777669] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-16T18:47:32.777972] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-16T18:47:32.949147] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:32.949342] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-16T18:47:32.949388] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-16T18:47:32.949596] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-16T18:47:32.949680] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-16T18:47:33.297748] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:33.542772] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-16T18:47:33.646235] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:47:34.183933] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-16T18:47:34.342817] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-16T18:47:35.142829] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-16T18:47:35.469419] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T18:47:35.477846] [INFO ] [REMOTE ] ESNT: Full fetch complete (57210 records). [2025-10-16T18:47:35.477970] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-16T18:47:35.829514] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-16T18:47:35.903224] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-16T18:47:35.903299] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-16T18:47:35.904100] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-16T18:47:35.904186] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-16T18:47:35.905314] [DEBUG] [LOCAL ] ESNT: Trimmed 57210 records to 38566 (keeping 200 days of data) [2025-10-16T18:47:35.961393] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-16T18:47:36.159368] [DEBUG] [LOCAL ] ESNT: Primary data saved (38566 records). [2025-10-16T18:47:36.159528] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-16T18:47:36.159613] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESNT took 34.3s. Estimated remaining: 3h 43m 45s. Rate: 7.2 symbols/min [2025-10-16T18:47:36.331991] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:36.345717] [DEBUG] [LOCAL ] ETB: Loaded 11985 existing records from primary storage. [2025-10-16T18:47:36.345964] [INFO ] [MAIN ] ETB: Loaded 11985 existing records. [2025-10-16T18:47:36.536279] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:36.536719] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-16T18:47:36.536882] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-16T18:47:36.537053] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-16T18:47:36.537094] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-16T18:47:36.748810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-16T18:47:37.012475] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:37.038065] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T18:47:37.542895] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-16T18:47:37.934344] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:47:37.987331] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T18:47:38.342867] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-16T18:47:38.851720] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T18:47:39.142802] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-16T18:47:39.942793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-16T18:47:40.342314] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-16T18:47:40.708687] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:47:40.742781] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-16T18:47:40.778038] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:47:41.542806] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-16T18:47:42.342817] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-16T18:47:42.567610] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T18:47:42.620373] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:47:43.142850] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-16T18:47:43.942877] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-16T18:47:44.596599] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-16T18:47:44.618819] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T18:47:44.624112] [INFO ] [REMOTE ] ESS: Full fetch complete (43656 records). [2025-10-16T18:47:44.624252] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-16T18:47:44.747280] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-16T18:47:45.043090] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-16T18:47:45.043166] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-16T18:47:45.043888] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-16T18:47:45.043949] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-16T18:47:45.044819] [DEBUG] [LOCAL ] ESS: Trimmed 43656 records to 30383 (keeping 200 days of data) [2025-10-16T18:47:45.269709] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:47:45.284452] [DEBUG] [LOCAL ] ESS: Primary data saved (30383 records). [2025-10-16T18:47:45.285143] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-16T18:47:45.285391] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESS took 40.1s. Estimated remaining: 3h 43m 38s. Rate: 7.1 symbols/min [2025-10-16T18:47:45.454996] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:45.485120] [DEBUG] [LOCAL ] ETD: Loaded 27336 existing records from primary storage. [2025-10-16T18:47:45.485413] [INFO ] [MAIN ] ETD: Loaded 27336 existing records. [2025-10-16T18:47:45.548035] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-16T18:47:45.596989] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T18:47:45.682673] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:45.683265] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-16T18:47:45.683348] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-16T18:47:45.683528] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-16T18:47:45.683568] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-16T18:47:46.028809] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:46.342845] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-16T18:47:47.115864] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:47:47.142767] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-16T18:47:47.795443] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-16T18:47:47.828628] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T18:47:47.942783] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-16T18:47:48.742810] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-16T18:47:49.451912] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:47:49.542770] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-16T18:47:50.342804] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-16T18:47:51.017832] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-16T18:47:51.041424] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-16T18:47:51.142793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-16T18:47:51.274519] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T18:47:51.897709] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T18:47:51.942775] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-16T18:47:52.496497] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T18:47:52.742827] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-16T18:47:53.542851] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-16T18:47:54.342820] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-16T18:47:54.864496] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T18:47:54.965107] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T18:47:55.142769] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-16T18:47:55.234899] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T18:47:55.942896] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-16T18:47:56.742841] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-16T18:47:57.140332] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:47:57.147076] [INFO ] [REMOTE ] ESTC: Full fetch complete (72459 records). [2025-10-16T18:47:57.147206] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-16T18:47:57.551523] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-16T18:47:57.547318] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-16T18:47:57.547871] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T18:47:57.552612] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-16T18:47:57.556139] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-16T18:47:57.557135] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-16T18:47:57.558706] [DEBUG] [LOCAL ] ESTC: Trimmed 72459 records to 50722 (keeping 200 days of data) [2025-10-16T18:47:57.860424] [DEBUG] [LOCAL ] ESTC: Primary data saved (50722 records). [2025-10-16T18:47:57.860812] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-16T18:47:57.861499] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESTC took 29.2s. Estimated remaining: 3h 43m 39s. Rate: 7.1 symbols/min [2025-10-16T18:47:58.034160] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:47:58.054273] [DEBUG] [LOCAL ] ETG: Loaded 16670 existing records from primary storage. [2025-10-16T18:47:58.054543] [INFO ] [MAIN ] ETG: Loaded 16670 existing records. [2025-10-16T18:47:58.244881] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-16T18:47:58.331477] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:47:58.332586] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-16T18:47:58.332839] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-16T18:47:58.333245] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-16T18:47:58.333442] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-16T18:47:58.348108] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-16T18:47:58.391169] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T18:47:58.705990] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:47:59.142854] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-16T18:47:59.222822] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T18:47:59.942885] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-16T18:48:00.742890] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-16T18:48:00.976891] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:48:01.542862] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-16T18:48:01.861707] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T18:48:01.942838] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-16T18:48:02.342847] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-16T18:48:02.624909] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T18:48:03.142813] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-16T18:48:03.942788] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-16T18:48:04.124908] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:48:04.601307] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T18:48:04.624428] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T18:48:04.742791] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-16T18:48:05.542854] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-16T18:48:06.342798] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-16T18:48:06.662030] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T18:48:06.816941] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:48:06.827218] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-16T18:48:06.827415] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-16T18:48:07.146849] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-16T18:48:07.141637] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:48:07.173712] [INFO ] [REMOTE ] ETB: Full fetch complete (18304 records). [2025-10-16T18:48:07.191822] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-16T18:48:07.311753] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-16T18:48:07.327678] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-16T18:48:07.329307] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-16T18:48:07.340798] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-16T18:48:07.401876] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54179 (keeping 200 days of data) [2025-10-16T18:48:07.726745] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-16T18:48:07.729675] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-16T18:48:07.730295] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-16T18:48:07.736471] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-16T18:48:07.742714] [DEBUG] [LOCAL ] ETB: Trimmed 18304 records to 12026 (keeping 200 days of data) [2025-10-16T18:48:07.924604] [DEBUG] [LOCAL ] ETB: Primary data saved (12026 records). [2025-10-16T18:48:07.929325] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-16T18:48:07.929748] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 31.8s. Estimated remaining: 3h 43m 34s. Rate: 7.1 symbols/min [2025-10-16T18:48:07.952179] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-16T18:48:08.131197] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:08.249186] [DEBUG] [LOCAL ] ETJ: Loaded 16847 existing records from primary storage. [2025-10-16T18:48:08.258362] [INFO ] [MAIN ] ETJ: Loaded 16847 existing records. [2025-10-16T18:48:08.258527] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-16T18:48:08.279636] [INFO ] [MAIN ] ET: Full history saved. [2025-10-16T18:48:08.290234] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 35.7s. Estimated remaining: 3h 43m 9s. Rate: 7.2 symbols/min [2025-10-16T18:48:08.485855] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:48:08.613533] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:08.627458] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-16T18:48:08.642022] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-16T18:48:08.644879] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-16T18:48:08.644973] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-16T18:48:08.644837] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:08.746766] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-16T18:48:09.022897] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:09.052637] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T18:48:09.059061] [DEBUG] [LOCAL ] ETN: Loaded 52641 existing records from primary storage. [2025-10-16T18:48:09.059625] [INFO ] [MAIN ] ETN: Loaded 52641 existing records. [2025-10-16T18:48:09.265399] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:09.265716] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-16T18:48:09.265776] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-16T18:48:09.266004] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-16T18:48:09.266059] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-16T18:48:09.543158] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-16T18:48:09.630423] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:09.875971] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-16T18:48:10.153403] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:48:10.342822] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-16T18:48:11.142887] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-16T18:48:11.315223] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T18:48:11.942876] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-16T18:48:12.742862] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:48:12.743040] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-16T18:48:13.016616] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T18:48:13.542800] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-16T18:48:13.781472] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T18:48:14.342864] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-16T18:48:14.634615] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:48:15.142848] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-16T18:48:15.366372] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T18:48:15.942866] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-16T18:48:16.307941] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:48:16.742807] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-16T18:48:17.542775] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-16T18:48:17.661923] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-16T18:48:17.782465] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:48:18.342912] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-16T18:48:18.837298] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T18:48:18.851672] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T18:48:19.142851] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-16T18:48:19.942853] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-16T18:48:20.163222] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:48:20.742823] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-16T18:48:21.018929] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:48:21.542834] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-16T18:48:22.277891] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:48:22.342829] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-16T18:48:22.771821] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-16T18:48:22.775430] [INFO ] [REMOTE ] ETD: Full fetch complete (38676 records). [2025-10-16T18:48:22.775522] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-16T18:48:23.144710] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-16T18:48:23.156624] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-16T18:48:23.156740] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-16T18:48:23.157440] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-16T18:48:23.157633] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-16T18:48:23.168425] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:48:23.172504] [DEBUG] [LOCAL ] ETD: Trimmed 38676 records to 27518 (keeping 200 days of data) [2025-10-16T18:48:23.346163] [DEBUG] [LOCAL ] ETD: Primary data saved (27518 records). [2025-10-16T18:48:23.346314] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-16T18:48:23.346436] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETD took 38.1s. Estimated remaining: 3h 43m 14s. Rate: 7.1 symbols/min [2025-10-16T18:48:23.563465] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:23.573988] [DEBUG] [LOCAL ] ETO: Loaded 6976 existing records from primary storage. [2025-10-16T18:48:23.574228] [INFO ] [MAIN ] ETO: Loaded 6976 existing records. [2025-10-16T18:48:23.784336] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:23.784551] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-16T18:48:23.784600] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-16T18:48:23.784776] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-16T18:48:23.784841] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-16T18:48:23.953224] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-16T18:48:24.137369] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:24.742811] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-16T18:48:25.050015] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T18:48:25.215064] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T18:48:25.266661] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T18:48:25.542823] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-16T18:48:26.003849] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T18:48:26.342818] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-16T18:48:27.124498] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:48:27.142769] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-16T18:48:27.942786] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-16T18:48:28.097422] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T18:48:28.742837] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-16T18:48:29.336101] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T18:48:29.542896] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-16T18:48:29.683931] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:48:30.342833] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-16T18:48:30.570445] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T18:48:30.956987] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T18:48:31.142838] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-16T18:48:31.917056] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:48:31.942777] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-16T18:48:32.742799] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-16T18:48:32.916344] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T18:48:33.447047] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:48:33.542783] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-16T18:48:34.272459] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T18:48:34.342812] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-16T18:48:35.142814] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-16T18:48:35.166341] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:48:35.942804] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-16T18:48:36.742799] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-16T18:48:36.820520] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T18:48:36.823072] [INFO ] [REMOTE ] ETJ: Full fetch complete (25591 records). [2025-10-16T18:48:36.823144] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-16T18:48:37.191724] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-16T18:48:37.191892] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-16T18:48:37.192546] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-16T18:48:37.192622] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-16T18:48:37.193589] [DEBUG] [LOCAL ] ETJ: Trimmed 25591 records to 16898 (keeping 200 days of data) [2025-10-16T18:48:37.299509] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T18:48:37.334336] [DEBUG] [LOCAL ] ETJ: Primary data saved (16898 records). [2025-10-16T18:48:37.334455] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-16T18:48:37.334551] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETJ took 29.4s. Estimated remaining: 3h 43m 17s. Rate: 7.1 symbols/min [2025-10-16T18:48:37.513431] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:37.519873] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T18:48:37.553795] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-16T18:48:37.575334] [DEBUG] [LOCAL ] ETR: Loaded 53210 existing records from primary storage. [2025-10-16T18:48:37.575697] [INFO ] [MAIN ] ETR: Loaded 53210 existing records. [2025-10-16T18:48:37.753973] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:37.754229] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-16T18:48:37.754286] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-16T18:48:37.754563] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-16T18:48:37.754621] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-16T18:48:38.114126] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:38.342839] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-16T18:48:38.375256] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:48:38.807741] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-16T18:48:39.142837] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-16T18:48:39.942826] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-16T18:48:40.742860] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-16T18:48:40.839054] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:48:40.874180] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:48:40.878076] [INFO ] [REMOTE ] ETG: Full fetch complete (24867 records). [2025-10-16T18:48:40.878206] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-16T18:48:41.262489] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T18:48:41.273331] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-16T18:48:41.273406] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-16T18:48:41.275568] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-16T18:48:41.275672] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-16T18:48:41.276490] [DEBUG] [LOCAL ] ETG: Trimmed 24867 records to 16789 (keeping 200 days of data) [2025-10-16T18:48:41.382925] [DEBUG] [LOCAL ] ETG: Primary data saved (16789 records). [2025-10-16T18:48:41.383071] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-16T18:48:41.383151] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETG took 43.5s. Estimated remaining: 3h 42m 60s. Rate: 7.1 symbols/min [2025-10-16T18:48:41.543959] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-16T18:48:41.555466] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:41.608173] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-16T18:48:41.608474] [INFO ] [MAIN ] ETSY: Loaded 53577 existing records. [2025-10-16T18:48:41.794626] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:41.794838] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-16T18:48:41.795077] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-16T18:48:41.795964] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-16T18:48:41.796024] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-16T18:48:42.152801] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:42.342810] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-16T18:48:43.043814] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:48:43.142778] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-16T18:48:43.805076] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T18:48:43.942781] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-16T18:48:44.742841] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-16T18:48:45.294277] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T18:48:45.471924] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:48:45.542804] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-16T18:48:46.342844] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-16T18:48:46.496436] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T18:48:46.962235] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:48:47.135370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:48:47.137158] [INFO ] [REMOTE ] ETO: Full fetch complete (9757 records). [2025-10-16T18:48:47.137226] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-16T18:48:47.148492] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-16T18:48:47.494039] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-16T18:48:47.494111] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-16T18:48:47.494334] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-16T18:48:47.494372] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-16T18:48:47.494808] [DEBUG] [LOCAL ] ETO: Trimmed 9757 records to 7024 (keeping 200 days of data) [2025-10-16T18:48:47.536139] [DEBUG] [LOCAL ] ETO: Primary data saved (7024 records). [2025-10-16T18:48:47.536232] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-16T18:48:47.536307] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETO took 24.2s. Estimated remaining: 3h 42m 47s. Rate: 7.1 symbols/min [2025-10-16T18:48:47.707961] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:48:47.730627] [DEBUG] [LOCAL ] ETV: Loaded 22258 existing records from primary storage. [2025-10-16T18:48:47.730900] [INFO ] [MAIN ] ETV: Loaded 22258 existing records. [2025-10-16T18:48:47.904071] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:48:47.904299] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-16T18:48:47.904351] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-16T18:48:47.904588] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-16T18:48:47.904675] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-16T18:48:47.947877] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-16T18:48:48.253205] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:48:48.742799] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-16T18:48:49.414681] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-16T18:48:49.489538] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:48:49.542774] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-16T18:48:49.993542] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T18:48:50.342846] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-16T18:48:51.087308] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:48:51.142786] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-16T18:48:51.240952] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T18:48:51.942801] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-16T18:48:52.708682] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T18:48:52.742812] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-16T18:48:53.542848] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-16T18:48:53.765286] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-16T18:48:54.068889] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T18:48:54.342908] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-16T18:48:55.142794] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-16T18:48:55.306637] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T18:48:55.855492] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:48:55.931530] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T18:48:55.942790] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-16T18:48:56.742841] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-16T18:48:57.542827] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-16T18:48:57.689917] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:48:58.342856] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-16T18:48:58.545571] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T18:48:58.567852] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T18:48:59.142812] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-16T18:48:59.811084] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T18:48:59.942773] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-16T18:49:00.210879] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:49:00.742784] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-16T18:49:01.542796] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-16T18:49:01.802708] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T18:49:01.812045] [INFO ] [REMOTE ] ETSY: Full fetch complete (77666 records). [2025-10-16T18:49:01.812350] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-16T18:49:02.085422] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T18:49:02.259811] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-16T18:49:02.259899] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-16T18:49:02.260929] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-16T18:49:02.260997] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-16T18:49:02.262532] [DEBUG] [LOCAL ] ETSY: Trimmed 77666 records to 53966 (keeping 200 days of data) [2025-10-16T18:49:02.346574] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-16T18:49:02.579336] [DEBUG] [LOCAL ] ETSY: Primary data saved (53966 records). [2025-10-16T18:49:02.579489] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-16T18:49:02.580421] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETSY took 21.2s. Estimated remaining: 3h 42m 52s. Rate: 7.1 symbols/min [2025-10-16T18:49:02.744487] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:02.770294] [DEBUG] [LOCAL ] ETW: Loaded 25583 existing records from primary storage. [2025-10-16T18:49:02.770547] [INFO ] [MAIN ] ETW: Loaded 25583 existing records. [2025-10-16T18:49:02.972425] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:02.972827] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-16T18:49:02.972939] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-16T18:49:02.973279] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-16T18:49:02.973357] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-16T18:49:03.145965] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-16T18:49:03.335318] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T18:49:03.375949] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:03.942836] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-16T18:49:04.381440] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:49:04.416257] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T18:49:04.422752] [INFO ] [REMOTE ] ETN: Full fetch complete (76657 records). [2025-10-16T18:49:04.422865] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-16T18:49:04.745442] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-16T18:49:04.829470] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-16T18:49:04.830086] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-16T18:49:04.830514] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T18:49:04.831779] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-16T18:49:04.837217] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-16T18:49:04.838717] [DEBUG] [LOCAL ] ETN: Trimmed 76657 records to 53020 (keeping 200 days of data) [2025-10-16T18:49:05.166880] [DEBUG] [LOCAL ] ETN: Primary data saved (53020 records). [2025-10-16T18:49:05.167051] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-16T18:49:05.167151] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETN took 56.9s. Estimated remaining: 3h 42m 32s. Rate: 7.1 symbols/min [2025-10-16T18:49:05.331725] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:05.341977] [DEBUG] [LOCAL ] ETX: Loaded 5256 existing records from primary storage. [2025-10-16T18:49:05.342162] [INFO ] [MAIN ] ETX: Loaded 5256 existing records. [2025-10-16T18:49:05.513588] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:05.513783] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-16T18:49:05.513831] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-16T18:49:05.513970] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-16T18:49:05.514007] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-16T18:49:05.548060] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-16T18:49:05.865298] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:06.342843] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-16T18:49:06.491036] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:49:06.626474] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:49:07.142823] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-16T18:49:07.415329] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T18:49:07.942817] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-16T18:49:08.725991] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:49:08.742779] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-16T18:49:09.542861] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-16T18:49:09.890624] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T18:49:10.342857] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-16T18:49:11.142877] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-16T18:49:11.465589] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:49:11.486288] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (4.34 seconds). [2025-10-16T18:49:11.657601] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T18:49:11.805053] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:49:11.942863] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-16T18:49:12.742820] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-16T18:49:13.119733] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:49:13.542866] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-16T18:49:13.652068] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T18:49:14.342776] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-16T18:49:14.586994] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T18:49:15.142781] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-16T18:49:15.390239] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T18:49:15.942785] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-16T18:49:16.314204] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:49:16.742823] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-16T18:49:17.288499] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:49:17.542836] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-16T18:49:17.765463] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:49:18.342869] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-16T18:49:18.798229] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:49:19.142880] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-16T18:49:19.900393] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T18:49:19.942776] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-16T18:49:20.451965] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:49:20.551240] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T18:49:20.742853] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-16T18:49:21.292439] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T18:49:21.542895] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-16T18:49:22.147443] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T18:49:22.342882] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-16T18:49:23.056003] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T18:49:23.142841] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-16T18:49:23.623348] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-16T18:49:23.942864] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-16T18:49:24.742835] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-16T18:49:25.542820] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-16T18:49:25.936400] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T18:49:25.943189] [INFO ] [REMOTE ] ETR: Full fetch complete (77284 records). [2025-10-16T18:49:25.943304] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-16T18:49:26.059432] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:49:26.081251] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-16T18:49:26.110951] [INFO ] [REMOTE ] ETV: Full fetch complete (32498 records). [2025-10-16T18:49:26.147205] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-16T18:49:26.355095] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-16T18:49:26.654427] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-16T18:49:26.664922] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-16T18:49:26.665992] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-16T18:49:26.666075] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-16T18:49:26.736095] [DEBUG] [LOCAL ] ETR: Trimmed 77284 records to 53597 (keeping 200 days of data) [2025-10-16T18:49:26.774880] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-16T18:49:26.775211] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-16T18:49:26.775583] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-16T18:49:26.775635] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-16T18:49:26.776467] [DEBUG] [LOCAL ] ETV: Trimmed 32498 records to 22403 (keeping 200 days of data) [2025-10-16T18:49:27.122418] [DEBUG] [LOCAL ] ETV: Primary data saved (22403 records). [2025-10-16T18:49:27.123396] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-16T18:49:27.123858] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETV took 39.6s. Estimated remaining: 3h 42m 51s. Rate: 7.1 symbols/min [2025-10-16T18:49:27.155270] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-16T18:49:27.323841] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:27.359315] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T18:49:27.379036] [DEBUG] [LOCAL ] ETY: Loaded 22961 existing records from primary storage. [2025-10-16T18:49:27.380062] [INFO ] [MAIN ] ETY: Loaded 22961 existing records. [2025-10-16T18:49:27.624280] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:27.626184] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-16T18:49:27.627107] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-16T18:49:27.627985] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-16T18:49:27.628636] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-16T18:49:27.884739] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T18:49:27.944155] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-16T18:49:27.973678] [DEBUG] [LOCAL ] ETR: Primary data saved (53597 records). [2025-10-16T18:49:27.987361] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-16T18:49:27.995960] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETR took 50.7s. Estimated remaining: 3h 42m 27s. Rate: 7.1 symbols/min [2025-10-16T18:49:28.028703] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:28.180015] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:28.199507] [DEBUG] [LOCAL ] EVC: Loaded 18093 existing records from primary storage. [2025-10-16T18:49:28.199781] [INFO ] [MAIN ] EVC: Loaded 18093 existing records. [2025-10-16T18:49:28.374875] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:28.375127] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-16T18:49:28.375184] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-16T18:49:28.375341] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-16T18:49:28.375378] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-16T18:49:28.639293] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T18:49:28.650675] [INFO ] [REMOTE ] ETX: Full fetch complete (6896 records). [2025-10-16T18:49:28.656278] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-16T18:49:28.765524] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-16T18:49:28.812575] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:29.086367] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-16T18:49:29.086444] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-16T18:49:29.086607] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-16T18:49:29.086666] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-16T18:49:29.087060] [DEBUG] [LOCAL ] ETX: Trimmed 6896 records to 5276 (keeping 200 days of data) [2025-10-16T18:49:29.118536] [DEBUG] [LOCAL ] ETX: Primary data saved (5276 records). [2025-10-16T18:49:29.118633] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-16T18:49:29.118745] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETX took 24.0s. Estimated remaining: 3h 42m 4s. Rate: 7.1 symbols/min [2025-10-16T18:49:29.285312] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:29.315845] [DEBUG] [LOCAL ] EVEX: Loaded 32374 existing records from primary storage. [2025-10-16T18:49:29.316098] [INFO ] [MAIN ] EVEX: Loaded 32374 existing records. [2025-10-16T18:49:29.492031] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:29.492259] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-16T18:49:29.492312] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-16T18:49:29.492483] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-16T18:49:29.492520] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-16T18:49:29.552665] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-16T18:49:29.841849] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:29.941178] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:49:30.342796] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-16T18:49:30.654374] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:49:30.658366] [INFO ] [REMOTE ] ETW: Full fetch complete (36810 records). [2025-10-16T18:49:30.658483] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-16T18:49:31.033032] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-16T18:49:31.033112] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-16T18:49:31.033765] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-16T18:49:31.033828] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-16T18:49:31.034572] [DEBUG] [LOCAL ] ETW: Trimmed 36810 records to 25709 (keeping 200 days of data) [2025-10-16T18:49:31.142827] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-16T18:49:31.187603] [DEBUG] [LOCAL ] ETW: Primary data saved (25709 records). [2025-10-16T18:49:31.187760] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-16T18:49:31.187843] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETW took 28.6s. Estimated remaining: 3h 41m 43s. Rate: 7.2 symbols/min [2025-10-16T18:49:31.356153] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:31.367699] [DEBUG] [LOCAL ] EVF: Loaded 9830 existing records from primary storage. [2025-10-16T18:49:31.367902] [INFO ] [MAIN ] EVF: Loaded 9830 existing records. [2025-10-16T18:49:31.547070] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:31.547316] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-16T18:49:31.547365] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-16T18:49:31.547521] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-16T18:49:31.547558] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-16T18:49:31.921376] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T18:49:31.925594] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:31.942771] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-16T18:49:32.288292] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T18:49:32.742787] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-16T18:49:33.082937] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T18:49:33.542809] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-16T18:49:33.736916] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T18:49:34.342816] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-16T18:49:34.536968] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T18:49:35.138873] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T18:49:35.144329] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-16T18:49:35.640760] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T18:49:35.942819] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-16T18:49:36.743981] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-16T18:49:36.746295] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:49:37.298562] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T18:49:37.542802] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-16T18:49:37.938419] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:49:38.342820] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-16T18:49:39.142784] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-16T18:49:39.354845] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T18:49:39.890168] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T18:49:39.942816] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-16T18:49:40.742802] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-16T18:49:40.984009] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T18:49:41.502346] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T18:49:41.542841] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-16T18:49:42.342869] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-16T18:49:42.447851] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T18:49:42.934689] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T18:49:43.142800] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-16T18:49:43.713591] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T18:49:43.942813] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-16T18:49:44.742805] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-16T18:49:44.931172] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T18:49:45.542804] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-16T18:49:45.666590] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-16T18:49:46.342806] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-16T18:49:46.371993] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T18:49:47.142802] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-16T18:49:47.196831] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-16T18:49:47.942803] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-16T18:49:48.146686] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T18:49:48.728236] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T18:49:48.742766] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-16T18:49:49.325063] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T18:49:49.542887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-16T18:49:50.342806] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-16T18:49:50.566969] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T18:49:50.569550] [INFO ] [REMOTE ] EVF: Full fetch complete (12840 records). [2025-10-16T18:49:50.569738] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-16T18:49:50.961961] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-16T18:49:50.962061] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-16T18:49:50.962578] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-16T18:49:50.962706] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-16T18:49:50.963271] [DEBUG] [LOCAL ] EVF: Trimmed 12840 records to 9864 (keeping 200 days of data) [2025-10-16T18:49:51.026010] [DEBUG] [LOCAL ] EVF: Primary data saved (9864 records). [2025-10-16T18:49:51.026195] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-16T18:49:51.026290] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVF took 19.8s. Estimated remaining: 3h 41m 58s. Rate: 7.1 symbols/min [2025-10-16T18:49:51.148004] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-16T18:49:51.204872] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:49:51.219103] [DEBUG] [LOCAL ] EVG: Loaded 5933 existing records from primary storage. [2025-10-16T18:49:51.219488] [INFO ] [MAIN ] EVG: Loaded 5933 existing records. [2025-10-16T18:49:51.404593] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:49:51.405138] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-16T18:49:51.405205] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-16T18:49:51.405383] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-16T18:49:51.405425] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-16T18:49:51.739171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T18:49:51.825094] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:49:51.942849] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-16T18:49:52.278284] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T18:49:52.557704] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:49:52.742848] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-16T18:49:53.542740] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-16T18:49:53.581105] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T18:49:54.342824] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-16T18:49:54.933592] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:49:55.085531] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:49:55.142823] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-16T18:49:55.942821] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-16T18:49:56.404866] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T18:49:56.664169] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:49:56.742883] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-16T18:49:57.542826] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-16T18:49:57.890833] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T18:49:58.133721] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-16T18:49:58.342879] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-16T18:49:59.142879] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-16T18:49:59.908160] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:49:59.942780] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-16T18:49:59.966093] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T18:50:00.742858] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-16T18:50:01.542883] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-16T18:50:01.772587] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T18:50:01.778967] [INFO ] [REMOTE ] EVEX: Full fetch complete (43504 records). [2025-10-16T18:50:01.779065] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-16T18:50:02.017376] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T18:50:02.175586] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-16T18:50:02.175692] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-16T18:50:02.176410] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-16T18:50:02.176454] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-16T18:50:02.177454] [DEBUG] [LOCAL ] EVEX: Trimmed 43504 records to 32729 (keeping 200 days of data) [2025-10-16T18:50:02.343276] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-16T18:50:02.367152] [DEBUG] [LOCAL ] EVEX: Primary data saved (32729 records). [2025-10-16T18:50:02.367326] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-16T18:50:02.367416] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVEX took 33.2s. Estimated remaining: 3h 41m 55s. Rate: 7.1 symbols/min [2025-10-16T18:50:02.543997] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:02.584950] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:50:02.603512] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-16T18:50:02.603837] [INFO ] [MAIN ] EVH: Loaded 49624 existing records. [2025-10-16T18:50:02.780154] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:02.780438] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-16T18:50:02.780500] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-16T18:50:02.780950] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-16T18:50:02.781018] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-16T18:50:03.145332] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-16T18:50:03.176193] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:03.593449] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T18:50:03.942883] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-16T18:50:04.213987] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T18:50:04.636234] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-16T18:50:04.742788] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-16T18:50:05.542893] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-16T18:50:05.964491] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T18:50:06.342808] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-16T18:50:07.142799] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-16T18:50:07.297767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T18:50:07.398818] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T18:50:07.400975] [INFO ] [REMOTE ] EVC: Full fetch complete (28929 records). [2025-10-16T18:50:07.401045] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-16T18:50:07.618394] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-16T18:50:07.768828] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-16T18:50:07.768902] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-16T18:50:07.769442] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-16T18:50:07.769480] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-16T18:50:07.770145] [DEBUG] [LOCAL ] EVC: Trimmed 28929 records to 18191 (keeping 200 days of data) [2025-10-16T18:50:07.871398] [DEBUG] [LOCAL ] EVC: Primary data saved (18191 records). [2025-10-16T18:50:07.871533] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-16T18:50:07.871611] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVC took 39.9s. Estimated remaining: 3h 41m 41s. Rate: 7.1 symbols/min [2025-10-16T18:50:07.947997] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-16T18:50:08.039066] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:08.051279] [DEBUG] [LOCAL ] EVN: Loaded 10787 existing records from primary storage. [2025-10-16T18:50:08.051476] [INFO ] [MAIN ] EVN: Loaded 10787 existing records. [2025-10-16T18:50:08.222341] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:08.222581] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-16T18:50:08.222627] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-16T18:50:08.222822] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-16T18:50:08.222877] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-16T18:50:08.568511] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:08.683803] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T18:50:08.742769] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-16T18:50:09.542786] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-16T18:50:09.688141] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T18:50:10.342829] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-16T18:50:10.530995] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T18:50:11.043803] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T18:50:11.142821] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-16T18:50:11.942839] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-16T18:50:12.133586] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:50:12.436809] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T18:50:12.742841] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-16T18:50:13.542846] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-16T18:50:14.072356] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T18:50:14.074262] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T18:50:14.342804] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-16T18:50:15.142861] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-16T18:50:15.771980] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T18:50:15.942852] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-16T18:50:15.979350] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T18:50:16.742839] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-16T18:50:16.851064] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T18:50:16.855276] [INFO ] [REMOTE ] ETY: Full fetch complete (34335 records). [2025-10-16T18:50:16.855468] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-16T18:50:17.238881] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-16T18:50:17.239196] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-16T18:50:17.239926] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-16T18:50:17.240015] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-16T18:50:17.255256] [DEBUG] [LOCAL ] ETY: Trimmed 34335 records to 23111 (keeping 200 days of data) [2025-10-16T18:50:17.255110] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-16T18:50:17.405066] [DEBUG] [LOCAL ] ETY: Primary data saved (23111 records). [2025-10-16T18:50:17.405213] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-16T18:50:17.405298] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. ETY took 50.3s. Estimated remaining: 3h 41m 35s. Rate: 7.1 symbols/min [2025-10-16T18:50:17.549451] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-16T18:50:17.576066] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:17.608625] [DEBUG] [LOCAL ] EVR: Loaded 34420 existing records from primary storage. [2025-10-16T18:50:17.608983] [INFO ] [MAIN ] EVR: Loaded 34420 existing records. [2025-10-16T18:50:17.793768] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:17.794044] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-16T18:50:17.794100] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-16T18:50:17.794751] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-16T18:50:17.794809] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-16T18:50:18.143047] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:18.164868] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:50:18.342822] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-16T18:50:18.933689] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T18:50:18.935017] [INFO ] [REMOTE ] EVG: Full fetch complete (8200 records). [2025-10-16T18:50:18.935086] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-16T18:50:19.147998] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-16T18:50:19.311774] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-16T18:50:19.311853] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-16T18:50:19.312099] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-16T18:50:19.312147] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-16T18:50:19.312549] [DEBUG] [LOCAL ] EVG: Trimmed 8200 records to 5979 (keeping 200 days of data) [2025-10-16T18:50:19.348764] [DEBUG] [LOCAL ] EVG: Primary data saved (5979 records). [2025-10-16T18:50:19.348862] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-16T18:50:19.348936] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVG took 28.3s. Estimated remaining: 3h 41m 13s. Rate: 7.1 symbols/min [2025-10-16T18:50:19.512029] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:19.529577] [DEBUG] [LOCAL ] EVT: Loaded 16833 existing records from primary storage. [2025-10-16T18:50:19.529852] [INFO ] [MAIN ] EVT: Loaded 16833 existing records. [2025-10-16T18:50:19.703351] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:19.703607] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-16T18:50:19.703682] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-16T18:50:19.703867] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-16T18:50:19.703906] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-16T18:50:19.954688] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-16T18:50:20.075761] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:20.562038] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:50:20.742836] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-16T18:50:20.800889] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T18:50:21.542816] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-16T18:50:22.286752] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T18:50:22.342785] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-16T18:50:22.589160] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T18:50:23.142842] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-16T18:50:23.720091] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T18:50:23.942801] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-16T18:50:24.526898] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:50:24.742817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-16T18:50:24.816956] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T18:50:25.446949] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T18:50:25.542841] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-16T18:50:26.342846] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-16T18:50:26.482018] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:50:27.142817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-16T18:50:27.654141] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-16T18:50:27.684109] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T18:50:27.942823] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-16T18:50:28.713659] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T18:50:28.742804] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-16T18:50:29.542829] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-16T18:50:29.629993] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T18:50:30.342931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-16T18:50:30.552690] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T18:50:30.909289] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T18:50:31.142817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-16T18:50:31.942833] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-16T18:50:32.071695] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:50:32.074719] [INFO ] [REMOTE ] EVN: Full fetch complete (17325 records). [2025-10-16T18:50:32.074863] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-16T18:50:32.474788] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-16T18:50:32.474875] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-16T18:50:32.475257] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-16T18:50:32.475299] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-16T18:50:32.475939] [DEBUG] [LOCAL ] EVN: Trimmed 17325 records to 10839 (keeping 200 days of data) [2025-10-16T18:50:32.543915] [DEBUG] [LOCAL ] EVN: Primary data saved (10839 records). [2025-10-16T18:50:32.544081] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-16T18:50:32.544168] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 24.7s. Estimated remaining: 3h 41m 15s. Rate: 7.1 symbols/min [2025-10-16T18:50:32.711874] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:32.735633] [DEBUG] [LOCAL ] EVTC: Loaded 26787 existing records from primary storage. [2025-10-16T18:50:32.735900] [INFO ] [MAIN ] EVTC: Loaded 26787 existing records. [2025-10-16T18:50:32.748326] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-16T18:50:32.910466] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:32.910684] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-16T18:50:32.910744] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-16T18:50:32.911249] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-16T18:50:32.911306] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-16T18:50:33.260631] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:33.542810] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-16T18:50:33.599802] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T18:50:34.347969] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-16T18:50:34.365300] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:50:34.674987] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T18:50:35.142813] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-16T18:50:35.349604] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:50:35.908052] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-16T18:50:35.942776] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-16T18:50:36.742791] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-16T18:50:36.882155] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-16T18:50:37.542838] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-16T18:50:37.923743] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T18:50:38.342816] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-16T18:50:38.866920] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:50:39.142803] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-16T18:50:39.767059] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:50:39.942837] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-16T18:50:40.742787] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-16T18:50:40.811365] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T18:50:40.977676] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:50:41.542784] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-16T18:50:41.737019] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T18:50:42.342817] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-16T18:50:43.142837] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-16T18:50:43.177757] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T18:50:43.234421] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T18:50:43.942783] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-16T18:50:44.095139] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T18:50:44.742793] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-16T18:50:44.883793] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T18:50:45.542857] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-16T18:50:46.342833] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-16T18:50:46.430818] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:50:46.561273] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:50:46.942771] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T18:50:47.142861] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-16T18:50:47.942852] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-16T18:50:48.521603] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:50:48.528166] [INFO ] [REMOTE ] EVH: Full fetch complete (71861 records). [2025-10-16T18:50:48.528345] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-16T18:50:48.751806] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-16T18:50:48.940446] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-16T18:50:48.940521] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-16T18:50:48.941451] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-16T18:50:48.941513] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-16T18:50:48.942857] [DEBUG] [LOCAL ] EVH: Trimmed 71861 records to 49986 (keeping 200 days of data) [2025-10-16T18:50:49.225220] [DEBUG] [LOCAL ] EVH: Primary data saved (49986 records). [2025-10-16T18:50:49.225435] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-16T18:50:49.225697] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVH took 46.9s. Estimated remaining: 3h 41m 23s. Rate: 7.1 symbols/min [2025-10-16T18:50:49.420085] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T18:50:49.422448] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:49.465908] [DEBUG] [LOCAL ] EVTL: Loaded 40293 existing records from primary storage. [2025-10-16T18:50:49.466237] [INFO ] [MAIN ] EVTL: Loaded 40293 existing records. [2025-10-16T18:50:49.545608] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-16T18:50:49.648519] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:50:49.648893] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-16T18:50:49.648960] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-16T18:50:49.669123] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T18:50:49.669186] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-16T18:50:49.672086] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-16T18:50:50.033112] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:50.342798] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-16T18:50:50.609272] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:50:51.142852] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-16T18:50:51.630198] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:50:51.942839] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-16T18:50:52.543207] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T18:50:52.620449] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:50:52.622839] [INFO ] [REMOTE ] EVT: Full fetch complete (25299 records). [2025-10-16T18:50:52.622913] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-16T18:50:52.748002] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-16T18:50:52.999354] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-16T18:50:52.999436] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-16T18:50:53.000027] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-16T18:50:53.000089] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-16T18:50:53.000734] [DEBUG] [LOCAL ] EVT: Trimmed 25299 records to 16930 (keeping 200 days of data) [2025-10-16T18:50:53.106671] [DEBUG] [LOCAL ] EVT: Primary data saved (16930 records). [2025-10-16T18:50:53.106826] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-16T18:50:53.106906] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 33.8s. Estimated remaining: 3h 41m 5s. Rate: 7.1 symbols/min [2025-10-16T18:50:53.284246] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:50:53.284441] [DEBUG] [LOCAL ] EVTR: No existing data file found in primary storage. [2025-10-16T18:50:53.284482] [WARN ] [MAIN ] EVTR: No existing data found, performing full refresh instead. [2025-10-16T18:50:53.284594] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-16T18:50:53.284636] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-16T18:50:53.284723] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-16T18:50:53.284761] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-16T18:50:53.547962] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-16T18:50:53.650706] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:50:53.919769] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T18:50:54.342783] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-16T18:50:54.809152] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:50:55.052992] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-16T18:50:55.142807] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-16T18:50:55.942758] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-16T18:50:56.063859] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T18:50:56.742925] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-16T18:50:56.884147] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T18:50:57.542841] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-16T18:50:57.721323] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-16T18:50:58.342830] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-16T18:50:58.844258] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:50:58.930043] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-16T18:50:59.142819] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-16T18:50:59.942813] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-16T18:51:00.199779] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T18:51:00.203999] [INFO ] [REMOTE ] EVTC: Full fetch complete (38377 records). [2025-10-16T18:51:00.204087] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-16T18:51:00.579069] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-16T18:51:00.579145] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-16T18:51:00.579879] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-16T18:51:00.579942] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-16T18:51:00.580785] [DEBUG] [LOCAL ] EVTC: Trimmed 38377 records to 27014 (keeping 200 days of data) [2025-10-16T18:51:00.743006] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-16T18:51:00.744257] [DEBUG] [LOCAL ] EVTC: Primary data saved (27014 records). [2025-10-16T18:51:00.745180] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-16T18:51:00.745296] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVTC took 28.2s. Estimated remaining: 3h 40m 55s. Rate: 7.1 symbols/min [2025-10-16T18:51:00.938049] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:00.986443] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-16T18:51:00.986857] [INFO ] [MAIN ] EW: Loaded 53406 existing records. [2025-10-16T18:51:01.185776] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:01.180434] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T18:51:01.192009] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-16T18:51:01.192111] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-16T18:51:01.193925] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-16T18:51:01.193996] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-16T18:51:01.546385] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-16T18:51:01.586840] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:02.335714] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:51:02.345929] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-16T18:51:02.652537] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T18:51:03.142851] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-16T18:51:03.942785] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-16T18:51:04.179499] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T18:51:04.459319] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T18:51:04.464135] [INFO ] [REMOTE ] EVR: Full fetch complete (50850 records). [2025-10-16T18:51:04.464225] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-16T18:51:04.745248] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-16T18:51:04.858703] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T18:51:04.858087] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-16T18:51:04.863100] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-16T18:51:04.864297] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-16T18:51:04.864633] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-16T18:51:04.865622] [DEBUG] [LOCAL ] EVR: Trimmed 50850 records to 34630 (keeping 200 days of data) [2025-10-16T18:51:05.086305] [DEBUG] [LOCAL ] EVR: Primary data saved (34630 records). [2025-10-16T18:51:05.086447] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-16T18:51:05.086538] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVR took 47.7s. Estimated remaining: 3h 40m 39s. Rate: 7.1 symbols/min [2025-10-16T18:51:05.250921] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:05.281381] [DEBUG] [LOCAL ] EXG: Loaded 34033 existing records from primary storage. [2025-10-16T18:51:05.281672] [INFO ] [MAIN ] EXG: Loaded 34033 existing records. [2025-10-16T18:51:05.458287] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:05.458532] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-16T18:51:05.458583] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-16T18:51:05.459337] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-16T18:51:05.459394] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-16T18:51:05.553026] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-16T18:51:05.804966] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:06.342810] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-16T18:51:06.789918] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-16T18:51:06.896685] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-16T18:51:07.142807] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-16T18:51:07.684755] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:51:07.942886] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-16T18:51:08.742874] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-16T18:51:08.800155] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:51:09.136302] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T18:51:09.542809] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-16T18:51:10.092915] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T18:51:10.342809] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-16T18:51:10.587437] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-16T18:51:11.142813] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-16T18:51:11.575745] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T18:51:11.942815] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-16T18:51:12.742827] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-16T18:51:12.930805] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T18:51:13.463121] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T18:51:13.542857] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-16T18:51:13.848701] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T18:51:14.342783] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-16T18:51:14.414534] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T18:51:15.142875] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-16T18:51:15.691591] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T18:51:15.942828] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-16T18:51:16.267784] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:51:16.742808] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-16T18:51:17.542842] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-16T18:51:17.627909] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:51:18.342804] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-16T18:51:18.397079] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T18:51:18.422448] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T18:51:19.142968] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-16T18:51:19.942843] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-16T18:51:20.377605] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-16T18:51:20.742803] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-16T18:51:20.797597] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T18:51:20.826452] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:51:21.542845] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-16T18:51:22.317051] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T18:51:22.342825] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-16T18:51:22.767984] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T18:51:23.142897] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-16T18:51:23.942844] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-16T18:51:24.309900] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T18:51:24.714008] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T18:51:24.742771] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-16T18:51:25.542947] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-16T18:51:25.784489] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T18:51:26.342856] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-16T18:51:26.387200] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T18:51:26.394076] [INFO ] [REMOTE ] EVTL: Full fetch complete (54383 records). [2025-10-16T18:51:26.394210] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-16T18:51:26.775767] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-16T18:51:26.775857] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-16T18:51:26.776640] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-16T18:51:26.776758] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-16T18:51:26.778091] [DEBUG] [LOCAL ] EVTL: Trimmed 54383 records to 40675 (keeping 200 days of data) [2025-10-16T18:51:26.988978] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:51:26.994779] [INFO ] [REMOTE ] EVTR: Full fetch complete (33539 records). [2025-10-16T18:51:26.997067] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-16T18:51:27.182670] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-16T18:51:27.311726] [DEBUG] [LOCAL ] EVTL: Primary data saved (40675 records). [2025-10-16T18:51:27.314086] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-16T18:51:27.314455] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 38.1s. Estimated remaining: 3h 40m 58s. Rate: 7.1 symbols/min [2025-10-16T18:51:27.524168] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-16T18:51:27.536536] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-16T18:51:27.543214] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-16T18:51:27.566804] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-16T18:51:27.570215] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:27.571153] [DEBUG] [LOCAL ] EVTR: Trimmed 33539 records to 25015 (keeping 200 days of data) [2025-10-16T18:51:27.710871] [DEBUG] [LOCAL ] EXK: Loaded 53171 existing records from primary storage. [2025-10-16T18:51:27.712131] [INFO ] [MAIN ] EXK: Loaded 53171 existing records. [2025-10-16T18:51:27.900907] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:27.903242] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-16T18:51:27.903411] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-16T18:51:27.918789] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-16T18:51:27.921564] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-16T18:51:28.047160] [DEBUG] [LOCAL ] EVTR: Primary data saved (25015 records). [2025-10-16T18:51:28.068532] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-16T18:51:28.093837] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EVTR took 35.0s. Estimated remaining: 3h 40m 34s. Rate: 7.1 symbols/min [2025-10-16T18:51:28.423356] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:28.530025] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:28.530931] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-16T18:51:28.532847] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T18:51:28.573100] [DEBUG] [LOCAL ] EXP: Loaded 29600 existing records from primary storage. [2025-10-16T18:51:28.573378] [INFO ] [MAIN ] EXP: Loaded 29600 existing records. [2025-10-16T18:51:28.749764] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-16T18:51:28.761696] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T18:51:28.790398] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:28.791342] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-16T18:51:28.799249] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-16T18:51:28.800220] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-16T18:51:28.800277] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-16T18:51:29.144222] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:29.542812] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-16T18:51:30.177897] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:51:30.256691] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:51:30.342790] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-16T18:51:30.913320] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T18:51:31.018849] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T18:51:31.025843] [INFO ] [REMOTE ] EW: Full fetch complete (77520 records). [2025-10-16T18:51:31.026001] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-16T18:51:31.148016] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-16T18:51:31.463193] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-16T18:51:31.463282] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-16T18:51:31.464442] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-16T18:51:31.464516] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-16T18:51:31.466127] [DEBUG] [LOCAL ] EW: Trimmed 77520 records to 53793 (keeping 200 days of data) [2025-10-16T18:51:31.806367] [DEBUG] [LOCAL ] EW: Primary data saved (53793 records). [2025-10-16T18:51:31.806538] [INFO ] [MAIN ] EW: Full history saved. [2025-10-16T18:51:31.807278] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EW took 31.1s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-16T18:51:31.943678] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-16T18:51:32.007234] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:51:32.058488] [DEBUG] [LOCAL ] EXPD: Loaded 47973 existing records from primary storage. [2025-10-16T18:51:32.058859] [INFO ] [MAIN ] EXPD: Loaded 47973 existing records. [2025-10-16T18:51:32.238879] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:51:32.239150] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-16T18:51:32.239251] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-16T18:51:32.239639] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-16T18:51:32.239726] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-16T18:51:32.516330] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T18:51:32.637994] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:51:32.742817] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-16T18:51:33.503924] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T18:51:33.542782] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-16T18:51:34.003219] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:51:34.342855] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-16T18:51:34.848610] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T18:51:35.142828] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-16T18:51:35.953150] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-16T18:51:35.960514] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T18:51:36.143913] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-16T18:51:36.742850] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-16T18:51:37.491255] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:51:37.542808] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-16T18:51:37.963501] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-16T18:51:37.972198] [INFO ] [REMOTE ] EXG: Full fetch complete (49898 records). [2025-10-16T18:51:37.972418] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-16T18:51:38.343164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-16T18:51:38.343542] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-16T18:51:38.343848] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-16T18:51:38.345361] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-16T18:51:38.345545] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-16T18:51:38.346699] [DEBUG] [LOCAL ] EXG: Trimmed 49898 records to 34277 (keeping 200 days of data) [2025-10-16T18:51:38.549923] [DEBUG] [LOCAL ] EXG: Primary data saved (34277 records). [2025-10-16T18:51:38.550061] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-16T18:51:38.550151] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXG took 33.5s. Estimated remaining: 3h 40m 5s. Rate: 7.1 symbols/min [2025-10-16T18:51:39.142822] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-16T18:51:39.362477] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T18:51:39.942820] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-16T18:51:39.988168] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T18:51:40.195596] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T18:51:40.742892] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-16T18:51:41.407196] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:51:41.542809] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-16T18:51:42.324507] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:51:42.342776] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-16T18:51:43.142853] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-16T18:51:43.296450] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T18:51:43.942796] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-16T18:51:44.037730] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T18:51:44.092825] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T18:51:44.742878] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-16T18:51:45.542926] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-16T18:51:46.140579] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-16T18:51:46.342862] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-16T18:51:46.527523] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:51:47.142902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-16T18:51:47.336379] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:51:47.942863] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-16T18:51:48.103968] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T18:51:48.474018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T18:51:48.742819] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-16T18:51:49.554788] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-16T18:51:49.560044] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:51:50.342814] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-16T18:51:50.674156] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:51:50.926895] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T18:51:51.142868] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-16T18:51:51.832229] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T18:51:51.942837] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-16T18:51:52.742855] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-16T18:51:52.989587] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T18:51:53.331253] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T18:51:53.338266] [INFO ] [REMOTE ] EXK: Full fetch complete (76794 records). [2025-10-16T18:51:53.338479] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-16T18:51:53.570977] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-16T18:51:53.740477] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-16T18:51:53.740567] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-16T18:51:53.741558] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-16T18:51:53.741628] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-16T18:51:53.743312] [DEBUG] [LOCAL ] EXK: Trimmed 76794 records to 53561 (keeping 200 days of data) [2025-10-16T18:51:54.049592] [DEBUG] [LOCAL ] EXK: Primary data saved (53561 records). [2025-10-16T18:51:54.049771] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-16T18:51:54.049857] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXK took 26.7s. Estimated remaining: 3h 40m 11s. Rate: 7.1 symbols/min [2025-10-16T18:51:54.134187] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T18:51:54.342856] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-16T18:51:54.581087] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T18:51:55.142833] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-16T18:51:55.726253] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T18:51:55.942797] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-16T18:51:56.327810] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T18:51:56.742929] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-16T18:51:57.263173] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T18:51:57.542903] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-16T18:51:57.828383] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T18:51:58.342845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-16T18:51:58.736087] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T18:51:58.744995] [INFO ] [REMOTE ] EXPD: Full fetch complete (69548 records). [2025-10-16T18:51:58.745160] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-16T18:51:59.133028] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-16T18:51:59.133132] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-16T18:51:59.134076] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-16T18:51:59.134140] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-16T18:51:59.135446] [DEBUG] [LOCAL ] EXPD: Trimmed 69548 records to 48303 (keeping 200 days of data) [2025-10-16T18:51:59.428279] [DEBUG] [LOCAL ] EXPD: Primary data saved (48303 records). [2025-10-16T18:51:59.428414] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-16T18:51:59.429270] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXPD took 27.6s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-16T18:51:59.555952] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T18:51:59.560701] [INFO ] [REMOTE ] EXP: Full fetch complete (42968 records). [2025-10-16T18:51:59.560826] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-16T18:51:59.933070] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-16T18:51:59.933145] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-16T18:51:59.933848] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-16T18:51:59.933911] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-16T18:51:59.934797] [DEBUG] [LOCAL ] EXP: Trimmed 42968 records to 29802 (keeping 200 days of data) [2025-10-16T18:52:00.121412] [DEBUG] [LOCAL ] EXP: Primary data saved (29802 records). [2025-10-16T18:52:00.121560] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-16T18:52:00.121678] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXP took 32.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-16T18:52:00.643439] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.764709] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.821162] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.824846] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:00.865402] [DEBUG] [LOCAL ] FAF: Loaded 41492 existing records from primary storage. [2025-10-16T18:52:00.865895] [INFO ] [MAIN ] FAF: Loaded 41492 existing records. [2025-10-16T18:52:01.053805] [DEBUG] [LOCAL ] FBIN: Loaded 50393 existing records from primary storage. [2025-10-16T18:52:01.053121] [DEBUG] [LOCAL ] EXR: Loaded 45550 existing records from primary storage. [2025-10-16T18:52:01.081485] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-16T18:52:01.094835] [INFO ] [MAIN ] FBIN: Loaded 50393 existing records. [2025-10-16T18:52:01.122493] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-16T18:52:01.122312] [INFO ] [MAIN ] EXR: Loaded 45550 existing records. [2025-10-16T18:52:01.168469] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.230529] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.298395] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-16T18:52:01.419674] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-16T18:52:01.464505] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-16T18:52:01.780193] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.801300] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.801407] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-16T18:52:01.830746] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-16T18:52:01.842424] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.851563] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-16T18:52:01.851434] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.847179] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:01.851906] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-16T18:52:01.878088] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-16T18:52:01.878371] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-16T18:52:01.883669] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-16T18:52:01.908389] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-16T18:52:01.945040] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-16T18:52:02.002269] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-16T18:52:02.842966] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:02.905191] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-16T18:52:03.121584] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.161714] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-16T18:52:03.263631] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.270176] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-16T18:52:03.269738] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:03.271471] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-16T18:52:04.356220] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:52:04.363592] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-16T18:52:04.608683] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T18:52:04.618340] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-16T18:52:04.926339] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:52:04.936639] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-16T18:52:05.328126] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T18:52:05.340080] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-16T18:52:05.796571] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T18:52:05.803901] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-16T18:52:06.107366] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T18:52:06.168280] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T18:52:06.342860] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-16T18:52:06.710151] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T18:52:07.142850] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-16T18:52:07.421383] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-16T18:52:07.458430] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T18:52:07.942864] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-16T18:52:08.553473] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T18:52:08.742848] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-16T18:52:09.542945] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-16T18:52:10.284988] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-16T18:52:10.330749] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T18:52:10.342767] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-16T18:52:10.808750] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:52:11.142778] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-16T18:52:11.848505] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:52:11.942777] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-16T18:52:12.697361] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T18:52:12.742783] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-16T18:52:13.517596] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T18:52:13.542769] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-16T18:52:14.342774] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-16T18:52:14.368789] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T18:52:15.080126] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T18:52:15.142877] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-16T18:52:15.884615] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:52:15.942823] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-16T18:52:16.742829] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-16T18:52:17.380752] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-16T18:52:17.439399] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T18:52:17.542832] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-16T18:52:18.177774] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:52:18.342852] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-16T18:52:18.977839] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T18:52:19.142790] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-16T18:52:19.829890] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T18:52:19.942821] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-16T18:52:20.742830] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-16T18:52:20.949796] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T18:52:21.515095] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T18:52:21.520619] [INFO ] [REMOTE ] FAF: Full fetch complete (58041 records). [2025-10-16T18:52:21.520811] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-16T18:52:21.547960] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-16T18:52:21.938065] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-16T18:52:21.938178] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-16T18:52:21.939143] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-16T18:52:21.939206] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-16T18:52:21.940685] [DEBUG] [LOCAL ] FAF: Trimmed 58041 records to 41803 (keeping 200 days of data) [2025-10-16T18:52:22.210717] [DEBUG] [LOCAL ] FAF: Primary data saved (41803 records). [2025-10-16T18:52:22.210845] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-16T18:52:22.210931] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 22.1s. Estimated remaining: 3h 39m 51s. Rate: 7.1 symbols/min [2025-10-16T18:52:22.346579] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-16T18:52:22.402912] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:22.434771] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T18:52:22.466237] [DEBUG] [LOCAL ] FBK: Loaded 27411 existing records from primary storage. [2025-10-16T18:52:22.466516] [INFO ] [MAIN ] FBK: Loaded 27411 existing records. [2025-10-16T18:52:22.652028] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:22.652274] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-16T18:52:22.652322] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-16T18:52:22.652517] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-16T18:52:22.652574] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-16T18:52:23.012858] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:23.142844] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-16T18:52:23.942810] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-16T18:52:24.102607] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T18:52:24.102085] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:52:24.163283] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-16T18:52:24.742836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-16T18:52:25.438883] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T18:52:25.542806] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-16T18:52:26.342838] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-16T18:52:26.381854] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T18:52:26.851451] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-16T18:52:27.142849] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-16T18:52:27.835392] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T18:52:27.942809] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-16T18:52:28.600854] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T18:52:28.742787] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-16T18:52:28.868040] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T18:52:29.542794] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-16T18:52:30.342816] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-16T18:52:30.905384] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-16T18:52:30.932559] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T18:52:30.938483] [INFO ] [REMOTE ] EXR: Full fetch complete (66163 records). [2025-10-16T18:52:30.938684] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-16T18:52:31.147918] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-16T18:52:31.275692] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T18:52:31.357890] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-16T18:52:31.357988] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-16T18:52:31.359029] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-16T18:52:31.359100] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-16T18:52:31.360515] [DEBUG] [LOCAL ] EXR: Trimmed 66163 records to 45888 (keeping 200 days of data) [2025-10-16T18:52:31.654701] [DEBUG] [LOCAL ] EXR: Primary data saved (45888 records). [2025-10-16T18:52:31.654853] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-16T18:52:31.654955] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. EXR took 31.5s. Estimated remaining: 3h 39m 45s. Rate: 7.1 symbols/min [2025-10-16T18:52:31.836681] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:31.884559] [DEBUG] [LOCAL ] FBP: Loaded 45728 existing records from primary storage. [2025-10-16T18:52:31.884969] [INFO ] [MAIN ] FBP: Loaded 45728 existing records. [2025-10-16T18:52:31.948289] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-16T18:52:32.099148] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:32.099379] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-16T18:52:32.099427] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-16T18:52:32.099689] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-16T18:52:32.099760] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-16T18:52:32.486688] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:32.742824] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-16T18:52:32.919471] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-16T18:52:32.950137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T18:52:33.542835] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-16T18:52:34.253405] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T18:52:34.342812] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-16T18:52:34.986064] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:52:35.142818] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-16T18:52:35.885888] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:52:35.942776] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-16T18:52:36.742836] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-16T18:52:37.027226] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T18:52:37.240590] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T18:52:37.542828] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-16T18:52:37.806263] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:52:38.342814] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-16T18:52:39.142848] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-16T18:52:39.747531] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-16T18:52:39.942861] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-16T18:52:40.046599] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:52:40.228130] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:52:40.742844] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-16T18:52:41.543012] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-16T18:52:42.075394] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T18:52:42.342866] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-16T18:52:42.422078] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T18:52:42.919538] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T18:52:43.142842] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-16T18:52:43.177947] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T18:52:43.184784] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-16T18:52:43.184911] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-16T18:52:43.567820] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-16T18:52:43.567896] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-16T18:52:43.568897] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-16T18:52:43.568961] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-16T18:52:43.570405] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54210 (keeping 200 days of data) [2025-10-16T18:52:43.911470] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-16T18:52:43.911609] [INFO ] [MAIN ] F: Full history saved. [2025-10-16T18:52:43.912484] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. F took 43.8s. Estimated remaining: 3h 39m 44s. Rate: 7.1 symbols/min [2025-10-16T18:52:43.947156] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-16T18:52:44.090919] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:44.127371] [DEBUG] [LOCAL ] FBRT: Loaded 35439 existing records from primary storage. [2025-10-16T18:52:44.127629] [INFO ] [MAIN ] FBRT: Loaded 35439 existing records. [2025-10-16T18:52:44.305223] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:44.305430] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-16T18:52:44.305476] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-16T18:52:44.305866] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-16T18:52:44.305933] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-16T18:52:44.577579] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T18:52:44.684892] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:44.742771] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-16T18:52:45.542887] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-16T18:52:45.612230] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:52:45.986256] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T18:52:46.342790] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-16T18:52:46.587798] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T18:52:47.142881] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-16T18:52:47.283819] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:52:47.942887] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-16T18:52:48.499863] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T18:52:48.742821] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-16T18:52:48.841248] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-16T18:52:49.542804] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-16T18:52:50.342783] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-16T18:52:50.415887] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T18:52:50.425825] [INFO ] [REMOTE ] FBIN: Full fetch complete (72956 records). [2025-10-16T18:52:50.426083] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-16T18:52:50.610176] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T18:52:50.844764] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-16T18:52:50.844849] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-16T18:52:50.845769] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-16T18:52:50.845832] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-16T18:52:50.847195] [DEBUG] [LOCAL ] FBIN: Trimmed 72956 records to 50718 (keeping 200 days of data) [2025-10-16T18:52:51.144945] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-16T18:52:51.150204] [DEBUG] [LOCAL ] FBIN: Primary data saved (50718 records). [2025-10-16T18:52:51.151097] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-16T18:52:51.152128] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. FBIN took 51.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-16T18:52:51.317321] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:51.334223] [DEBUG] [LOCAL ] FC: Loaded 14873 existing records from primary storage. [2025-10-16T18:52:51.334474] [INFO ] [MAIN ] FC: Loaded 14873 existing records. [2025-10-16T18:52:51.511812] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:52:51.512063] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-16T18:52:51.512223] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-16T18:52:51.512475] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-16T18:52:51.512551] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-16T18:52:51.815486] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T18:52:51.906783] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:51.942815] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-16T18:52:52.120837] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T18:52:52.126293] [INFO ] [REMOTE ] FBK: Full fetch complete (35127 records). [2025-10-16T18:52:52.126421] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-16T18:52:52.505823] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-16T18:52:52.505994] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-16T18:52:52.506766] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-16T18:52:52.506847] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-16T18:52:52.508062] [DEBUG] [LOCAL ] FBK: Trimmed 35127 records to 27707 (keeping 200 days of data) [2025-10-16T18:52:52.674227] [DEBUG] [LOCAL ] FBK: Primary data saved (27707 records). [2025-10-16T18:52:52.674377] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-16T18:52:52.674470] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBK took 30.5s. Estimated remaining: 3h 39m 11s. Rate: 7.1 symbols/min [2025-10-16T18:52:52.748211] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-16T18:52:52.844685] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:52:52.844860] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-16T18:52:52.844897] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-16T18:52:52.845013] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-16T18:52:52.845054] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-16T18:52:52.845094] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-16T18:52:52.845126] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-16T18:52:53.194715] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:52:53.477408] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T18:52:53.542778] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-16T18:52:54.059222] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-16T18:52:54.342868] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-16T18:52:54.792971] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T18:52:55.130880] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T18:52:55.142800] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-16T18:52:55.942807] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-16T18:52:56.084767] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T18:52:56.742833] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-16T18:52:57.362241] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T18:52:57.542849] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-16T18:52:58.326212] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:52:58.342795] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-16T18:52:59.080503] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T18:52:59.142849] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-16T18:52:59.840425] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T18:52:59.942844] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-16T18:53:00.193237] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T18:53:00.742862] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-16T18:53:00.905101] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T18:53:01.542801] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-16T18:53:02.147096] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T18:53:02.342793] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-16T18:53:02.572405] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:53:03.142874] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-16T18:53:03.584470] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T18:53:03.942877] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-16T18:53:04.470496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T18:53:04.742831] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-16T18:53:05.255695] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T18:53:05.264609] [INFO ] [REMOTE ] FBP: Full fetch complete (66717 records). [2025-10-16T18:53:05.264883] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-16T18:53:05.549572] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-16T18:53:05.659953] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-16T18:53:05.660127] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-16T18:53:05.661104] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-16T18:53:05.661168] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-16T18:53:05.662595] [DEBUG] [LOCAL ] FBP: Trimmed 66717 records to 46111 (keeping 200 days of data) [2025-10-16T18:53:05.895219] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T18:53:05.958350] [DEBUG] [LOCAL ] FBP: Primary data saved (46111 records). [2025-10-16T18:53:05.958469] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-16T18:53:05.959010] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FBP took 34.3s. Estimated remaining: 3h 39m 12s. Rate: 7.1 symbols/min [2025-10-16T18:53:06.123731] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:06.151311] [DEBUG] [LOCAL ] FCN: Loaded 26052 existing records from primary storage. [2025-10-16T18:53:06.151558] [INFO ] [MAIN ] FCN: Loaded 26052 existing records. [2025-10-16T18:53:06.326964] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:06.327201] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-16T18:53:06.327250] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-16T18:53:06.327496] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-16T18:53:06.327555] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-16T18:53:06.347988] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-16T18:53:06.689937] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:06.710147] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T18:53:07.142857] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-16T18:53:07.942827] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-16T18:53:07.998748] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T18:53:08.066159] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T18:53:08.707401] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T18:53:08.742778] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-16T18:53:09.373313] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T18:53:09.542826] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-16T18:53:10.342880] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-16T18:53:10.922285] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:53:11.142851] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-16T18:53:11.414587] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T18:53:11.942826] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-16T18:53:12.372870] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T18:53:12.706126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T18:53:12.742863] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-16T18:53:13.542813] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-16T18:53:14.119345] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T18:53:14.127244] [INFO ] [REMOTE ] FBRT: Full fetch complete (49578 records). [2025-10-16T18:53:14.127449] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-16T18:53:14.347944] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-16T18:53:14.512839] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-16T18:53:14.512951] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-16T18:53:14.513782] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-16T18:53:14.513849] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-16T18:53:14.515096] [DEBUG] [LOCAL ] FBRT: Trimmed 49578 records to 35695 (keeping 200 days of data) [2025-10-16T18:53:14.736947] [DEBUG] [LOCAL ] FBRT: Primary data saved (35695 records). [2025-10-16T18:53:14.737096] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-16T18:53:14.737182] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBRT took 30.8s. Estimated remaining: 3h 39m 5s. Rate: 7.1 symbols/min [2025-10-16T18:53:14.907948] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:14.943326] [DEBUG] [LOCAL ] FCPT: Loaded 37344 existing records from primary storage. [2025-10-16T18:53:14.943616] [INFO ] [MAIN ] FCPT: Loaded 37344 existing records. [2025-10-16T18:53:15.146240] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-16T18:53:15.152900] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:15.154443] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-16T18:53:15.154589] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-16T18:53:15.156527] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T18:53:15.156862] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-16T18:53:15.166699] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-16T18:53:15.282129] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T18:53:15.534485] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:15.942815] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-16T18:53:16.163301] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T18:53:16.742820] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-16T18:53:17.289114] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:53:17.542784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-16T18:53:18.139873] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T18:53:18.266807] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T18:53:18.342775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-16T18:53:19.142781] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-16T18:53:19.202177] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-16T18:53:19.942808] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-16T18:53:19.976667] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T18:53:19.978980] [INFO ] [REMOTE ] FC: Full fetch complete (21846 records). [2025-10-16T18:53:19.979070] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-16T18:53:20.338548] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-16T18:53:20.338692] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-16T18:53:20.339204] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-16T18:53:20.339245] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-16T18:53:20.339834] [DEBUG] [LOCAL ] FC: Trimmed 21846 records to 14966 (keeping 200 days of data) [2025-10-16T18:53:20.428773] [DEBUG] [LOCAL ] FC: Primary data saved (14966 records). [2025-10-16T18:53:20.428902] [INFO ] [MAIN ] FC: Full history saved. [2025-10-16T18:53:20.428980] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FC took 29.3s. Estimated remaining: 3h 38m 51s. Rate: 7.1 symbols/min [2025-10-16T18:53:20.592621] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:20.592826] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-16T18:53:20.592867] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-16T18:53:20.592976] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-16T18:53:20.593016] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-16T18:53:20.593057] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-16T18:53:20.593087] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-16T18:53:20.752832] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-16T18:53:20.945880] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:21.141042] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-16T18:53:21.542817] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-16T18:53:21.786498] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T18:53:21.786634] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-10-16T18:53:22.342806] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-16T18:53:23.142875] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-16T18:53:23.495280] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T18:53:23.942822] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-16T18:53:24.651406] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:53:24.742806] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-16T18:53:25.435838] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:53:25.542867] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-16T18:53:25.886060] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T18:53:26.342855] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-16T18:53:26.690580] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T18:53:26.990895] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:53:26.996588] [INFO ] [REMOTE ] FCF: Full fetch complete (58183 records). [2025-10-16T18:53:26.996741] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-16T18:53:27.146551] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-16T18:53:27.380702] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-16T18:53:27.380799] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-16T18:53:27.382357] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-16T18:53:27.382423] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-16T18:53:27.383841] [DEBUG] [LOCAL ] FCF: Trimmed 58183 records to 39657 (keeping 200 days of data) [2025-10-16T18:53:27.625661] [DEBUG] [LOCAL ] FCF: Primary data saved (39657 records). [2025-10-16T18:53:27.625842] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-16T18:53:27.625936] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCF took 35.0s. Estimated remaining: 3h 38m 40s. Rate: 7.1 symbols/min [2025-10-16T18:53:27.823176] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:27.839099] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-16T18:53:27.839343] [INFO ] [MAIN ] FCT: Loaded 14677 existing records. [2025-10-16T18:53:27.943475] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-16T18:53:28.028887] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:28.029079] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-16T18:53:28.029145] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-16T18:53:28.029366] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-16T18:53:28.029426] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-16T18:53:28.312069] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T18:53:28.389123] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:28.709002] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:53:28.742770] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-16T18:53:29.542831] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-16T18:53:30.243328] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:53:30.342847] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-16T18:53:30.369018] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:53:31.142817] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-16T18:53:31.643731] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T18:53:31.942796] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-16T18:53:32.353507] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T18:53:32.742804] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-16T18:53:33.113688] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:53:33.302932] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T18:53:33.542812] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-16T18:53:34.342806] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-16T18:53:34.669727] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T18:53:34.878979] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T18:53:35.142813] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-16T18:53:35.942822] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-16T18:53:36.700274] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T18:53:36.719274] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T18:53:36.742783] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-16T18:53:37.542793] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-16T18:53:37.685613] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:53:38.342798] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-16T18:53:39.040194] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T18:53:39.045739] [INFO ] [REMOTE ] FCPT: Full fetch complete (53908 records). [2025-10-16T18:53:39.045868] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-16T18:53:39.147910] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-16T18:53:39.419934] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T18:53:39.476911] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-16T18:53:39.476988] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-16T18:53:39.477797] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-16T18:53:39.477857] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-16T18:53:39.478950] [DEBUG] [LOCAL ] FCPT: Trimmed 53908 records to 37627 (keeping 200 days of data) [2025-10-16T18:53:39.600686] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T18:53:39.713447] [DEBUG] [LOCAL ] FCPT: Primary data saved (37627 records). [2025-10-16T18:53:39.713580] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-16T18:53:39.713677] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCPT took 25.0s. Estimated remaining: 3h 38m 39s. Rate: 7.1 symbols/min [2025-10-16T18:53:39.881482] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:39.932578] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-16T18:53:39.932958] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-16T18:53:39.947900] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-16T18:53:40.114989] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:40.115219] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-16T18:53:40.115266] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-16T18:53:40.115631] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-16T18:53:40.115720] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-16T18:53:40.458002] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:40.742770] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-16T18:53:40.803913] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T18:53:41.542841] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-16T18:53:42.342804] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-16T18:53:42.719787] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-16T18:53:42.765990] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:53:43.142795] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-16T18:53:43.183429] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T18:53:43.942864] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-16T18:53:44.742793] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-16T18:53:45.108404] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-16T18:53:45.125546] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-16T18:53:45.144372] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T18:53:45.542854] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-16T18:53:45.947015] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T18:53:46.342813] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-16T18:53:47.142794] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-16T18:53:47.229631] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T18:53:47.942849] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-16T18:53:48.742792] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-16T18:53:49.011561] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T18:53:49.072597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T18:53:49.072714] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-16T18:53:49.542832] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-16T18:53:50.342828] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-16T18:53:50.620927] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T18:53:51.142869] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-16T18:53:51.942809] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-16T18:53:51.958361] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T18:53:52.564309] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T18:53:52.742833] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-16T18:53:53.081633] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T18:53:53.244234] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T18:53:53.247835] [INFO ] [REMOTE ] FCN: Full fetch complete (35943 records). [2025-10-16T18:53:53.247945] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-16T18:53:53.542786] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-16T18:53:53.635261] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-16T18:53:53.635355] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-16T18:53:53.636260] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-16T18:53:53.636329] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-16T18:53:53.637396] [DEBUG] [LOCAL ] FCN: Trimmed 35943 records to 26219 (keeping 200 days of data) [2025-10-16T18:53:53.819572] [DEBUG] [LOCAL ] FCN: Primary data saved (26219 records). [2025-10-16T18:53:53.819749] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-16T18:53:53.819836] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCN took 47.9s. Estimated remaining: 3h 38m 41s. Rate: 7.1 symbols/min [2025-10-16T18:53:53.990349] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:54.024953] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T18:53:54.025742] [DEBUG] [LOCAL ] FDP: Loaded 29807 existing records from primary storage. [2025-10-16T18:53:54.027713] [INFO ] [MAIN ] FDP: Loaded 29807 existing records. [2025-10-16T18:53:54.200640] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:54.201037] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-16T18:53:54.201088] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-16T18:53:54.201327] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-16T18:53:54.201366] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-16T18:53:54.351942] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-16T18:53:54.547101] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:54.839539] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T18:53:54.840300] [INFO ] [REMOTE ] FCRX: Full fetch complete (1665 records). [2025-10-16T18:53:54.840413] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-16T18:53:55.014012] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-16T18:53:55.014201] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:53:55.014270] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:53:55.014344] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-16T18:53:55.014407] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-16T18:53:55.014443] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-16T18:53:55.014482] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-16T18:53:55.014535] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCRX took 34.6s. Estimated remaining: 3h 38m 19s. Rate: 7.1 symbols/min [2025-10-16T18:53:55.153173] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-16T18:53:55.186067] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:53:55.214280] [DEBUG] [LOCAL ] FDS: Loaded 27640 existing records from primary storage. [2025-10-16T18:53:55.214543] [INFO ] [MAIN ] FDS: Loaded 27640 existing records. [2025-10-16T18:53:55.385959] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:53:55.386170] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-16T18:53:55.386216] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-16T18:53:55.386465] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-16T18:53:55.386519] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-16T18:53:55.726891] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:53:55.942783] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-16T18:53:56.163681] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T18:53:56.742804] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-16T18:53:57.021730] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T18:53:57.542834] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-16T18:53:58.013768] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T18:53:58.342811] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-16T18:53:58.836151] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T18:53:59.142846] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-16T18:53:59.223496] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:53:59.942782] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-16T18:54:00.097048] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-16T18:54:00.099753] [INFO ] [REMOTE ] FCT: Full fetch complete (21061 records). [2025-10-16T18:54:00.099862] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-16T18:54:00.454533] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-16T18:54:00.454605] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-16T18:54:00.455067] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-16T18:54:00.455128] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-16T18:54:00.455690] [DEBUG] [LOCAL ] FCT: Trimmed 21061 records to 14752 (keeping 200 days of data) [2025-10-16T18:54:00.539915] [DEBUG] [LOCAL ] FCT: Primary data saved (14752 records). [2025-10-16T18:54:00.540053] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-16T18:54:00.540133] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 32.9s. Estimated remaining: 3h 38m 5s. Rate: 7.1 symbols/min [2025-10-16T18:54:00.708715] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:00.743318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-16T18:54:00.759187] [DEBUG] [LOCAL ] FDX: Loaded 51368 existing records from primary storage. [2025-10-16T18:54:00.759518] [INFO ] [MAIN ] FDX: Loaded 51368 existing records. [2025-10-16T18:54:00.936001] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:00.936202] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-16T18:54:00.936313] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-16T18:54:00.937038] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-16T18:54:00.937096] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-16T18:54:01.316199] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:01.317602] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:54:01.542834] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-16T18:54:02.342814] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-16T18:54:03.068746] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-16T18:54:03.142773] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-16T18:54:03.501895] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:54:03.558698] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-16T18:54:03.942823] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-16T18:54:04.104425] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T18:54:04.742929] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-16T18:54:05.542787] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-16T18:54:05.986088] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-16T18:54:06.342798] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-16T18:54:06.573337] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T18:54:06.612190] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T18:54:07.142900] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-16T18:54:07.942851] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-16T18:54:08.108080] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T18:54:08.567865] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T18:54:08.742816] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-16T18:54:09.254513] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T18:54:09.542836] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-16T18:54:10.342825] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-16T18:54:11.002901] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-16T18:54:11.142795] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-16T18:54:11.287119] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T18:54:11.317395] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T18:54:11.942882] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-16T18:54:12.742858] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-16T18:54:13.119443] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-16T18:54:13.549492] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-16T18:54:13.570280] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T18:54:13.878452] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T18:54:14.342825] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-16T18:54:15.142807] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-16T18:54:15.684698] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-16T18:54:15.942793] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-16T18:54:16.126238] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T18:54:16.158095] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T18:54:16.742909] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-16T18:54:16.797967] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T18:54:16.805469] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-16T18:54:16.805701] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-16T18:54:17.368420] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-16T18:54:17.368514] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-16T18:54:17.370007] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-16T18:54:17.370081] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-16T18:54:17.372418] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54091 (keeping 200 days of data) [2025-10-16T18:54:17.576725] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-16T18:54:17.756288] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T18:54:17.779337] [DEBUG] [LOCAL ] FCX: Primary data saved (54091 records). [2025-10-16T18:54:17.779541] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-16T18:54:17.779637] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FCX took 38.1s. Estimated remaining: 3h 38m 14s. Rate: 7.1 symbols/min [2025-10-16T18:54:17.951253] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:17.999239] [DEBUG] [LOCAL ] FE: Loaded 53432 existing records from primary storage. [2025-10-16T18:54:17.999551] [INFO ] [MAIN ] FE: Loaded 53432 existing records. [2025-10-16T18:54:18.190429] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:18.190685] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-16T18:54:18.190745] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-16T18:54:18.190944] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-16T18:54:18.190983] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-16T18:54:18.368429] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-16T18:54:18.561532] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:18.678568] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:54:19.142829] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-16T18:54:19.784962] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T18:54:19.942856] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-16T18:54:20.742801] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-16T18:54:20.846252] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T18:54:21.143471] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T18:54:21.542842] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-16T18:54:21.886976] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:54:22.342837] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-16T18:54:23.142914] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-16T18:54:23.440572] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T18:54:23.745156] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:54:23.942815] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-16T18:54:23.962499] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T18:54:24.742852] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-16T18:54:25.530169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T18:54:25.542783] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-16T18:54:25.815010] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T18:54:26.342801] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-16T18:54:27.142894] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-16T18:54:27.273493] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T18:54:27.278106] [INFO ] [REMOTE ] FDP: Full fetch complete (42650 records). [2025-10-16T18:54:27.278242] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-16T18:54:27.423036] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T18:54:27.700138] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-16T18:54:27.700211] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-16T18:54:27.700799] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-16T18:54:27.700860] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-16T18:54:27.701730] [DEBUG] [LOCAL ] FDP: Trimmed 42650 records to 29961 (keeping 200 days of data) [2025-10-16T18:54:27.877369] [DEBUG] [LOCAL ] FDP: Primary data saved (29961 records). [2025-10-16T18:54:27.877506] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-16T18:54:27.877584] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDP took 34.1s. Estimated remaining: 3h 38m 8s. Rate: 7.1 symbols/min [2025-10-16T18:54:27.951285] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-16T18:54:28.046685] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:28.046837] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-16T18:54:28.046874] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-16T18:54:28.046982] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-16T18:54:28.047022] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-16T18:54:28.047061] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-16T18:54:28.047092] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-16T18:54:28.402757] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:28.683447] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T18:54:28.742781] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-16T18:54:29.542845] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-16T18:54:29.893075] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-16T18:54:29.965067] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T18:54:30.342836] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-16T18:54:30.751541] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T18:54:30.781034] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T18:54:31.142786] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-16T18:54:31.567083] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:54:31.942824] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-16T18:54:32.742817] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-16T18:54:33.542808] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-16T18:54:33.779262] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T18:54:34.342810] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-16T18:54:34.633080] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-16T18:54:34.636261] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:54:35.011609] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T18:54:35.020260] [INFO ] [REMOTE ] FDS: Full fetch complete (38754 records). [2025-10-16T18:54:35.020432] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-16T18:54:35.147966] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-16T18:54:35.424503] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-16T18:54:35.424611] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-16T18:54:35.425696] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-16T18:54:35.425763] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-16T18:54:35.426993] [DEBUG] [LOCAL ] FDS: Trimmed 38754 records to 27887 (keeping 200 days of data) [2025-10-16T18:54:35.609527] [DEBUG] [LOCAL ] FDS: Primary data saved (27887 records). [2025-10-16T18:54:35.609774] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-16T18:54:35.609884] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDS took 40.6s. Estimated remaining: 3h 37m 59s. Rate: 7.1 symbols/min [2025-10-16T18:54:35.786400] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:35.839998] [DEBUG] [LOCAL ] FERG: Loaded 48746 existing records from primary storage. [2025-10-16T18:54:35.840474] [INFO ] [MAIN ] FERG: Loaded 48746 existing records. [2025-10-16T18:54:35.947986] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-16T18:54:36.038916] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:36.039214] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-16T18:54:36.039266] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-16T18:54:36.039594] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-16T18:54:36.039699] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-16T18:54:36.452065] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:36.498567] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T18:54:36.742785] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-16T18:54:37.164491] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T18:54:37.231622] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T18:54:37.542780] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-16T18:54:38.342833] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-16T18:54:38.686792] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T18:54:39.142824] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-16T18:54:39.605949] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T18:54:39.612520] [INFO ] [REMOTE ] FDX: Full fetch complete (74404 records). [2025-10-16T18:54:39.612716] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-16T18:54:39.952459] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-16T18:54:39.999578] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-16T18:54:39.999683] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-16T18:54:40.000630] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-16T18:54:40.000716] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-16T18:54:40.002136] [DEBUG] [LOCAL ] FDX: Trimmed 74404 records to 51742 (keeping 200 days of data) [2025-10-16T18:54:40.256509] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-16T18:54:40.364461] [DEBUG] [LOCAL ] FDX: Primary data saved (51742 records). [2025-10-16T18:54:40.364590] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-16T18:54:40.365363] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 39.8s. Estimated remaining: 3h 37m 43s. Rate: 7.1 symbols/min [2025-10-16T18:54:40.536072] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:40.551683] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-10-16T18:54:40.551912] [INFO ] [MAIN ] FET: Loaded 12838 existing records. [2025-10-16T18:54:40.730842] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:40.731077] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-16T18:54:40.731153] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-16T18:54:40.731399] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-16T18:54:40.731498] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-16T18:54:40.751341] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-16T18:54:41.066828] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T18:54:41.134089] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T18:54:41.137045] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:41.542791] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-16T18:54:42.342820] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-16T18:54:42.369525] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T18:54:43.142823] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-16T18:54:43.903865] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T18:54:43.942773] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-16T18:54:44.742810] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-16T18:54:44.877106] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T18:54:45.115117] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T18:54:45.406297] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T18:54:45.542838] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-16T18:54:46.342811] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-16T18:54:46.787963] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T18:54:46.788900] [INFO ] [REMOTE ] FENG: Full fetch complete (2281 records). [2025-10-16T18:54:46.788970] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-16T18:54:46.995821] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T18:54:46.996022] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-16T18:54:46.996106] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-16T18:54:46.996189] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-16T18:54:46.996255] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-16T18:54:46.996320] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-16T18:54:46.996391] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-16T18:54:46.996469] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FENG took 19.1s. Estimated remaining: 3h 37m 31s. Rate: 7.1 symbols/min [2025-10-16T18:54:47.143531] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-16T18:54:47.213875] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:54:47.246505] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T18:54:47.274594] [DEBUG] [LOCAL ] FF: Loaded 24337 existing records from primary storage. [2025-10-16T18:54:47.274977] [INFO ] [MAIN ] FF: Loaded 24337 existing records. [2025-10-16T18:54:47.464493] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:54:47.464823] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-16T18:54:47.464887] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-16T18:54:47.465153] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-16T18:54:47.465249] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-16T18:54:47.858139] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:54:47.942866] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-16T18:54:48.744187] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-16T18:54:48.747186] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T18:54:49.211379] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T18:54:49.542947] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-16T18:54:49.927637] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-16T18:54:50.342903] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-16T18:54:51.102474] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T18:54:51.142767] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T18:54:51.142849] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-16T18:54:51.709402] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T18:54:51.942866] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-16T18:54:52.742837] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-16T18:54:52.768819] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T18:54:53.542873] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-16T18:54:53.898219] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:54:54.071226] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T18:54:54.342870] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-16T18:54:55.071396] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T18:54:55.142792] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-16T18:54:55.922181] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T18:54:55.942791] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-16T18:54:56.742817] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-16T18:54:57.542809] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-16T18:54:57.776507] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T18:54:57.811909] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T18:54:58.165389] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T18:54:58.342814] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-16T18:54:59.142886] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-16T18:54:59.942834] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-16T18:55:00.017324] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:55:00.488966] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T18:55:00.585352] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T18:55:00.592461] [INFO ] [REMOTE ] FE: Full fetch complete (77468 records). [2025-10-16T18:55:00.592617] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-16T18:55:00.748627] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-16T18:55:00.999552] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-16T18:55:00.999628] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-16T18:55:01.000734] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-16T18:55:01.000799] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-16T18:55:01.002246] [DEBUG] [LOCAL ] FE: Trimmed 77468 records to 53822 (keeping 200 days of data) [2025-10-16T18:55:01.340965] [DEBUG] [LOCAL ] FE: Primary data saved (53822 records). [2025-10-16T18:55:01.341361] [INFO ] [MAIN ] FE: Full history saved. [2025-10-16T18:55:01.341467] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FE took 43.6s. Estimated remaining: 3h 37m 34s. Rate: 7.1 symbols/min [2025-10-16T18:55:01.529914] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:01.542214] [DEBUG] [LOCAL ] FFA: Loaded 5921 existing records from primary storage. [2025-10-16T18:55:01.542580] [INFO ] [MAIN ] FFA: Loaded 5921 existing records. [2025-10-16T18:55:01.547937] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-16T18:55:01.822600] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:01.822896] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-16T18:55:01.822945] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-16T18:55:01.823463] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-16T18:55:01.823532] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-16T18:55:02.242471] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:02.342834] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-16T18:55:02.549085] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T18:55:02.728679] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-16T18:55:03.142895] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-16T18:55:03.626996] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:55:03.942878] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-16T18:55:04.555742] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:55:04.742838] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-16T18:55:04.956110] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T18:55:05.542827] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-16T18:55:05.706194] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T18:55:06.342822] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-16T18:55:06.754607] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T18:55:07.142848] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-16T18:55:07.312018] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:55:07.314157] [INFO ] [REMOTE ] FET: Full fetch complete (18412 records). [2025-10-16T18:55:07.314225] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-16T18:55:07.669447] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-16T18:55:07.669522] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-16T18:55:07.670060] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-16T18:55:07.670124] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-16T18:55:07.670733] [DEBUG] [LOCAL ] FET: Trimmed 18412 records to 12940 (keeping 200 days of data) [2025-10-16T18:55:07.745231] [DEBUG] [LOCAL ] FET: Primary data saved (12940 records). [2025-10-16T18:55:07.745363] [INFO ] [MAIN ] FET: Full history saved. [2025-10-16T18:55:07.745444] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 27.4s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-16T18:55:07.912611] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:07.930900] [DEBUG] [LOCAL ] FFC: Loaded 16719 existing records from primary storage. [2025-10-16T18:55:07.931139] [INFO ] [MAIN ] FFC: Loaded 16719 existing records. [2025-10-16T18:55:07.951112] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-16T18:55:08.108220] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:08.108462] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-16T18:55:08.108509] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-16T18:55:08.108766] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-16T18:55:08.108822] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-16T18:55:08.427681] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T18:55:08.485298] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:08.742831] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-16T18:55:08.793688] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T18:55:09.542902] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-16T18:55:09.962622] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:55:10.342816] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-16T18:55:11.142781] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-16T18:55:11.405448] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-16T18:55:11.511700] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T18:55:11.544292] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T18:55:11.942789] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-16T18:55:12.742865] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-16T18:55:13.542849] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-16T18:55:13.746691] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:55:13.768258] [INFO ] [REMOTE ] FERG: Full fetch complete (71096 records). [2025-10-16T18:55:13.769708] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T18:55:13.769016] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-16T18:55:14.181176] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-16T18:55:14.181258] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-16T18:55:14.182250] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-16T18:55:14.182316] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-16T18:55:14.183638] [DEBUG] [LOCAL ] FERG: Trimmed 71096 records to 49121 (keeping 200 days of data) [2025-10-16T18:55:14.364921] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-16T18:55:14.496170] [DEBUG] [LOCAL ] FERG: Primary data saved (49121 records). [2025-10-16T18:55:14.496321] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-16T18:55:14.497126] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FERG took 38.9s. Estimated remaining: 3h 37m 10s. Rate: 7.1 symbols/min [2025-10-16T18:55:14.679465] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:14.681103] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T18:55:14.717977] [DEBUG] [LOCAL ] FFWM: Loaded 35915 existing records from primary storage. [2025-10-16T18:55:14.718279] [INFO ] [MAIN ] FFWM: Loaded 35915 existing records. [2025-10-16T18:55:14.899074] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-16T18:55:14.903477] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:14.905927] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-16T18:55:14.905993] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-16T18:55:14.906163] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-16T18:55:14.906203] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-16T18:55:15.147999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-16T18:55:15.265359] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:15.922527] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T18:55:15.942758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-16T18:55:16.548700] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T18:55:16.742867] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-16T18:55:17.542779] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-16T18:55:17.780573] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T18:55:18.186988] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T18:55:18.342836] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-16T18:55:19.142820] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-16T18:55:19.711185] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T18:55:19.868407] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T18:55:19.871587] [INFO ] [REMOTE ] FF: Full fetch complete (36598 records). [2025-10-16T18:55:19.871703] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-16T18:55:19.948001] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-16T18:55:20.235953] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-16T18:55:20.236031] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-16T18:55:20.236686] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-16T18:55:20.236747] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-16T18:55:20.237485] [DEBUG] [LOCAL ] FF: Trimmed 36598 records to 24506 (keeping 200 days of data) [2025-10-16T18:55:20.372231] [DEBUG] [LOCAL ] FF: Primary data saved (24506 records). [2025-10-16T18:55:20.372359] [INFO ] [MAIN ] FF: Full history saved. [2025-10-16T18:55:20.372442] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FF took 33.4s. Estimated remaining: 3h 36m 57s. Rate: 7.1 symbols/min [2025-10-16T18:55:20.541700] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:20.562796] [DEBUG] [LOCAL ] FG: Loaded 22183 existing records from primary storage. [2025-10-16T18:55:20.563032] [INFO ] [MAIN ] FG: Loaded 22183 existing records. [2025-10-16T18:55:20.735583] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:20.735784] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-16T18:55:20.735831] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-16T18:55:20.735996] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-16T18:55:20.736053] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-16T18:55:20.748744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-16T18:55:21.088907] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:21.109540] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:55:21.380473] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T18:55:21.542792] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-16T18:55:22.342788] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-16T18:55:22.502362] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T18:55:23.143170] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-16T18:55:23.622062] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T18:55:23.942795] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-16T18:55:24.118774] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T18:55:24.742826] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-16T18:55:25.003470] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-16T18:55:25.400256] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:55:25.542835] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-16T18:55:26.178544] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-16T18:55:26.342778] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-16T18:55:27.143770] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-16T18:55:27.147363] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T18:55:27.942812] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-16T18:55:28.079228] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T18:55:28.742826] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-16T18:55:28.841019] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T18:55:29.318861] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-16T18:55:29.542831] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-16T18:55:30.342811] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-16T18:55:30.698223] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T18:55:31.142788] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-16T18:55:31.297938] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T18:55:31.942809] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-16T18:55:32.240739] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-16T18:55:32.711902] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:55:32.742776] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-16T18:55:33.542783] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-16T18:55:33.765736] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T18:55:34.050305] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T18:55:34.342811] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-16T18:55:35.142810] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-16T18:55:35.624716] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:55:35.945238] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-16T18:55:35.946070] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T18:55:35.948545] [INFO ] [REMOTE ] FFA: Full fetch complete (8808 records). [2025-10-16T18:55:35.948740] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-16T18:55:36.323579] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-16T18:55:36.323686] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-16T18:55:36.323928] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-16T18:55:36.323968] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-16T18:55:36.324399] [DEBUG] [LOCAL ] FFA: Trimmed 8808 records to 5963 (keeping 200 days of data) [2025-10-16T18:55:36.360808] [DEBUG] [LOCAL ] FFA: Primary data saved (5963 records). [2025-10-16T18:55:36.360895] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-16T18:55:36.361005] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFA took 35.0s. Estimated remaining: 3h 37m 3s. Rate: 7.1 symbols/min [2025-10-16T18:55:36.525785] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:36.533196] [DEBUG] [LOCAL ] FGN: Loaded 3724 existing records from primary storage. [2025-10-16T18:55:36.533384] [INFO ] [MAIN ] FGN: Loaded 3724 existing records. [2025-10-16T18:55:36.716782] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:36.717000] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-16T18:55:36.717047] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-16T18:55:36.717191] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-16T18:55:36.717246] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-16T18:55:36.747859] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-16T18:55:37.079059] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:37.124391] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T18:55:37.542795] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-16T18:55:37.804676] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T18:55:38.342837] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-16T18:55:38.542956] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:55:39.142830] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-16T18:55:39.346939] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T18:55:39.942827] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-16T18:55:40.141799] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T18:55:40.742835] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-16T18:55:41.081108] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T18:55:41.359730] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-16T18:55:41.542816] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-16T18:55:42.155726] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T18:55:42.342838] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-16T18:55:43.142808] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-16T18:55:43.292834] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T18:55:43.476334] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T18:55:43.942828] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-16T18:55:44.742870] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-16T18:55:45.381509] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T18:55:45.542791] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-16T18:55:45.741837] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T18:55:46.342806] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-16T18:55:46.513076] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T18:55:46.515458] [INFO ] [REMOTE ] FFC: Full fetch complete (24559 records). [2025-10-16T18:55:46.515545] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-16T18:55:46.706398] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T18:55:46.922273] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-16T18:55:46.922366] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-16T18:55:46.922981] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-16T18:55:46.923044] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-16T18:55:46.923763] [DEBUG] [LOCAL ] FFC: Trimmed 24559 records to 16818 (keeping 200 days of data) [2025-10-16T18:55:47.026460] [DEBUG] [LOCAL ] FFC: Primary data saved (16818 records). [2025-10-16T18:55:47.026599] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-16T18:55:47.026702] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FFC took 39.3s. Estimated remaining: 3h 36m 59s. Rate: 7.1 symbols/min [2025-10-16T18:55:47.147943] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-16T18:55:47.202902] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:47.203075] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-16T18:55:47.203159] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-16T18:55:47.203272] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-16T18:55:47.203313] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-16T18:55:47.203353] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-16T18:55:47.203384] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-16T18:55:47.546957] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:47.942839] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-16T18:55:48.320111] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T18:55:48.543007] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T18:55:48.742785] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-16T18:55:48.930138] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:55:48.930442] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-16T18:55:48.930560] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:55:48.930636] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-16T18:55:48.930749] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:55:48.930841] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-16T18:55:48.930920] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-16T18:55:48.930958] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-16T18:55:48.930996] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-16T18:55:48.931041] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGSN took 1.9s. Estimated remaining: 3h 36m 38s. Rate: 7.1 symbols/min [2025-10-16T18:55:49.119414] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:49.158727] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-16T18:55:49.159021] [INFO ] [MAIN ] FHI: Loaded 39897 existing records. [2025-10-16T18:55:49.337726] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:49.337960] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-16T18:55:49.338008] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-16T18:55:49.338198] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-16T18:55:49.338254] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-16T18:55:49.547932] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-16T18:55:49.695611] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:50.342825] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-16T18:55:50.697506] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T18:55:50.700783] [INFO ] [REMOTE ] FG: Full fetch complete (28671 records). [2025-10-16T18:55:50.700922] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-16T18:55:50.859307] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T18:55:51.087692] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-16T18:55:51.087776] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-16T18:55:51.088344] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-16T18:55:51.088423] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-16T18:55:51.089156] [DEBUG] [LOCAL ] FG: Trimmed 28671 records to 22335 (keeping 200 days of data) [2025-10-16T18:55:51.144004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-16T18:55:51.228727] [DEBUG] [LOCAL ] FG: Primary data saved (22335 records). [2025-10-16T18:55:51.228867] [INFO ] [MAIN ] FG: Full history saved. [2025-10-16T18:55:51.228943] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FG took 30.9s. Estimated remaining: 3h 36m 18s. Rate: 7.1 symbols/min [2025-10-16T18:55:51.405256] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:51.459089] [DEBUG] [LOCAL ] FHN: Loaded 53392 existing records from primary storage. [2025-10-16T18:55:51.459493] [INFO ] [MAIN ] FHN: Loaded 53392 existing records. [2025-10-16T18:55:51.639054] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:51.639327] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-16T18:55:51.639387] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-16T18:55:51.639722] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-16T18:55:51.639778] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-16T18:55:51.955420] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-16T18:55:52.000393] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:52.241410] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-16T18:55:52.246088] [INFO ] [REMOTE ] FFWM: Full fetch complete (51927 records). [2025-10-16T18:55:52.246192] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-16T18:55:52.622188] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-16T18:55:52.622282] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-16T18:55:52.623087] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-16T18:55:52.623147] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-16T18:55:52.624162] [DEBUG] [LOCAL ] FFWM: Trimmed 51927 records to 36234 (keeping 200 days of data) [2025-10-16T18:55:52.767706] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-16T18:55:52.822834] [DEBUG] [LOCAL ] FFWM: Primary data saved (36234 records). [2025-10-16T18:55:52.822948] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-16T18:55:52.823021] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FFWM took 38.3s. Estimated remaining: 3h 35m 57s. Rate: 7.1 symbols/min [2025-10-16T18:55:52.992174] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:55:53.043722] [DEBUG] [LOCAL ] FI: Loaded 53580 existing records from primary storage. [2025-10-16T18:55:53.044080] [INFO ] [MAIN ] FI: Loaded 53580 existing records. [2025-10-16T18:55:53.223306] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:55:53.223552] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-16T18:55:53.223607] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-16T18:55:53.223811] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-16T18:55:53.223875] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-16T18:55:53.452113] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T18:55:53.548401] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-16T18:55:53.610146] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:55:53.632213] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T18:55:54.155627] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-16T18:55:54.342820] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-16T18:55:54.918287] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T18:55:55.142820] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-16T18:55:55.670862] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-16T18:55:55.942810] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-16T18:55:56.489424] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T18:55:56.742827] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-16T18:55:57.542834] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-16T18:55:57.896074] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:55:58.081579] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T18:55:58.342820] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-16T18:55:59.142824] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-16T18:55:59.868252] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T18:55:59.942837] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-16T18:56:00.696009] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T18:56:00.742785] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-16T18:56:01.542884] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-16T18:56:01.661114] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T18:56:02.342917] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-16T18:56:02.502746] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T18:56:02.504220] [INFO ] [REMOTE ] FGN: Full fetch complete (5618 records). [2025-10-16T18:56:02.504313] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-16T18:56:02.651828] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T18:56:02.934286] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-16T18:56:02.934389] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-16T18:56:02.934620] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-16T18:56:02.934696] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-16T18:56:02.935152] [DEBUG] [LOCAL ] FGN: Trimmed 5618 records to 3741 (keeping 200 days of data) [2025-10-16T18:56:02.960042] [DEBUG] [LOCAL ] FGN: Primary data saved (3741 records). [2025-10-16T18:56:02.960244] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-16T18:56:02.960352] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FGN took 26.6s. Estimated remaining: 3h 35m 52s. Rate: 7.1 symbols/min [2025-10-16T18:56:03.138494] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:03.142825] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-16T18:56:03.168357] [DEBUG] [LOCAL ] FICO: Loaded 21752 existing records from primary storage. [2025-10-16T18:56:03.168817] [INFO ] [MAIN ] FICO: Loaded 21752 existing records. [2025-10-16T18:56:03.357812] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:03.358030] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-16T18:56:03.358082] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-16T18:56:03.358325] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-16T18:56:03.358381] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-16T18:56:03.741134] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:03.912755] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T18:56:03.942798] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-16T18:56:04.050598] [DEBUG] [REMOTE ] FHN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-16T18:56:04.051004] [WARN ] [REMOTE ] FHN: No data returned for month 2025-02 [2025-10-16T18:56:04.051107] [FATAL] [REMOTE ] FHN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:56:04.051209] [FATAL] [MAIN ] FHN: Failed to fetch primary data. [2025-10-16T18:56:04.051276] [WARN ] [MAIN ] FHN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:56:04.051349] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-16T18:56:04.051418] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-16T18:56:04.051456] [INFO ] [LOCAL ] FHN: Starting deletion of derivative data. [2025-10-16T18:56:04.051625] [DEBUG] [LOCAL ] FHN: Deleted derivative data file. [2025-10-16T18:56:04.052199] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHN took 12.8s. Estimated remaining: 3h 35m 30s. Rate: 7.1 symbols/min [2025-10-16T18:56:04.224752] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:04.225046] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-16T18:56:04.225118] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-16T18:56:04.225234] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-16T18:56:04.225359] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-16T18:56:04.225442] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-16T18:56:04.225562] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-16T18:56:04.412370] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T18:56:04.636589] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:04.742777] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-16T18:56:04.976474] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-10-16T18:56:05.542872] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-16T18:56:06.342827] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-16T18:56:06.569366] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-16T18:56:07.142807] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-16T18:56:07.440961] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-16T18:56:07.465631] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-16T18:56:07.942879] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-16T18:56:08.206956] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-16T18:56:08.742814] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-16T18:56:09.542825] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-16T18:56:10.306287] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T18:56:10.346979] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-16T18:56:10.351702] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-16T18:56:11.142864] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-16T18:56:11.953414] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-16T18:56:11.958960] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T18:56:12.742800] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-16T18:56:13.085808] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T18:56:13.090494] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T18:56:13.121013] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-16T18:56:13.542856] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-16T18:56:14.342820] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-16T18:56:14.679606] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-16T18:56:15.142852] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-16T18:56:15.269023] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:56:15.942833] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-16T18:56:16.010812] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T18:56:16.138365] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:56:16.138768] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-16T18:56:16.138857] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:56:16.138930] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-16T18:56:16.138992] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:56:16.139067] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-16T18:56:16.139133] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-16T18:56:16.139169] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-16T18:56:16.139208] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-16T18:56:16.139255] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FIG took 12.1s. Estimated remaining: 3h 35m 28s. Rate: 7.1 symbols/min [2025-10-16T18:56:16.318992] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:16.363635] [DEBUG] [LOCAL ] FIGS: Loaded 48583 existing records from primary storage. [2025-10-16T18:56:16.364003] [INFO ] [MAIN ] FIGS: Loaded 48583 existing records. [2025-10-16T18:56:16.570153] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:16.570556] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-16T18:56:16.570614] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-16T18:56:16.570887] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-16T18:56:16.570943] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-16T18:56:16.744518] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-16T18:56:16.928231] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:17.542835] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-16T18:56:17.871057] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T18:56:18.342857] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-16T18:56:19.142806] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-16T18:56:19.601126] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-16T18:56:19.622630] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T18:56:19.942833] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-16T18:56:20.640402] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T18:56:20.742808] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-16T18:56:21.291317] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T18:56:21.542782] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-16T18:56:21.935881] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T18:56:22.342806] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-16T18:56:22.946409] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:56:23.142814] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-16T18:56:23.942815] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-16T18:56:24.494308] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T18:56:24.567347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:56:24.742782] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-16T18:56:25.401991] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T18:56:25.542775] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-16T18:56:26.342808] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-16T18:56:26.379472] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T18:56:26.517787] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T18:56:27.142845] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-16T18:56:27.435335] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:56:27.942821] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-16T18:56:28.742865] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-16T18:56:28.777789] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T18:56:29.458857] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:56:29.542798] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-16T18:56:29.927900] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T18:56:30.342837] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-16T18:56:30.529851] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T18:56:31.142807] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-16T18:56:31.942810] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-16T18:56:32.279376] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T18:56:32.746878] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-16T18:56:32.752784] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T18:56:32.825560] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T18:56:33.542796] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-16T18:56:34.342791] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-16T18:56:34.675368] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-16T18:56:35.099128] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T18:56:35.142778] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-16T18:56:35.399548] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T18:56:35.942783] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-16T18:56:36.014512] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T18:56:36.021512] [INFO ] [REMOTE ] FI: Full fetch complete (77440 records). [2025-10-16T18:56:36.021634] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-16T18:56:36.422866] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-16T18:56:36.422962] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-16T18:56:36.423984] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-16T18:56:36.424051] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-16T18:56:36.425579] [DEBUG] [LOCAL ] FI: Trimmed 77440 records to 53970 (keeping 200 days of data) [2025-10-16T18:56:36.746631] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-16T18:56:36.746551] [DEBUG] [LOCAL ] FI: Primary data saved (53970 records). [2025-10-16T18:56:36.746857] [INFO ] [MAIN ] FI: Full history saved. [2025-10-16T18:56:36.748370] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FI took 43.9s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-16T18:56:36.915459] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:36.953686] [DEBUG] [LOCAL ] FIHL: Loaded 39437 existing records from primary storage. [2025-10-16T18:56:36.953968] [INFO ] [MAIN ] FIHL: Loaded 39437 existing records. [2025-10-16T18:56:37.134635] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:37.134959] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-16T18:56:37.135052] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-16T18:56:37.135435] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-16T18:56:37.135480] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-16T18:56:37.429131] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T18:56:37.471355] [INFO ] [REMOTE ] FICO: Full fetch complete (29895 records). [2025-10-16T18:56:37.491123] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-16T18:56:37.566508] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:37.562782] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-16T18:56:37.885128] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-16T18:56:37.885205] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-16T18:56:37.885803] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-16T18:56:37.885864] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-16T18:56:37.886579] [DEBUG] [LOCAL ] FICO: Trimmed 29895 records to 21912 (keeping 200 days of data) [2025-10-16T18:56:38.025732] [DEBUG] [LOCAL ] FICO: Primary data saved (21912 records). [2025-10-16T18:56:38.025853] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-16T18:56:38.025929] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FICO took 35.1s. Estimated remaining: 3h 35m 21s. Rate: 7.1 symbols/min [2025-10-16T18:56:38.202163] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:38.212794] [DEBUG] [LOCAL ] FINS: Loaded 8292 existing records from primary storage. [2025-10-16T18:56:38.212994] [INFO ] [MAIN ] FINS: Loaded 8292 existing records. [2025-10-16T18:56:38.351148] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-16T18:56:38.391623] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:38.392825] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-16T18:56:38.393038] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-16T18:56:38.393245] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-16T18:56:38.393499] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-16T18:56:38.699582] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-16T18:56:38.791165] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:39.012572] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:56:39.017621] [INFO ] [REMOTE ] FHI: Full fetch complete (57761 records). [2025-10-16T18:56:39.017754] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-16T18:56:39.143572] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-16T18:56:39.440176] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-16T18:56:39.440263] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-16T18:56:39.441109] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-16T18:56:39.441178] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-16T18:56:39.442388] [DEBUG] [LOCAL ] FHI: Trimmed 57761 records to 40215 (keeping 200 days of data) [2025-10-16T18:56:39.685810] [DEBUG] [LOCAL ] FHI: Primary data saved (40215 records). [2025-10-16T18:56:39.685942] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-16T18:56:39.686022] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FHI took 50.8s. Estimated remaining: 3h 35m 0s. Rate: 7.1 symbols/min [2025-10-16T18:56:39.860591] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:39.881086] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-16T18:56:39.922762] [DEBUG] [LOCAL ] FINV: Loaded 45270 existing records from primary storage. [2025-10-16T18:56:39.923134] [INFO ] [MAIN ] FINV: Loaded 45270 existing records. [2025-10-16T18:56:39.953261] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-16T18:56:40.100720] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:40.100883] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-16T18:56:40.100938] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-16T18:56:40.101119] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-16T18:56:40.101156] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-16T18:56:40.453253] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:40.613725] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-16T18:56:40.742785] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-16T18:56:40.779198] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T18:56:41.450091] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T18:56:41.542834] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-16T18:56:42.342877] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-16T18:56:43.150311] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-16T18:56:43.155398] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T18:56:43.444687] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T18:56:43.822741] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T18:56:43.942854] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-16T18:56:44.742875] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-16T18:56:45.097987] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T18:56:45.542848] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-16T18:56:46.342814] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-16T18:56:46.398244] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:56:46.404776] [INFO ] [REMOTE ] FIGS: Full fetch complete (70882 records). [2025-10-16T18:56:46.404948] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-16T18:56:46.812816] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T18:56:46.843374] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-16T18:56:46.843455] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-16T18:56:46.844418] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-16T18:56:46.844484] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-16T18:56:46.845742] [DEBUG] [LOCAL ] FIGS: Trimmed 70882 records to 48947 (keeping 200 days of data) [2025-10-16T18:56:47.059933] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T18:56:47.142034] [DEBUG] [LOCAL ] FIGS: Primary data saved (48947 records). [2025-10-16T18:56:47.142183] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-16T18:56:47.142668] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIGS took 31.0s. Estimated remaining: 3h 34m 50s. Rate: 7.1 symbols/min [2025-10-16T18:56:47.142991] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-16T18:56:47.316197] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:56:47.366672] [DEBUG] [LOCAL ] FIS: Loaded 53339 existing records from primary storage. [2025-10-16T18:56:47.367017] [INFO ] [MAIN ] FIS: Loaded 53339 existing records. [2025-10-16T18:56:47.545071] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:56:47.545321] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-16T18:56:47.545379] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-16T18:56:47.545568] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-16T18:56:47.545619] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-16T18:56:47.904800] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:56:47.942794] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-16T18:56:47.996787] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T18:56:48.742897] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-16T18:56:49.411740] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T18:56:49.542819] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-16T18:56:50.323563] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T18:56:50.342798] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-16T18:56:50.945328] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T18:56:51.142812] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-16T18:56:51.607163] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T18:56:51.915606] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T18:56:51.942771] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-16T18:56:52.665577] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T18:56:52.742875] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-16T18:56:53.542830] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-16T18:56:54.118552] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T18:56:54.342903] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-16T18:56:54.924947] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-16T18:56:55.065253] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T18:56:55.142853] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-16T18:56:55.942822] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-16T18:56:56.358464] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T18:56:56.742829] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-16T18:56:57.542797] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-16T18:56:57.635461] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:56:57.660209] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-16T18:56:58.342860] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-16T18:56:59.051599] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T18:56:59.142814] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-16T18:56:59.755727] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T18:56:59.942843] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-16T18:57:00.615799] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T18:57:00.663979] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:57:00.742808] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-16T18:57:01.536330] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T18:57:01.537678] [INFO ] [REMOTE ] FINS: Full fetch complete (11789 records). [2025-10-16T18:57:01.537748] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-16T18:57:01.548701] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-16T18:57:01.917173] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-16T18:57:01.917252] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-16T18:57:01.917606] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-16T18:57:01.917668] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-16T18:57:01.918183] [DEBUG] [LOCAL ] FINS: Trimmed 11789 records to 8363 (keeping 200 days of data) [2025-10-16T18:57:01.971124] [DEBUG] [LOCAL ] FINS: Primary data saved (8363 records). [2025-10-16T18:57:01.971271] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-16T18:57:01.971370] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FINS took 23.9s. Estimated remaining: 3h 34m 53s. Rate: 7.1 symbols/min [2025-10-16T18:57:02.146118] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:02.174582] [DEBUG] [LOCAL ] FIX: Loaded 28800 existing records from primary storage. [2025-10-16T18:57:02.174872] [INFO ] [MAIN ] FIX: Loaded 28800 existing records. [2025-10-16T18:57:02.348030] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-16T18:57:02.353250] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:02.354763] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-16T18:57:02.354846] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-16T18:57:02.355070] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-16T18:57:02.355131] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-16T18:57:02.726075] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:03.138818] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:57:03.147963] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-16T18:57:03.861956] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T18:57:03.942790] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-16T18:57:04.154441] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T18:57:04.742829] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-16T18:57:05.289074] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T18:57:05.294383] [INFO ] [REMOTE ] FIHL: Full fetch complete (56400 records). [2025-10-16T18:57:05.294508] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-16T18:57:05.554502] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-16T18:57:05.681890] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-16T18:57:05.681981] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-16T18:57:05.682821] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-16T18:57:05.682884] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-16T18:57:05.684093] [DEBUG] [LOCAL ] FIHL: Trimmed 56400 records to 39714 (keeping 200 days of data) [2025-10-16T18:57:05.932152] [DEBUG] [LOCAL ] FIHL: Primary data saved (39714 records). [2025-10-16T18:57:05.932301] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-16T18:57:05.932382] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FIHL took 29.2s. Estimated remaining: 3h 34m 37s. Rate: 7.1 symbols/min [2025-10-16T18:57:06.103625] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:06.103842] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-16T18:57:06.103884] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-16T18:57:06.103998] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-16T18:57:06.104040] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-16T18:57:06.104081] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-16T18:57:06.104115] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-16T18:57:06.351669] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-16T18:57:06.424326] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T18:57:06.523706] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:07.142872] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-16T18:57:07.249582] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:57:07.942828] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-16T18:57:08.041374] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T18:57:08.145985] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:57:08.146294] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-16T18:57:08.146402] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:57:08.146451] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-16T18:57:08.146511] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:57:08.146584] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-16T18:57:08.146674] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-16T18:57:08.146743] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-16T18:57:08.146810] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-16T18:57:08.146859] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 2.2s. Estimated remaining: 3h 34m 17s. Rate: 7.1 symbols/min [2025-10-16T18:57:08.236827] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T18:57:08.742862] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-16T18:57:09.542912] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-16T18:57:10.342851] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-16T18:57:10.439969] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T18:57:10.590213] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T18:57:11.142838] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-16T18:57:11.909610] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T18:57:11.942795] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-16T18:57:12.439828] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T18:57:12.742887] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-16T18:57:13.542864] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-16T18:57:13.827968] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T18:57:14.266080] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-16T18:57:14.342809] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-16T18:57:14.572867] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T18:57:15.142826] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-16T18:57:15.944720] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-16T18:57:15.947136] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T18:57:16.437176] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T18:57:16.742784] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-16T18:57:17.147451] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T18:57:17.542834] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-16T18:57:18.342846] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-16T18:57:18.492898] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T18:57:19.142872] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-16T18:57:19.331034] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:57:19.381670] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T18:57:19.942854] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-16T18:57:20.742910] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-16T18:57:20.835633] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T18:57:21.198322] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T18:57:21.542850] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-16T18:57:22.342866] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-16T18:57:22.564077] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T18:57:23.105580] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T18:57:23.112247] [INFO ] [REMOTE ] FINV: Full fetch complete (64641 records). [2025-10-16T18:57:23.112382] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-16T18:57:23.149635] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-16T18:57:23.568318] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-16T18:57:23.568546] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-16T18:57:23.570030] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-16T18:57:23.570113] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-16T18:57:23.571967] [DEBUG] [LOCAL ] FINV: Trimmed 64641 records to 45609 (keeping 200 days of data) [2025-10-16T18:57:23.679890] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T18:57:23.880453] [DEBUG] [LOCAL ] FINV: Primary data saved (45609 records). [2025-10-16T18:57:23.880609] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-16T18:57:23.881563] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 44.2s. Estimated remaining: 3h 34m 22s. Rate: 7.1 symbols/min [2025-10-16T18:57:23.942889] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-16T18:57:25.085034] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T18:57:25.096571] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-16T18:57:25.178989] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-16T18:57:25.182549] [INFO ] [REMOTE ] FIX: Full fetch complete (45507 records). [2025-10-16T18:57:25.182666] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-16T18:57:25.550065] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-16T18:57:25.550143] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-16T18:57:25.550916] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-16T18:57:25.550980] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-16T18:57:25.551937] [DEBUG] [LOCAL ] FIX: Trimmed 45507 records to 29033 (keeping 200 days of data) [2025-10-16T18:57:25.732773] [DEBUG] [LOCAL ] FIX: Primary data saved (29033 records). [2025-10-16T18:57:25.732922] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-16T18:57:25.733032] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIX took 23.8s. Estimated remaining: 3h 34m 2s. Rate: 7.1 symbols/min [2025-10-16T18:57:25.921274] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T18:57:25.928266] [INFO ] [REMOTE ] FIS: Full fetch complete (77392 records). [2025-10-16T18:57:25.928452] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-16T18:57:26.308251] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-16T18:57:26.308335] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-16T18:57:26.309326] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-16T18:57:26.309395] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-16T18:57:26.310891] [DEBUG] [LOCAL ] FIS: Trimmed 77392 records to 53727 (keeping 200 days of data) [2025-10-16T18:57:26.640376] [DEBUG] [LOCAL ] FIS: Primary data saved (53727 records). [2025-10-16T18:57:26.640514] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-16T18:57:26.640989] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 39.5s. Estimated remaining: 3h 33m 40s. Rate: 7.2 symbols/min [2025-10-16T18:57:27.242901] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.313911] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.361527] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.393621] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:27.400037] [DEBUG] [LOCAL ] FLC: Loaded 5420 existing records from primary storage. [2025-10-16T18:57:27.400330] [INFO ] [MAIN ] FLC: Loaded 5420 existing records. [2025-10-16T18:57:27.592435] [DEBUG] [LOCAL ] FLNG: Loaded 33712 existing records from primary storage. [2025-10-16T18:57:27.642390] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:27.643371] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-16T18:57:27.643433] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-16T18:57:27.643616] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-16T18:57:27.643703] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-16T18:57:27.642682] [INFO ] [MAIN ] FLNG: Loaded 33712 existing records. [2025-10-16T18:57:27.862799] [DEBUG] [LOCAL ] FLG: Loaded 53327 existing records from primary storage. [2025-10-16T18:57:27.853784] [DEBUG] [LOCAL ] FLO: Loaded 52082 existing records from primary storage. [2025-10-16T18:57:27.873479] [INFO ] [MAIN ] FLG: Loaded 53327 existing records. [2025-10-16T18:57:27.884041] [INFO ] [MAIN ] FLO: Loaded 52082 existing records. [2025-10-16T18:57:28.283819] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.342087] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.387666] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-16T18:57:28.495970] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-16T18:57:28.530679] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-16T18:57:28.549808] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.573676] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:28.614976] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.620302] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-16T18:57:28.625613] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-16T18:57:28.649367] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-16T18:57:28.666858] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-16T18:57:28.699553] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-16T18:57:28.715866] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-16T18:57:28.719623] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:28.716019] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-16T18:57:28.770756] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-16T18:57:29.629307] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.640830] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T18:57:29.646228] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-16T18:57:29.696311] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-16T18:57:29.773387] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.792331] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-16T18:57:29.795617] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:29.796741] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-16T18:57:30.366437] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:57:30.368236] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-16T18:57:30.945779] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T18:57:30.947277] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-16T18:57:31.204152] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T18:57:31.212022] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-16T18:57:31.280588] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T18:57:31.528121] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T18:57:31.526533] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T18:57:31.942878] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-16T18:57:32.626030] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-16T18:57:32.742811] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-16T18:57:33.396597] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T18:57:33.542897] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-16T18:57:34.342844] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-16T18:57:34.412576] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T18:57:34.908796] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-16T18:57:35.142868] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-16T18:57:35.293112] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T18:57:35.942812] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-16T18:57:36.747986] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-16T18:57:36.761982] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T18:57:37.119969] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-16T18:57:37.524396] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T18:57:37.542780] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-16T18:57:38.342908] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-16T18:57:39.086907] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T18:57:39.142824] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-16T18:57:39.950086] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-16T18:57:39.956058] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T18:57:40.534627] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T18:57:40.644175] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T18:57:40.742782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-16T18:57:41.542815] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-16T18:57:42.204491] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T18:57:42.342782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-16T18:57:43.142877] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-16T18:57:43.261812] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T18:57:43.714904] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T18:57:43.942819] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-16T18:57:44.487515] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T18:57:44.510788] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T18:57:44.742808] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-16T18:57:45.542820] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-16T18:57:45.860172] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T18:57:46.342870] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-16T18:57:47.142839] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-16T18:57:47.260238] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T18:57:47.908750] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-16T18:57:47.942769] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-16T18:57:48.222771] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-16T18:57:48.296828] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-16T18:57:48.742819] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-16T18:57:49.542842] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-16T18:57:49.953829] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T18:57:50.342838] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-16T18:57:50.854424] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T18:57:51.044034] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T18:57:51.045225] [INFO ] [REMOTE ] FLC: Full fetch complete (7820 records). [2025-10-16T18:57:51.045296] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-16T18:57:51.146061] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-16T18:57:51.406507] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-16T18:57:51.406592] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-16T18:57:51.406935] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-16T18:57:51.406998] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-16T18:57:51.407395] [DEBUG] [LOCAL ] FLC: Trimmed 7820 records to 5440 (keeping 200 days of data) [2025-10-16T18:57:51.440497] [DEBUG] [LOCAL ] FLC: Primary data saved (5440 records). [2025-10-16T18:57:51.440623] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-16T18:57:51.440743] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLC took 24.8s. Estimated remaining: 3h 34m 1s. Rate: 7.1 symbols/min [2025-10-16T18:57:51.615997] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:51.616200] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-16T18:57:51.616240] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-16T18:57:51.616355] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-16T18:57:51.616397] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-16T18:57:51.616440] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-16T18:57:51.616474] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-16T18:57:51.947976] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-16T18:57:51.988055] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:52.742845] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-16T18:57:52.866440] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T18:57:53.391779] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T18:57:53.542832] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-16T18:57:53.735956] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T18:57:53.736293] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-16T18:57:53.736437] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T18:57:53.736528] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-16T18:57:53.736602] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T18:57:53.736699] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-16T18:57:53.736778] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-16T18:57:53.736825] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-16T18:57:53.736871] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-16T18:57:53.736932] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLOC took 2.3s. Estimated remaining: 3h 33m 42s. Rate: 7.1 symbols/min [2025-10-16T18:57:53.933333] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:57:53.989006] [DEBUG] [LOCAL ] FLR: Loaded 53241 existing records from primary storage. [2025-10-16T18:57:53.989351] [INFO ] [MAIN ] FLR: Loaded 53241 existing records. [2025-10-16T18:57:54.197113] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:57:54.197471] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-16T18:57:54.197526] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-16T18:57:54.197866] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-16T18:57:54.197923] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-16T18:57:54.347108] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-16T18:57:54.628816] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:57:54.662949] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T18:57:55.142811] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-16T18:57:55.930485] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T18:57:55.942786] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-16T18:57:56.742880] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-16T18:57:56.791949] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T18:57:57.458977] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T18:57:57.542848] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-16T18:57:58.342803] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-16T18:57:58.450820] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T18:57:58.565362] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T18:57:59.142820] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-16T18:57:59.942798] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-16T18:58:00.054981] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T18:58:00.306387] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T18:58:00.310434] [INFO ] [REMOTE ] FLNG: Full fetch complete (50123 records). [2025-10-16T18:58:00.310522] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-16T18:58:00.676376] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-16T18:58:00.676452] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-16T18:58:00.677204] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-16T18:58:00.677266] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-16T18:58:00.678252] [DEBUG] [LOCAL ] FLNG: Trimmed 50123 records to 33918 (keeping 200 days of data) [2025-10-16T18:58:00.765853] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-16T18:58:00.886862] [DEBUG] [LOCAL ] FLNG: Primary data saved (33918 records). [2025-10-16T18:58:00.887008] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-16T18:58:00.887111] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLNG took 34.2s. Estimated remaining: 3h 33m 31s. Rate: 7.1 symbols/min [2025-10-16T18:58:01.054310] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:01.099318] [DEBUG] [LOCAL ] FLS: Loaded 50373 existing records from primary storage. [2025-10-16T18:58:01.099613] [INFO ] [MAIN ] FLS: Loaded 50373 existing records. [2025-10-16T18:58:01.281487] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:01.281741] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-16T18:58:01.281796] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-16T18:58:01.281977] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-16T18:58:01.282016] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-16T18:58:01.552112] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-16T18:58:01.636995] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:01.737608] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T18:58:02.342882] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-16T18:58:02.561759] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T18:58:03.142855] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-16T18:58:03.456090] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T18:58:03.463636] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-16T18:58:03.464017] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-16T18:58:03.885239] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-16T18:58:03.885376] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-16T18:58:03.886635] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-16T18:58:03.886791] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-16T18:58:03.888374] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 53717 (keeping 200 days of data) [2025-10-16T18:58:03.951179] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-16T18:58:04.007563] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T18:58:04.018265] [INFO ] [REMOTE ] FLO: Full fetch complete (75289 records). [2025-10-16T18:58:04.019239] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-16T18:58:04.455204] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-16T18:58:04.456231] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-16T18:58:04.458610] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-16T18:58:04.459803] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-16T18:58:04.551906] [DEBUG] [LOCAL ] FLO: Trimmed 75289 records to 52459 (keeping 200 days of data) [2025-10-16T18:58:04.687467] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T18:58:04.742805] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-16T18:58:05.033080] [DEBUG] [LOCAL ] FLG: Primary data saved (53717 records). [2025-10-16T18:58:05.034390] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-16T18:58:05.034514] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLG took 38.4s. Estimated remaining: 3h 33m 15s. Rate: 7.2 symbols/min [2025-10-16T18:58:05.257388] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:05.264804] [DEBUG] [LOCAL ] FLO: Primary data saved (52459 records). [2025-10-16T18:58:05.265150] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-16T18:58:05.265723] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLO took 38.6s. Estimated remaining: 3h 32m 52s. Rate: 7.2 symbols/min [2025-10-16T18:58:05.527756] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:05.532158] [DEBUG] [LOCAL ] FLUT: Loaded 50758 existing records from primary storage. [2025-10-16T18:58:05.532878] [INFO ] [MAIN ] FLUT: Loaded 50758 existing records. [2025-10-16T18:58:05.552848] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:58:05.597234] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-16T18:58:05.746516] [DEBUG] [LOCAL ] FLXR: Loaded 21029 existing records from primary storage. [2025-10-16T18:58:05.748618] [INFO ] [MAIN ] FLXR: Loaded 21029 existing records. [2025-10-16T18:58:05.770897] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:05.862274] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-16T18:58:05.872943] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-16T18:58:05.879039] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-16T18:58:05.889358] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-16T18:58:06.025506] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:06.042171] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-16T18:58:06.049033] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-16T18:58:06.061423] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-16T18:58:06.072404] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-16T18:58:06.604190] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:06.629003] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-16T18:58:06.714488] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:06.752741] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T18:58:07.142865] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-16T18:58:07.298664] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T18:58:07.840279] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:58:07.942811] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-16T18:58:08.152580] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:58:08.742873] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-16T18:58:09.413892] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T18:58:09.413451] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-16T18:58:09.542847] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-16T18:58:10.342861] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-16T18:58:11.142812] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-16T18:58:11.327950] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:58:11.644031] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T18:58:11.942822] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-16T18:58:12.599687] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T18:58:12.716705] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T18:58:12.742771] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-16T18:58:13.542834] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-16T18:58:13.747270] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T18:58:14.342837] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-16T18:58:15.142847] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-16T18:58:15.279477] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T18:58:15.760582] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T18:58:15.942847] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-16T18:58:16.742846] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-16T18:58:16.971197] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T18:58:17.374933] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-16T18:58:17.542878] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-16T18:58:17.726676] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T18:58:18.343038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-16T18:58:19.142845] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-16T18:58:19.303576] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T18:58:19.942836] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-16T18:58:20.035438] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T18:58:20.732880] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T18:58:20.743137] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-16T18:58:21.518848] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T18:58:21.542786] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-16T18:58:22.035238] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T18:58:22.342814] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-16T18:58:23.142800] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-16T18:58:23.431012] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T18:58:23.942801] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-16T18:58:23.992839] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T18:58:24.203729] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T18:58:24.742822] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-16T18:58:25.460603] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T18:58:25.542777] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-16T18:58:26.342802] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-16T18:58:26.407070] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T18:58:27.142813] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-16T18:58:27.299391] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T18:58:27.942816] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-16T18:58:27.987070] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T18:58:28.742785] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-16T18:58:28.984308] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T18:58:28.991001] [INFO ] [REMOTE ] FLS: Full fetch complete (72438 records). [2025-10-16T18:58:28.991157] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-16T18:58:29.372886] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-16T18:58:29.372996] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-16T18:58:29.374028] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-16T18:58:29.374110] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-16T18:58:29.375573] [DEBUG] [LOCAL ] FLS: Trimmed 72438 records to 50762 (keeping 200 days of data) [2025-10-16T18:58:29.552084] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-16T18:58:29.638737] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T18:58:29.730967] [DEBUG] [LOCAL ] FLS: Primary data saved (50762 records). [2025-10-16T18:58:29.731115] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-16T18:58:29.731201] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLS took 28.8s. Estimated remaining: 3h 33m 13s. Rate: 7.1 symbols/min [2025-10-16T18:58:29.894508] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:29.941367] [DEBUG] [LOCAL ] FMC: Loaded 51849 existing records from primary storage. [2025-10-16T18:58:29.941709] [INFO ] [MAIN ] FMC: Loaded 51849 existing records. [2025-10-16T18:58:30.111504] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:30.111772] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-16T18:58:30.111822] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-16T18:58:30.112034] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-16T18:58:30.112090] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-16T18:58:30.348006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-16T18:58:30.473002] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:30.495389] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T18:58:30.503088] [INFO ] [REMOTE ] FLR: Full fetch complete (76798 records). [2025-10-16T18:58:30.503233] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-16T18:58:30.638030] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T18:58:30.977952] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-16T18:58:30.978036] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-16T18:58:30.979136] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-16T18:58:30.979203] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-16T18:58:30.980815] [DEBUG] [LOCAL ] FLR: Trimmed 76798 records to 53630 (keeping 200 days of data) [2025-10-16T18:58:31.157942] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-16T18:58:31.311454] [DEBUG] [LOCAL ] FLR: Primary data saved (53630 records). [2025-10-16T18:58:31.311604] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-16T18:58:31.312347] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLR took 37.6s. Estimated remaining: 3h 32m 52s. Rate: 7.2 symbols/min [2025-10-16T18:58:31.475670] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:31.484250] [DEBUG] [LOCAL ] FMN: Loaded 5431 existing records from primary storage. [2025-10-16T18:58:31.484469] [INFO ] [MAIN ] FMN: Loaded 5431 existing records. [2025-10-16T18:58:31.653891] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:31.654124] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-16T18:58:31.654172] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-16T18:58:31.654302] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-16T18:58:31.654339] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-16T18:58:31.944799] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-16T18:58:32.020981] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:32.062613] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T18:58:32.742789] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-16T18:58:32.933258] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T18:58:33.040860] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T18:58:33.164794] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T18:58:33.542841] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-16T18:58:34.342800] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-16T18:58:34.636366] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T18:58:35.142819] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-16T18:58:35.942852] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-16T18:58:36.029969] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T18:58:36.742791] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-16T18:58:37.014400] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T18:58:37.075739] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:58:37.219604] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T18:58:37.542864] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-16T18:58:38.342789] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-16T18:58:38.446819] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T18:58:38.450626] [INFO ] [REMOTE ] FLXR: Full fetch complete (26951 records). [2025-10-16T18:58:38.450742] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-16T18:58:38.872761] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-16T18:58:38.872836] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-16T18:58:38.873400] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-16T18:58:38.873439] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-16T18:58:38.874116] [DEBUG] [LOCAL ] FLXR: Trimmed 26951 records to 21214 (keeping 200 days of data) [2025-10-16T18:58:39.008537] [DEBUG] [LOCAL ] FLXR: Primary data saved (21214 records). [2025-10-16T18:58:39.008715] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-16T18:58:39.008831] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLXR took 33.7s. Estimated remaining: 3h 32m 42s. Rate: 7.2 symbols/min [2025-10-16T18:58:39.150314] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-16T18:58:39.177860] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:39.206686] [DEBUG] [LOCAL ] FMS: Loaded 30232 existing records from primary storage. [2025-10-16T18:58:39.206972] [INFO ] [MAIN ] FMS: Loaded 30232 existing records. [2025-10-16T18:58:39.388193] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:39.388423] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-16T18:58:39.388501] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-16T18:58:39.389330] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-16T18:58:39.389391] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-16T18:58:39.742934] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:39.942793] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-16T18:58:40.136665] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T18:58:40.667951] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T18:58:40.742865] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-16T18:58:40.966762] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T18:58:41.236223] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T18:58:41.542772] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-16T18:58:42.268192] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T18:58:42.342830] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-16T18:58:42.894048] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T18:58:43.142830] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-16T18:58:43.610694] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-16T18:58:43.942866] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-16T18:58:44.742822] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-16T18:58:45.542806] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-16T18:58:45.666833] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:58:45.984022] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-16T18:58:46.342782] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-16T18:58:46.723074] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-16T18:58:46.743817] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T18:58:46.750486] [INFO ] [REMOTE ] FLUT: Full fetch complete (73282 records). [2025-10-16T18:58:46.750606] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-16T18:58:47.130025] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-16T18:58:47.130108] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-16T18:58:47.131035] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-16T18:58:47.131100] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-16T18:58:47.132473] [DEBUG] [LOCAL ] FLUT: Trimmed 73282 records to 51111 (keeping 200 days of data) [2025-10-16T18:58:47.182003] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-16T18:58:47.434950] [DEBUG] [LOCAL ] FLUT: Primary data saved (51111 records). [2025-10-16T18:58:47.435097] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-16T18:58:47.435697] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FLUT took 42.4s. Estimated remaining: 3h 32m 34s. Rate: 7.2 symbols/min [2025-10-16T18:58:47.600545] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:47.639534] [DEBUG] [LOCAL ] FMX: Loaded 40547 existing records from primary storage. [2025-10-16T18:58:47.639879] [INFO ] [MAIN ] FMX: Loaded 40547 existing records. [2025-10-16T18:58:47.810528] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:47.810756] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-16T18:58:47.810805] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-16T18:58:47.811734] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-16T18:58:47.811796] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-16T18:58:47.947962] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-16T18:58:48.161943] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:48.570034] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-16T18:58:48.742796] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-16T18:58:49.099467] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T18:58:49.248073] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T18:58:49.249675] [INFO ] [REMOTE ] FMN: Full fetch complete (10173 records). [2025-10-16T18:58:49.249749] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-16T18:58:49.547592] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-16T18:58:49.628995] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-16T18:58:49.629074] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-16T18:58:49.629347] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-16T18:58:49.629406] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-16T18:58:49.629852] [DEBUG] [LOCAL ] FMN: Trimmed 10173 records to 5497 (keeping 200 days of data) [2025-10-16T18:58:49.662248] [DEBUG] [LOCAL ] FMN: Primary data saved (5497 records). [2025-10-16T18:58:49.662350] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-16T18:58:49.662426] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMN took 18.3s. Estimated remaining: 3h 32m 15s. Rate: 7.2 symbols/min [2025-10-16T18:58:49.829722] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:58:49.833474] [DEBUG] [LOCAL ] FMY: Loaded 1388 existing records from primary storage. [2025-10-16T18:58:49.833615] [INFO ] [MAIN ] FMY: Loaded 1388 existing records. [2025-10-16T18:58:50.004626] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:58:50.004866] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-16T18:58:50.004944] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-16T18:58:50.005090] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-16T18:58:50.005157] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-16T18:58:50.351824] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:58:50.347903] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-16T18:58:51.142786] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-16T18:58:51.343936] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T18:58:51.545434] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-16T18:58:51.944009] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-16T18:58:51.942782] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-16T18:58:52.742852] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-16T18:58:53.088142] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T18:58:53.552031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-16T18:58:53.570053] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T18:58:54.342939] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-16T18:58:54.811904] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T18:58:55.142885] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-16T18:58:55.552943] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T18:58:55.566018] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-16T18:58:55.942826] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-16T18:58:56.742790] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-16T18:58:56.818959] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T18:58:57.542841] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-16T18:58:58.192963] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-16T18:58:58.342787] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-16T18:58:58.701926] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T18:58:59.142791] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-16T18:58:59.917710] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T18:58:59.942770] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-16T18:59:00.465918] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T18:59:00.742863] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-16T18:59:01.097534] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-16T18:59:01.420800] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T18:59:01.542885] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-16T18:59:02.342833] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-16T18:59:03.004247] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T18:59:03.142857] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-16T18:59:03.579500] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-16T18:59:03.837665] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T18:59:03.942895] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-16T18:59:04.742882] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-16T18:59:05.094304] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-16T18:59:05.426467] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T18:59:05.542891] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-16T18:59:06.342858] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-16T18:59:07.142902] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-16T18:59:07.347264] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T18:59:07.357632] [INFO ] [REMOTE ] FMC: Full fetch complete (75367 records). [2025-10-16T18:59:07.357969] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-16T18:59:07.868941] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-16T18:59:07.869089] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-16T18:59:07.870909] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-16T18:59:07.871075] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-16T18:59:07.873394] [DEBUG] [LOCAL ] FMC: Trimmed 75367 records to 52236 (keeping 200 days of data) [2025-10-16T18:59:07.900554] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T18:59:07.964174] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-16T18:59:08.275943] [DEBUG] [LOCAL ] FMC: Primary data saved (52236 records). [2025-10-16T18:59:08.276210] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-16T18:59:08.276372] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMC took 38.5s. Estimated remaining: 3h 32m 24s. Rate: 7.1 symbols/min [2025-10-16T18:59:08.375762] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T18:59:08.472242] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:08.495781] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T18:59:08.534958] [DEBUG] [LOCAL ] FN: Loaded 37711 existing records from primary storage. [2025-10-16T18:59:08.535258] [INFO ] [MAIN ] FN: Loaded 37711 existing records. [2025-10-16T18:59:08.716895] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:08.717213] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-16T18:59:08.717272] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-16T18:59:08.718513] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-16T18:59:08.718604] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-16T18:59:08.748127] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-16T18:59:09.088035] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:09.542864] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-16T18:59:10.260874] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T18:59:10.342840] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-16T18:59:10.867026] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T18:59:11.142842] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-16T18:59:11.419098] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T18:59:11.597579] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T18:59:11.942843] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-16T18:59:12.742905] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-16T18:59:13.109618] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T18:59:13.544129] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-16T18:59:13.549471] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T18:59:14.342903] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-16T18:59:14.980677] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T18:59:15.142871] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-16T18:59:15.535753] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-16T18:59:15.942884] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-16T18:59:16.347427] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T18:59:16.379503] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T18:59:16.742795] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-16T18:59:17.145633] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-16T18:59:17.146353] [INFO ] [REMOTE ] FMY: Full fetch complete (1953 records). [2025-10-16T18:59:17.146419] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-16T18:59:17.512502] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-16T18:59:17.512583] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-16T18:59:17.512696] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-16T18:59:17.512755] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-16T18:59:17.513072] [DEBUG] [LOCAL ] FMY: Trimmed 1953 records to 1390 (keeping 200 days of data) [2025-10-16T18:59:17.521756] [DEBUG] [LOCAL ] FMY: Primary data saved (1390 records). [2025-10-16T18:59:17.521814] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-16T18:59:17.521877] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMY took 27.9s. Estimated remaining: 3h 32m 18s. Rate: 7.1 symbols/min [2025-10-16T18:59:17.549898] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-16T18:59:17.692278] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:17.745976] [DEBUG] [LOCAL ] FNB: Loaded 52596 existing records from primary storage. [2025-10-16T18:59:17.746311] [INFO ] [MAIN ] FNB: Loaded 52596 existing records. [2025-10-16T18:59:17.918712] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:17.918934] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-16T18:59:17.918988] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-16T18:59:17.919962] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-16T18:59:17.920019] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-16T18:59:18.260424] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:18.342814] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-16T18:59:18.904454] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T18:59:19.142885] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-16T18:59:19.942796] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-16T18:59:20.000259] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T18:59:20.512537] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T18:59:20.742829] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-16T18:59:21.101431] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T18:59:21.542824] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-16T18:59:22.342798] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-16T18:59:22.462996] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T18:59:22.734469] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T18:59:23.142818] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-16T18:59:23.566256] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T18:59:23.942846] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-16T18:59:24.340867] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T18:59:24.345772] [INFO ] [REMOTE ] FMX: Full fetch complete (57909 records). [2025-10-16T18:59:24.345903] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-16T18:59:24.743723] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-16T18:59:24.744032] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-16T18:59:24.744940] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-16T18:59:24.745025] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-16T18:59:24.743842] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-16T18:59:24.747119] [DEBUG] [LOCAL ] FMX: Trimmed 57909 records to 40866 (keeping 200 days of data) [2025-10-16T18:59:25.000209] [DEBUG] [LOCAL ] FMX: Primary data saved (40866 records). [2025-10-16T18:59:25.000340] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-16T18:59:25.001316] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 37.6s. Estimated remaining: 3h 32m 7s. Rate: 7.1 symbols/min [2025-10-16T18:59:25.170162] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:25.220763] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T18:59:25.245521] [DEBUG] [LOCAL ] FND: Loaded 52150 existing records from primary storage. [2025-10-16T18:59:25.245858] [INFO ] [MAIN ] FND: Loaded 52150 existing records. [2025-10-16T18:59:25.419290] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:25.419536] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-16T18:59:25.419587] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-16T18:59:25.420500] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-16T18:59:25.420559] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-16T18:59:25.554114] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-16T18:59:25.768241] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:26.348515] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-16T18:59:26.361720] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T18:59:27.005341] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T18:59:27.009497] [INFO ] [REMOTE ] FMS: Full fetch complete (42664 records). [2025-10-16T18:59:27.009598] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-16T18:59:27.150859] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-16T18:59:27.386255] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-16T18:59:27.386328] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-16T18:59:27.387049] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-16T18:59:27.387110] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-16T18:59:27.388001] [DEBUG] [LOCAL ] FMS: Trimmed 42664 records to 30464 (keeping 200 days of data) [2025-10-16T18:59:27.579571] [DEBUG] [LOCAL ] FMS: Primary data saved (30464 records). [2025-10-16T18:59:27.579798] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-16T18:59:27.579922] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FMS took 48.6s. Estimated remaining: 3h 31m 49s. Rate: 7.2 symbols/min [2025-10-16T18:59:27.814670] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:27.865001] [DEBUG] [LOCAL ] FNF: Loaded 48942 existing records from primary storage. [2025-10-16T18:59:27.865452] [INFO ] [MAIN ] FNF: Loaded 48942 existing records. [2025-10-16T18:59:27.947861] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-16T18:59:28.064712] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:28.065247] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-16T18:59:28.065358] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-16T18:59:28.065887] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-16T18:59:28.065958] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-16T18:59:28.189727] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-16T18:59:28.503770] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:28.690719] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T18:59:28.742814] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-16T18:59:29.542886] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-16T18:59:29.611486] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T18:59:30.091777] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T18:59:30.342832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-16T18:59:31.067164] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T18:59:31.142846] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-16T18:59:31.692329] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T18:59:31.942837] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-16T18:59:32.450109] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T18:59:32.742846] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-16T18:59:33.542888] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-16T18:59:33.690555] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T18:59:34.327345] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T18:59:34.342841] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-16T18:59:35.142852] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-16T18:59:35.180229] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T18:59:35.942364] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T18:59:35.951371] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-16T18:59:36.742839] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-16T18:59:36.930875] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T18:59:37.542900] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-16T18:59:37.729149] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T18:59:37.871901] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-16T18:59:38.342875] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-16T18:59:39.018214] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T18:59:39.142807] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-16T18:59:39.591770] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T18:59:39.596043] [INFO ] [REMOTE ] FN: Full fetch complete (56212 records). [2025-10-16T18:59:39.596149] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-16T18:59:39.950684] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-16T18:59:39.988439] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-16T18:59:39.988510] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-16T18:59:39.989518] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-16T18:59:39.989583] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-16T18:59:39.990781] [DEBUG] [LOCAL ] FN: Trimmed 56212 records to 38016 (keeping 200 days of data) [2025-10-16T18:59:40.225003] [DEBUG] [LOCAL ] FN: Primary data saved (38016 records). [2025-10-16T18:59:40.225171] [INFO ] [MAIN ] FN: Full history saved. [2025-10-16T18:59:40.225282] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 31.9s. Estimated remaining: 3h 31m 48s. Rate: 7.1 symbols/min [2025-10-16T18:59:40.408063] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:40.408300] [DEBUG] [LOCAL ] FNV: No existing data file found in primary storage. [2025-10-16T18:59:40.408349] [WARN ] [MAIN ] FNV: No existing data found, performing full refresh instead. [2025-10-16T18:59:40.408458] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-16T18:59:40.408500] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-16T18:59:40.408542] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-10-16T18:59:40.408602] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-16T18:59:40.751737] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-16T18:59:40.782118] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:40.813776] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T18:59:41.446079] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T18:59:41.542801] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-16T18:59:42.342796] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-16T18:59:42.504908] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T18:59:42.771268] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T18:59:43.142864] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-16T18:59:43.929617] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T18:59:43.942777] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-16T18:59:44.566624] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T18:59:44.742782] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-16T18:59:45.542869] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-16T18:59:45.597546] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T18:59:46.170885] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T18:59:46.342813] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-16T18:59:47.142921] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-16T18:59:47.271540] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T18:59:47.835331] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T18:59:47.942888] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-16T18:59:48.742882] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-16T18:59:49.542934] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-16T18:59:50.347739] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T18:59:50.358485] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-16T18:59:53.296057] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (6.15 seconds). [2025-10-16T18:59:53.308182] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-16T18:59:54.987266] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T18:59:54.998853] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-16T18:59:55.315930] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (7.37 seconds). [2025-10-16T18:59:55.326432] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-16T18:59:56.430584] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (6.89 seconds). [2025-10-16T18:59:56.442265] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-16T18:59:57.114808] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (6.76 seconds). [2025-10-16T18:59:57.126690] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-16T18:59:57.475741] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-16T18:59:57.483244] [INFO ] [REMOTE ] FNB: Full fetch complete (76156 records). [2025-10-16T18:59:57.483435] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-16T18:59:57.909111] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-16T18:59:57.909279] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-16T18:59:57.910789] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-16T18:59:57.910911] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-16T18:59:57.913470] [DEBUG] [LOCAL ] FNB: Trimmed 76156 records to 52986 (keeping 200 days of data) [2025-10-16T18:59:58.048742] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-16T18:59:58.063333] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-16T18:59:58.233438] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T18:59:58.248739] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-16T18:59:58.361675] [DEBUG] [LOCAL ] FNB: Primary data saved (52986 records). [2025-10-16T18:59:58.361889] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-16T18:59:58.362930] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNB took 40.8s. Estimated remaining: 3h 31m 57s. Rate: 7.1 symbols/min [2025-10-16T18:59:58.547021] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T18:59:58.563620] [DEBUG] [LOCAL ] FOA: Loaded 13050 existing records from primary storage. [2025-10-16T18:59:58.563921] [INFO ] [MAIN ] FOA: Loaded 13050 existing records. [2025-10-16T18:59:58.761385] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T18:59:58.761844] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-16T18:59:58.761910] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-16T18:59:58.799176] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-16T18:59:58.799279] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-16T18:59:58.883123] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T18:59:58.936025] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-16T18:59:59.203506] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T18:59:59.203886] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-16T18:59:59.686691] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T18:59:59.698596] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-16T18:59:59.868910] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T18:59:59.881809] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-16T18:59:59.906588] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-16T18:59:59.942863] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-16T19:00:00.173425] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:00:00.742927] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-16T19:00:01.037620] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T19:00:01.373141] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:00:01.425533] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T19:00:01.542812] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-16T19:00:02.342923] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-16T19:00:02.567511] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:00:03.142858] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-16T19:00:03.935235] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:00:03.944303] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-16T19:00:04.166510] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:00:04.173423] [INFO ] [REMOTE ] FND: Full fetch complete (74997 records). [2025-10-16T19:00:04.173543] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-16T19:00:04.573311] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-16T19:00:04.573411] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-16T19:00:04.574464] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-16T19:00:04.574575] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-16T19:00:04.590983] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:00:04.596709] [DEBUG] [LOCAL ] FND: Trimmed 74997 records to 52517 (keeping 200 days of data) [2025-10-16T19:00:04.597555] [INFO ] [REMOTE ] FNF: Full fetch complete (69976 records). [2025-10-16T19:00:04.597852] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-16T19:00:04.767574] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-16T19:00:05.062023] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:00:05.148367] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-16T19:00:05.148778] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-16T19:00:05.150099] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-16T19:00:05.150181] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-16T19:00:05.158221] [DEBUG] [LOCAL ] FNF: Trimmed 69976 records to 49296 (keeping 200 days of data) [2025-10-16T19:00:05.549168] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-16T19:00:05.645796] [DEBUG] [LOCAL ] FNF: Primary data saved (49296 records). [2025-10-16T19:00:05.646473] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-16T19:00:05.647312] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNF took 38.1s. Estimated remaining: 3h 31m 46s. Rate: 7.1 symbols/min [2025-10-16T19:00:05.780361] [DEBUG] [LOCAL ] FND: Primary data saved (52517 records). [2025-10-16T19:00:05.797844] [INFO ] [MAIN ] FND: Full history saved. [2025-10-16T19:00:05.804874] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FND took 40.8s. Estimated remaining: 3h 31m 23s. Rate: 7.1 symbols/min [2025-10-16T19:00:05.842393] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:05.987865] [DEBUG] [LOCAL ] FOF: Loaded 8595 existing records from primary storage. [2025-10-16T19:00:06.014283] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:06.011009] [INFO ] [MAIN ] FOF: Loaded 8595 existing records. [2025-10-16T19:00:06.205507] [DEBUG] [LOCAL ] FOR: Loaded 19813 existing records from primary storage. [2025-10-16T19:00:06.215103] [INFO ] [MAIN ] FOR: Loaded 19813 existing records. [2025-10-16T19:00:06.272483] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:06.307299] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-16T19:00:06.313261] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-16T19:00:06.330309] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-16T19:00:06.340967] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-16T19:00:06.524251] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:06.527886] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-16T19:00:06.533952] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-16T19:00:06.549781] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-16T19:00:06.591848] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-16T19:00:06.722533] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:00:06.813460] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-16T19:00:06.931035] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:07.151336] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-16T19:00:07.193039] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:07.237362] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-16T19:00:07.932506] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T19:00:07.937307] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:00:07.943515] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-16T19:00:08.742820] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-16T19:00:09.345964] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:00:09.399582] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T19:00:09.542821] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-16T19:00:10.342851] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-16T19:00:10.365477] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-16T19:00:11.105242] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:00:11.142770] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-16T19:00:11.844360] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:00:11.942817] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-16T19:00:12.742811] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-16T19:00:13.542959] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-16T19:00:13.546248] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:00:13.683532] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:00:14.339515] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T19:00:14.342838] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-16T19:00:15.139344] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:00:15.142757] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-16T19:00:15.942790] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-16T19:00:16.100603] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:00:16.742839] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-16T19:00:17.050630] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:00:17.336958] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:00:17.542812] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-16T19:00:18.342822] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-16T19:00:19.077353] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:00:19.083784] [INFO ] [REMOTE ] FNV: Full fetch complete (66726 records). [2025-10-16T19:00:19.083956] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-16T19:00:19.148011] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-16T19:00:19.497326] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-16T19:00:19.498003] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-16T19:00:19.498615] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T19:00:19.499969] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-16T19:00:19.504395] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-16T19:00:19.506469] [DEBUG] [LOCAL ] FNV: Trimmed 66726 records to 46507 (keeping 200 days of data) [2025-10-16T19:00:19.795600] [DEBUG] [LOCAL ] FNV: Primary data saved (46507 records). [2025-10-16T19:00:19.795760] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-16T19:00:19.795838] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNV took 39.6s. Estimated remaining: 3h 31m 25s. Rate: 7.1 symbols/min [2025-10-16T19:00:19.923340] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-16T19:00:19.946582] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-16T19:00:19.982370] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:20.025960] [DEBUG] [LOCAL ] FOUR: Loaded 49718 existing records from primary storage. [2025-10-16T19:00:20.026278] [INFO ] [MAIN ] FOUR: Loaded 49718 existing records. [2025-10-16T19:00:20.204208] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:20.204447] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-16T19:00:20.204495] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-16T19:00:20.205269] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-16T19:00:20.205327] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-16T19:00:20.567607] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:20.742769] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-16T19:00:20.985054] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:00:21.542852] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-16T19:00:21.720037] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:00:22.342867] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-16T19:00:23.142785] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-16T19:00:23.272236] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T19:00:23.658469] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T19:00:23.918427] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T19:00:23.942766] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-16T19:00:24.489853] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:00:24.742806] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-16T19:00:25.542814] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-16T19:00:26.343176] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-16T19:00:26.350282] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:00:26.547794] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:00:26.550064] [INFO ] [REMOTE ] FOA: Full fetch complete (21684 records). [2025-10-16T19:00:26.550145] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-16T19:00:26.916498] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-16T19:00:26.916572] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-16T19:00:26.917042] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-16T19:00:26.917102] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-16T19:00:26.917630] [DEBUG] [LOCAL ] FOA: Trimmed 21684 records to 13156 (keeping 200 days of data) [2025-10-16T19:00:26.994039] [DEBUG] [LOCAL ] FOA: Primary data saved (13156 records). [2025-10-16T19:00:26.994176] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-16T19:00:26.994262] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOA took 28.6s. Estimated remaining: 3h 31m 14s. Rate: 7.1 symbols/min [2025-10-16T19:00:27.143701] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-16T19:00:27.164346] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:27.183789] [DEBUG] [LOCAL ] FPF: Loaded 18844 existing records from primary storage. [2025-10-16T19:00:27.184028] [INFO ] [MAIN ] FPF: Loaded 18844 existing records. [2025-10-16T19:00:27.357135] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:27.357444] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-16T19:00:27.357564] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-16T19:00:27.358068] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-16T19:00:27.358126] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-16T19:00:27.506856] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T19:00:27.719639] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:27.942915] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-16T19:00:28.703983] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T19:00:28.742870] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-16T19:00:28.875863] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:00:29.290725] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T19:00:29.292299] [INFO ] [REMOTE ] FOF: Full fetch complete (11927 records). [2025-10-16T19:00:29.292372] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-16T19:00:29.548044] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-16T19:00:29.656099] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-16T19:00:29.656193] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-16T19:00:29.656552] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-16T19:00:29.656610] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-16T19:00:29.657097] [DEBUG] [LOCAL ] FOF: Trimmed 11927 records to 8657 (keeping 200 days of data) [2025-10-16T19:00:29.709119] [DEBUG] [LOCAL ] FOF: Primary data saved (8657 records). [2025-10-16T19:00:29.709247] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-16T19:00:29.709327] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOF took 24.1s. Estimated remaining: 3h 30m 56s. Rate: 7.1 symbols/min [2025-10-16T19:00:29.876687] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:29.893924] [DEBUG] [LOCAL ] FPH: Loaded 19325 existing records from primary storage. [2025-10-16T19:00:29.894159] [INFO ] [MAIN ] FPH: Loaded 19325 existing records. [2025-10-16T19:00:30.067146] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:30.067343] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-16T19:00:30.067389] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-16T19:00:30.067773] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-16T19:00:30.067832] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-16T19:00:30.348002] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-16T19:00:30.422254] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:30.506662] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:00:31.142831] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-16T19:00:31.942812] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-16T19:00:32.101925] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:00:32.225221] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:00:32.742781] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-16T19:00:33.042076] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:00:33.542880] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-16T19:00:34.342797] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-16T19:00:34.408943] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:00:34.473080] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:00:35.142872] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-16T19:00:35.216278] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:00:35.942808] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-16T19:00:36.742855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-16T19:00:36.819280] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:00:37.084984] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:00:37.337229] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:00:37.542845] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-16T19:00:38.342784] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-16T19:00:38.386739] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:00:39.142813] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-16T19:00:39.199708] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:00:39.868162] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:00:39.942955] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-16T19:00:40.742785] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-16T19:00:40.923384] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:00:41.542859] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-16T19:00:42.067772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:00:42.196802] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:00:42.342831] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-16T19:00:43.142816] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-16T19:00:43.486135] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-16T19:00:43.942843] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-16T19:00:44.742827] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-16T19:00:44.819428] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:00:44.908031] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:00:44.910537] [INFO ] [REMOTE ] FOR: Full fetch complete (29791 records). [2025-10-16T19:00:44.910609] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-16T19:00:45.291162] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-16T19:00:45.291241] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-16T19:00:45.291940] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-16T19:00:45.292003] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-16T19:00:45.292719] [DEBUG] [LOCAL ] FOR: Trimmed 29791 records to 19877 (keeping 200 days of data) [2025-10-16T19:00:45.409447] [DEBUG] [LOCAL ] FOR: Primary data saved (19877 records). [2025-10-16T19:00:45.409594] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-16T19:00:45.409700] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FOR took 39.6s. Estimated remaining: 3h 31m 0s. Rate: 7.1 symbols/min [2025-10-16T19:00:45.549881] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-16T19:00:45.584405] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:45.615491] [DEBUG] [LOCAL ] FPI: Loaded 31359 existing records from primary storage. [2025-10-16T19:00:45.615837] [INFO ] [MAIN ] FPI: Loaded 31359 existing records. [2025-10-16T19:00:45.794998] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:45.795292] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-16T19:00:45.795443] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-16T19:00:45.796270] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-16T19:00:45.796328] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-16T19:00:45.990610] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T19:00:46.192605] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:46.342912] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-16T19:00:47.142868] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-16T19:00:47.265298] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:00:47.784104] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:00:47.942793] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-16T19:00:48.137282] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:00:48.742797] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-16T19:00:48.988142] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:00:49.542791] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-16T19:00:49.708533] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T19:00:50.342845] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-16T19:00:51.066562] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:00:51.142794] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-16T19:00:51.196766] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-16T19:00:51.942792] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-16T19:00:52.039750] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T19:00:52.742829] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-16T19:00:52.925026] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:00:53.542829] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-16T19:00:53.648483] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:00:54.307584] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:00:54.342822] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-16T19:00:55.142844] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-16T19:00:55.500692] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:00:55.942816] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-16T19:00:56.742876] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-16T19:00:57.007470] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-16T19:00:57.128049] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-16T19:00:57.134806] [INFO ] [REMOTE ] FOUR: Full fetch complete (72264 records). [2025-10-16T19:00:57.134954] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-16T19:00:57.521573] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-16T19:00:57.521693] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-16T19:00:57.522736] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-16T19:00:57.522893] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-16T19:00:57.524376] [DEBUG] [LOCAL ] FOUR: Trimmed 72264 records to 50101 (keeping 200 days of data) [2025-10-16T19:00:57.573104] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-16T19:00:57.750560] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:00:57.843431] [DEBUG] [LOCAL ] FOUR: Primary data saved (50101 records). [2025-10-16T19:00:57.843573] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-16T19:00:57.843672] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 38.0s. Estimated remaining: 3h 30m 59s. Rate: 7.1 symbols/min [2025-10-16T19:00:58.017439] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:00:58.057804] [DEBUG] [LOCAL ] FR: Loaded 46546 existing records from primary storage. [2025-10-16T19:00:58.058145] [INFO ] [MAIN ] FR: Loaded 46546 existing records. [2025-10-16T19:00:58.244756] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:00:58.245001] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-16T19:00:58.245070] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-16T19:00:58.245892] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-16T19:00:58.245951] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-16T19:00:58.347952] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-16T19:00:58.413277] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:00:58.658076] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:00:59.142823] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-16T19:00:59.544805] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:00:59.548834] [INFO ] [REMOTE ] FPF: Full fetch complete (26738 records). [2025-10-16T19:00:59.548948] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-16T19:00:59.930589] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-16T19:00:59.930691] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-16T19:00:59.931278] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-16T19:00:59.931320] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-16T19:00:59.932015] [DEBUG] [LOCAL ] FPF: Trimmed 26738 records to 19054 (keeping 200 days of data) [2025-10-16T19:00:59.980254] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-16T19:01:00.049256] [DEBUG] [LOCAL ] FPF: Primary data saved (19054 records). [2025-10-16T19:01:00.049380] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-16T19:01:00.049458] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPF took 33.1s. Estimated remaining: 3h 30m 40s. Rate: 7.1 symbols/min [2025-10-16T19:01:00.214848] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:00.229770] [DEBUG] [LOCAL ] FRA: Loaded 14294 existing records from primary storage. [2025-10-16T19:01:00.230052] [INFO ] [MAIN ] FRA: Loaded 14294 existing records. [2025-10-16T19:01:00.411932] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:00.412285] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-16T19:01:00.412407] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-16T19:01:00.412846] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-16T19:01:00.412917] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-16T19:01:00.785626] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-16T19:01:00.822919] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:00.826194] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:01:01.058856] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:01:01.542852] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-16T19:01:02.342838] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-16T19:01:02.747064] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T19:01:03.142881] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-16T19:01:03.386086] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:01:03.389927] [INFO ] [REMOTE ] FPH: Full fetch complete (31152 records). [2025-10-16T19:01:03.390069] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-16T19:01:03.522050] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T19:01:03.875796] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-16T19:01:03.875909] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-16T19:01:03.876873] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-16T19:01:03.877015] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-16T19:01:03.888983] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:01:03.893806] [DEBUG] [LOCAL ] FPH: Trimmed 31152 records to 19484 (keeping 200 days of data) [2025-10-16T19:01:03.949233] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-16T19:01:04.018570] [DEBUG] [LOCAL ] FPH: Primary data saved (19484 records). [2025-10-16T19:01:04.018767] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-16T19:01:04.018864] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPH took 34.3s. Estimated remaining: 3h 30m 24s. Rate: 7.1 symbols/min [2025-10-16T19:01:04.219964] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:04.238710] [DEBUG] [LOCAL ] FRGE: Loaded 16119 existing records from primary storage. [2025-10-16T19:01:04.239018] [INFO ] [MAIN ] FRGE: Loaded 16119 existing records. [2025-10-16T19:01:04.449998] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:04.450280] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-16T19:01:04.450359] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-16T19:01:04.450559] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-16T19:01:04.450617] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-16T19:01:04.744243] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-16T19:01:04.877286] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:05.143142] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:01:05.542830] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-16T19:01:06.342797] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-16T19:01:06.395413] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:01:06.865221] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:01:07.142861] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-16T19:01:07.257527] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T19:01:07.942811] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-16T19:01:08.753732] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-16T19:01:08.788852] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:01:09.301552] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:01:09.542848] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-16T19:01:09.752499] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-16T19:01:10.212916] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T19:01:10.342796] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-16T19:01:11.142815] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-16T19:01:11.358285] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:01:11.942819] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-16T19:01:12.742794] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-16T19:01:12.777842] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:01:12.801804] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:01:13.542806] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-16T19:01:14.273003] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:01:14.287600] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T19:01:14.342781] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-16T19:01:15.006864] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:01:15.142794] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-16T19:01:15.942830] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-16T19:01:16.532186] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:01:16.742810] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-16T19:01:17.522772] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:01:17.542799] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-16T19:01:17.758007] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-16T19:01:18.342801] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-16T19:01:19.102586] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-16T19:01:19.142773] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-16T19:01:19.513402] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T19:01:19.942814] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-16T19:01:20.742807] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-16T19:01:20.869127] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T19:01:20.912434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:01:21.542809] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-16T19:01:21.918140] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:01:22.342838] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-16T19:01:23.067767] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T19:01:23.096959] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:01:23.142774] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-16T19:01:23.942803] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-16T19:01:24.637809] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:01:24.679197] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:01:24.681579] [INFO ] [REMOTE ] FRA: Full fetch complete (23636 records). [2025-10-16T19:01:24.681694] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-16T19:01:24.747952] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-16T19:01:25.069712] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-16T19:01:25.069797] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-16T19:01:25.070284] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-16T19:01:25.070323] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-16T19:01:25.070931] [DEBUG] [LOCAL ] FRA: Trimmed 23636 records to 14371 (keeping 200 days of data) [2025-10-16T19:01:25.158479] [DEBUG] [LOCAL ] FRA: Primary data saved (14371 records). [2025-10-16T19:01:25.158635] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-16T19:01:25.158756] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FRA took 25.1s. Estimated remaining: 3h 30m 37s. Rate: 7.1 symbols/min [2025-10-16T19:01:25.328189] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:25.380283] [DEBUG] [LOCAL ] FRO: Loaded 51696 existing records from primary storage. [2025-10-16T19:01:25.380591] [INFO ] [MAIN ] FRO: Loaded 51696 existing records. [2025-10-16T19:01:25.544791] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-16T19:01:25.560297] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:25.560527] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-16T19:01:25.560574] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-16T19:01:25.561236] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-16T19:01:25.561307] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-16T19:01:25.917296] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:26.006421] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T19:01:26.342822] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-16T19:01:26.886438] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:01:26.971922] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:01:27.142840] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-16T19:01:27.942846] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-16T19:01:28.507571] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:01:28.511905] [INFO ] [REMOTE ] FPI: Full fetch complete (43917 records). [2025-10-16T19:01:28.512061] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-16T19:01:28.747972] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-16T19:01:28.916960] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-16T19:01:28.917050] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-16T19:01:28.917820] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-16T19:01:28.917886] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-16T19:01:28.919115] [DEBUG] [LOCAL ] FPI: Trimmed 43917 records to 31623 (keeping 200 days of data) [2025-10-16T19:01:29.113972] [DEBUG] [LOCAL ] FPI: Primary data saved (31623 records). [2025-10-16T19:01:29.114107] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-16T19:01:29.114182] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FPI took 43.7s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-16T19:01:29.282272] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:29.335784] [DEBUG] [LOCAL ] FRT: Loaded 41709 existing records from primary storage. [2025-10-16T19:01:29.336899] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T19:01:29.337245] [INFO ] [MAIN ] FRT: Loaded 41709 existing records. [2025-10-16T19:01:29.385604] [INFO ] [REMOTE ] FR: Full fetch complete (67022 records). [2025-10-16T19:01:29.411609] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-16T19:01:29.547059] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-16T19:01:29.653535] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:29.663961] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-16T19:01:29.682985] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-16T19:01:29.713109] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-16T19:01:29.778328] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-16T19:01:30.093160] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-16T19:01:30.108735] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-16T19:01:30.113909] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-16T19:01:30.159156] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-16T19:01:30.223886] [DEBUG] [LOCAL ] FR: Trimmed 67022 records to 46923 (keeping 200 days of data) [2025-10-16T19:01:30.348485] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:30.385120] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-16T19:01:30.408546] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-16T19:01:30.594304] [DEBUG] [LOCAL ] FR: Primary data saved (46923 records). [2025-10-16T19:01:30.594438] [INFO ] [MAIN ] FR: Full history saved. [2025-10-16T19:01:30.594518] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FR took 32.8s. Estimated remaining: 3h 30m 1s. Rate: 7.1 symbols/min [2025-10-16T19:01:30.766813] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:30.801850] [DEBUG] [LOCAL ] FSCO: Loaded 38487 existing records from primary storage. [2025-10-16T19:01:30.802126] [INFO ] [MAIN ] FSCO: Loaded 38487 existing records. [2025-10-16T19:01:30.988180] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:30.998195] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-16T19:01:31.011846] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-16T19:01:31.014948] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-16T19:01:31.015396] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-16T19:01:31.016533] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-16T19:01:31.147891] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-16T19:01:31.395969] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:31.819478] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:01:31.836226] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:01:31.942818] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-16T19:01:32.742848] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-16T19:01:33.398150] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:01:33.542851] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-16T19:01:33.720169] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:01:34.342820] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-16T19:01:34.729268] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T19:01:35.142820] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-16T19:01:35.942798] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-16T19:01:36.068175] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:01:36.521674] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:01:36.742838] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-16T19:01:36.762002] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:01:37.542875] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-16T19:01:38.349542] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-16T19:01:38.367983] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:01:39.057926] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T19:01:39.142795] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-16T19:01:39.942886] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-16T19:01:40.228871] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-16T19:01:40.524447] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:01:40.742795] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-16T19:01:40.863829] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:01:40.865795] [INFO ] [REMOTE ] FRGE: Full fetch complete (30857 records). [2025-10-16T19:01:40.865866] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-16T19:01:41.233951] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-16T19:01:41.234034] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-16T19:01:41.234685] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-16T19:01:41.234748] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-16T19:01:41.235563] [DEBUG] [LOCAL ] FRGE: Trimmed 30857 records to 16223 (keeping 200 days of data) [2025-10-16T19:01:41.327795] [DEBUG] [LOCAL ] FRGE: Primary data saved (16223 records). [2025-10-16T19:01:41.327933] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-16T19:01:41.328027] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRGE took 37.3s. Estimated remaining: 3h 29m 57s. Rate: 7.1 symbols/min [2025-10-16T19:01:41.493489] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:41.538150] [DEBUG] [LOCAL ] FSK: Loaded 49506 existing records from primary storage. [2025-10-16T19:01:41.538462] [INFO ] [MAIN ] FSK: Loaded 49506 existing records. [2025-10-16T19:01:41.549540] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-16T19:01:41.716091] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:41.716244] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-16T19:01:41.716291] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-16T19:01:41.716487] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-16T19:01:41.716543] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-16T19:01:42.069802] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:42.342788] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-16T19:01:42.464985] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:01:42.637197] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:01:43.142818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-16T19:01:43.942851] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-16T19:01:44.013541] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:01:44.742794] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-16T19:01:44.873728] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:01:45.471426] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:01:45.542817] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-16T19:01:46.340829] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:01:46.350223] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-16T19:01:47.077380] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:01:47.142853] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-16T19:01:47.827048] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:01:47.942901] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-16T19:01:48.661959] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:01:48.742823] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-16T19:01:49.192485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:01:49.542890] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-16T19:01:50.100564] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T19:01:50.342816] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-16T19:01:51.142874] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-16T19:01:51.310856] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:01:51.942848] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-16T19:01:52.204407] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:01:52.717394] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:01:52.742835] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-16T19:01:53.344752] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:01:53.542862] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-16T19:01:54.232746] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:01:54.342849] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-16T19:01:55.142818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-16T19:01:55.186909] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T19:01:55.831954] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:01:55.837117] [INFO ] [REMOTE ] FRT: Full fetch complete (60531 records). [2025-10-16T19:01:55.837224] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-16T19:01:55.947991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-16T19:01:56.219951] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-16T19:01:56.220052] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-16T19:01:56.221050] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-16T19:01:56.221117] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-16T19:01:56.222425] [DEBUG] [LOCAL ] FRT: Trimmed 60531 records to 42000 (keeping 200 days of data) [2025-10-16T19:01:56.483392] [DEBUG] [LOCAL ] FRT: Primary data saved (42000 records). [2025-10-16T19:01:56.483528] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-16T19:01:56.484135] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FRT took 27.4s. Estimated remaining: 3h 29m 60s. Rate: 7.1 symbols/min [2025-10-16T19:01:56.656551] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:01:56.735347] [DEBUG] [LOCAL ] FSLY: Loaded 51325 existing records from primary storage. [2025-10-16T19:01:56.734285] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T19:01:56.745675] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-16T19:01:56.747187] [INFO ] [MAIN ] FSLY: Loaded 51325 existing records. [2025-10-16T19:01:56.937456] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:01:56.937717] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-16T19:01:56.937775] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-16T19:01:56.938007] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-16T19:01:56.938063] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-16T19:01:57.290539] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:01:57.542824] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-16T19:01:57.691716] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T19:01:58.155018] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:01:58.342891] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-16T19:01:59.142804] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-16T19:01:59.585696] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T19:01:59.861845] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:01:59.942816] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-16T19:02:00.697748] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:02:00.742829] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-16T19:02:01.515362] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:02:01.542785] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-16T19:02:02.342845] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-16T19:02:02.631220] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T19:02:03.140890] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:02:03.149150] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-16T19:02:03.942807] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-16T19:02:04.237054] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T19:02:04.321436] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:02:04.742823] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-16T19:02:05.342155] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:02:05.348186] [INFO ] [REMOTE ] FSCO: Full fetch complete (55347 records). [2025-10-16T19:02:05.348293] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-16T19:02:05.553556] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-16T19:02:05.721585] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-16T19:02:05.721690] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-16T19:02:05.722507] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-16T19:02:05.722550] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-16T19:02:05.723738] [DEBUG] [LOCAL ] FSCO: Trimmed 55347 records to 38807 (keeping 200 days of data) [2025-10-16T19:02:05.949087] [DEBUG] [LOCAL ] FSCO: Primary data saved (38807 records). [2025-10-16T19:02:05.949226] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-16T19:02:05.949304] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FSCO took 35.4s. Estimated remaining: 3h 29m 53s. Rate: 7.1 symbols/min [2025-10-16T19:02:06.120970] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:06.178096] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T19:02:06.204943] [DEBUG] [LOCAL ] FSM: Loaded 53301 existing records from primary storage. [2025-10-16T19:02:06.205272] [INFO ] [MAIN ] FSM: Loaded 53301 existing records. [2025-10-16T19:02:06.348401] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-16T19:02:06.377972] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:06.378250] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-16T19:02:06.378298] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-16T19:02:06.378540] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-16T19:02:06.378617] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-16T19:02:06.719237] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:07.142810] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-16T19:02:07.340484] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:02:07.942824] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-16T19:02:08.308718] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-16T19:02:08.742818] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-16T19:02:08.828400] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:02:09.542772] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-16T19:02:09.735142] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:02:10.342816] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-16T19:02:10.752524] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-16T19:02:11.019307] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:02:11.142789] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-16T19:02:11.942795] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-16T19:02:12.405548] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:02:12.413025] [INFO ] [REMOTE ] FSK: Full fetch complete (72064 records). [2025-10-16T19:02:12.413291] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-16T19:02:12.755982] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-16T19:02:12.778150] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-16T19:02:12.876733] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-16T19:02:12.876833] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-16T19:02:12.877786] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-16T19:02:12.877850] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-16T19:02:12.879329] [DEBUG] [LOCAL ] FSK: Trimmed 72064 records to 49891 (keeping 200 days of data) [2025-10-16T19:02:13.199297] [DEBUG] [LOCAL ] FSK: Primary data saved (49891 records). [2025-10-16T19:02:13.199450] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-16T19:02:13.199964] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 31.9s. Estimated remaining: 3h 29m 43s. Rate: 7.1 symbols/min [2025-10-16T19:02:13.403301] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:13.433176] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:02:13.448934] [INFO ] [REMOTE ] FRO: Full fetch complete (75367 records). [2025-10-16T19:02:13.449139] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-16T19:02:13.547932] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-16T19:02:13.563076] [DEBUG] [LOCAL ] FSS: Loaded 33666 existing records from primary storage. [2025-10-16T19:02:13.563721] [INFO ] [MAIN ] FSS: Loaded 33666 existing records. [2025-10-16T19:02:13.981745] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:14.000964] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-16T19:02:14.006188] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-16T19:02:14.040611] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-16T19:02:14.069268] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-16T19:02:14.064768] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-16T19:02:14.111715] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-16T19:02:14.125372] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-16T19:02:14.140061] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-16T19:02:14.198914] [DEBUG] [LOCAL ] FRO: Trimmed 75367 records to 52078 (keeping 200 days of data) [2025-10-16T19:02:14.546188] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:14.548773] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-16T19:02:14.588896] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T19:02:14.816507] [DEBUG] [LOCAL ] FRO: Primary data saved (52078 records). [2025-10-16T19:02:14.816666] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-16T19:02:14.817312] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FRO took 49.7s. Estimated remaining: 3h 29m 23s. Rate: 7.1 symbols/min [2025-10-16T19:02:14.987055] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:15.018121] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T19:02:15.031785] [DEBUG] [LOCAL ] FT: Loaded 6804 existing records from primary storage. [2025-10-16T19:02:15.031997] [INFO ] [MAIN ] FT: Loaded 6804 existing records. [2025-10-16T19:02:15.147888] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-16T19:02:15.208200] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:15.208476] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-16T19:02:15.208527] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-16T19:02:15.208715] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-16T19:02:15.208771] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-16T19:02:15.561787] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:15.576569] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:02:15.942826] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-16T19:02:16.500245] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:02:16.725721] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T19:02:16.742779] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-16T19:02:17.542804] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-16T19:02:18.250897] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:02:18.342839] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-16T19:02:18.443631] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T19:02:18.914821] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T19:02:19.142799] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-16T19:02:19.942818] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-16T19:02:20.416099] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-16T19:02:20.443428] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:02:20.742820] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-16T19:02:21.460113] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:02:21.542862] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-16T19:02:22.342838] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-16T19:02:22.936037] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:02:23.142819] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-16T19:02:23.920468] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T19:02:23.942829] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-16T19:02:24.646171] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T19:02:24.742828] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-16T19:02:24.828493] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:02:25.542828] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-16T19:02:25.980555] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:02:26.342806] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-16T19:02:26.431565] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-16T19:02:26.442178] [INFO ] [REMOTE ] FSLY: Full fetch complete (74994 records). [2025-10-16T19:02:26.442402] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-16T19:02:26.844785] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-16T19:02:26.844880] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-16T19:02:26.845817] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-16T19:02:26.845881] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-16T19:02:26.847209] [DEBUG] [LOCAL ] FSLY: Trimmed 74994 records to 51707 (keeping 200 days of data) [2025-10-16T19:02:27.144739] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-16T19:02:27.155544] [DEBUG] [LOCAL ] FSLY: Primary data saved (51707 records). [2025-10-16T19:02:27.155672] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-16T19:02:27.156195] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSLY took 30.7s. Estimated remaining: 3h 29m 21s. Rate: 7.1 symbols/min [2025-10-16T19:02:27.331918] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:27.348726] [DEBUG] [LOCAL ] FTHY: Loaded 12336 existing records from primary storage. [2025-10-16T19:02:27.348988] [INFO ] [MAIN ] FTHY: Loaded 12336 existing records. [2025-10-16T19:02:27.528878] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:27.529099] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-16T19:02:27.529147] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-16T19:02:27.529296] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-16T19:02:27.529334] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-16T19:02:27.897254] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:27.923350] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:02:27.942786] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-16T19:02:28.742816] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-16T19:02:28.885004] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T19:02:29.556176] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-16T19:02:29.559848] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T19:02:29.691274] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-16T19:02:30.105864] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T19:02:30.342845] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-16T19:02:31.142820] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-16T19:02:31.942836] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-16T19:02:32.319446] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:02:32.398298] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T19:02:32.457866] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T19:02:32.742847] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-16T19:02:33.542822] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-16T19:02:34.232069] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:02:34.342794] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-16T19:02:34.552262] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T19:02:34.921374] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:02:35.142797] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-16T19:02:35.876457] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:02:35.942855] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-16T19:02:36.742798] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-16T19:02:37.299165] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:02:37.475329] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:02:37.542905] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-16T19:02:38.342911] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-16T19:02:38.513863] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T19:02:39.142878] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-16T19:02:39.890370] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:02:39.934179] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-16T19:02:39.942828] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-16T19:02:40.742856] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-16T19:02:41.164689] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T19:02:41.542835] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-16T19:02:42.343796] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-16T19:02:42.351503] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T19:02:42.926510] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T19:02:42.929581] [INFO ] [REMOTE ] FT: Full fetch complete (9324 records). [2025-10-16T19:02:42.929485] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:02:42.932030] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-16T19:02:43.147963] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-16T19:02:43.322741] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-16T19:02:43.322821] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-16T19:02:43.323070] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-16T19:02:43.323111] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-16T19:02:43.323583] [DEBUG] [LOCAL ] FT: Trimmed 9324 records to 6851 (keeping 200 days of data) [2025-10-16T19:02:43.365400] [DEBUG] [LOCAL ] FT: Primary data saved (6851 records). [2025-10-16T19:02:43.365546] [INFO ] [MAIN ] FT: Full history saved. [2025-10-16T19:02:43.365731] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FT took 28.5s. Estimated remaining: 3h 29m 26s. Rate: 7.1 symbols/min [2025-10-16T19:02:43.546260] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:43.601160] [DEBUG] [LOCAL ] FTI: Loaded 53296 existing records from primary storage. [2025-10-16T19:02:43.601505] [INFO ] [MAIN ] FTI: Loaded 53296 existing records. [2025-10-16T19:02:43.789336] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:43.789606] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-16T19:02:43.789693] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-16T19:02:43.789921] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-16T19:02:43.789976] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-16T19:02:43.947130] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-16T19:02:44.053698] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:02:44.162904] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:44.742866] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-16T19:02:45.358118] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:02:45.363143] [INFO ] [REMOTE ] FSS: Full fetch complete (48605 records). [2025-10-16T19:02:45.363441] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-16T19:02:45.543277] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-16T19:02:45.767675] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-16T19:02:45.767762] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-16T19:02:45.768628] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-16T19:02:45.768713] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-16T19:02:45.769750] [DEBUG] [LOCAL ] FSS: Trimmed 48605 records to 33877 (keeping 200 days of data) [2025-10-16T19:02:45.990245] [DEBUG] [LOCAL ] FSS: Primary data saved (33877 records). [2025-10-16T19:02:45.990416] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-16T19:02:45.990509] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FSS took 32.8s. Estimated remaining: 3h 29m 8s. Rate: 7.1 symbols/min [2025-10-16T19:02:46.173021] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:02:46.211908] [DEBUG] [LOCAL ] FTK: Loaded 32908 existing records from primary storage. [2025-10-16T19:02:46.212250] [INFO ] [MAIN ] FTK: Loaded 32908 existing records. [2025-10-16T19:02:46.344489] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-16T19:02:46.436238] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:02:46.436626] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-16T19:02:46.436749] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-16T19:02:46.437302] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-16T19:02:46.437411] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-16T19:02:46.633544] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:02:46.856717] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:02:47.142794] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-16T19:02:47.216782] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:02:47.393032] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T19:02:47.942836] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-16T19:02:48.742988] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-16T19:02:48.871174] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:02:48.980725] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:02:49.542869] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-16T19:02:50.200189] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:02:50.342790] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-16T19:02:50.645408] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:02:51.142856] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-16T19:02:51.741929] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:02:51.942841] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-16T19:02:52.742868] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-16T19:02:52.773700] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:02:52.894516] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-16T19:02:53.542887] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-16T19:02:54.187004] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:02:54.342804] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-16T19:02:54.602286] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-16T19:02:55.142791] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-16T19:02:55.362426] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:02:55.942860] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-16T19:02:56.742794] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-16T19:02:56.912827] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:02:57.542817] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-16T19:02:57.808937] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-16T19:02:57.847919] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:02:58.342818] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-16T19:02:58.909446] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:02:59.143519] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-16T19:02:59.142842] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-16T19:02:59.942835] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-16T19:03:00.742777] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-16T19:03:00.821824] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:03:00.824029] [INFO ] [REMOTE ] FTHY: Full fetch complete (17348 records). [2025-10-16T19:03:00.824100] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-16T19:03:01.186869] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-16T19:03:01.187000] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-16T19:03:01.187419] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-16T19:03:01.187627] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-16T19:03:01.204543] [DEBUG] [LOCAL ] FTHY: Trimmed 17348 records to 12446 (keeping 200 days of data) [2025-10-16T19:03:01.205917] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:03:01.243894] [INFO ] [REMOTE ] FSM: Full fetch complete (77082 records). [2025-10-16T19:03:01.249941] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-16T19:03:01.442358] [DEBUG] [LOCAL ] FTHY: Primary data saved (12446 records). [2025-10-16T19:03:01.466006] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-16T19:03:01.471003] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 34.3s. Estimated remaining: 3h 29m 11s. Rate: 7.1 symbols/min [2025-10-16T19:03:01.552438] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-16T19:03:01.699764] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-16T19:03:01.699857] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-16T19:03:01.701112] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-16T19:03:01.701177] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-16T19:03:01.702913] [DEBUG] [LOCAL ] FSM: Trimmed 77082 records to 53691 (keeping 200 days of data) [2025-10-16T19:03:02.020207] [DEBUG] [LOCAL ] FSM: Primary data saved (53691 records). [2025-10-16T19:03:02.020356] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-16T19:03:02.020496] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FSM took 56.1s. Estimated remaining: 3h 28m 50s. Rate: 7.1 symbols/min [2025-10-16T19:03:02.147367] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:03:02.342815] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-16T19:03:03.101682] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:03:03.142788] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-16T19:03:03.855592] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:03:03.942887] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-16T19:03:05.050788] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-16T19:03:05.062896] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-16T19:03:05.475770] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:03:05.542857] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-16T19:03:06.876962] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:03:06.888280] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-16T19:03:06.911276] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:03:07.142805] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-16T19:03:08.531536] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:03:08.540382] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-16T19:03:08.664726] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:03:08.742851] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-16T19:03:09.646628] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:03:09.651440] [INFO ] [REMOTE ] FTK: Full fetch complete (44002 records). [2025-10-16T19:03:09.651579] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-16T19:03:10.049417] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-16T19:03:10.049522] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-16T19:03:10.050376] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-16T19:03:10.050446] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-16T19:03:10.051565] [DEBUG] [LOCAL ] FTK: Trimmed 44002 records to 33095 (keeping 200 days of data) [2025-10-16T19:03:10.242877] [DEBUG] [LOCAL ] FTK: Primary data saved (33095 records). [2025-10-16T19:03:10.242998] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-16T19:03:10.243074] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 24.3s. Estimated remaining: 3h 28m 41s. Rate: 7.1 symbols/min [2025-10-16T19:03:10.319043] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:03:10.325757] [INFO ] [REMOTE ] FTI: Full fetch complete (77326 records). [2025-10-16T19:03:10.325868] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-16T19:03:10.715773] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-16T19:03:10.715849] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-16T19:03:10.716807] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-16T19:03:10.716870] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-16T19:03:10.718238] [DEBUG] [LOCAL ] FTI: Trimmed 77326 records to 53685 (keeping 200 days of data) [2025-10-16T19:03:11.035768] [DEBUG] [LOCAL ] FTI: Primary data saved (53685 records). [2025-10-16T19:03:11.035915] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-16T19:03:11.036578] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTI took 27.7s. Estimated remaining: 3h 28m 20s. Rate: 7.1 symbols/min [2025-10-16T19:03:11.600766] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.693710] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.719082] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.738550] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:11.741819] [DEBUG] [LOCAL ] FTWO: Loaded 1915 existing records from primary storage. [2025-10-16T19:03:11.742246] [INFO ] [MAIN ] FTWO: Loaded 1915 existing records. [2025-10-16T19:03:11.958786] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:11.960004] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-16T19:03:11.960090] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-16T19:03:11.960392] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-16T19:03:11.960481] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-16T19:03:12.105103] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-16T19:03:12.123134] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-16T19:03:12.123016] [DEBUG] [LOCAL ] FTS: Loaded 42538 existing records from primary storage. [2025-10-16T19:03:12.129415] [INFO ] [MAIN ] FTS: Loaded 42538 existing records. [2025-10-16T19:03:12.123861] [DEBUG] [LOCAL ] FTV: Loaded 53067 existing records from primary storage. [2025-10-16T19:03:12.228751] [INFO ] [MAIN ] FTV: Loaded 53067 existing records. [2025-10-16T19:03:12.660002] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:12.738345] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-16T19:03:12.792856] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-16T19:03:12.826515] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-16T19:03:12.932965] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:12.963058] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-16T19:03:12.962973] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-16T19:03:12.996899] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:12.997226] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-16T19:03:13.007597] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-16T19:03:13.022706] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-16T19:03:12.936635] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:13.033210] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-16T19:03:13.071455] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-16T19:03:13.087557] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-16T19:03:13.108263] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-16T19:03:13.111995] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-16T19:03:13.750369] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:03:13.859096] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:13.839841] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-16T19:03:13.869728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-16T19:03:14.031164] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:14.046843] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-16T19:03:14.070092] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:14.070353] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-16T19:03:14.308356] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:03:14.310856] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-16T19:03:14.761424] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-16T19:03:14.762761] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-16T19:03:15.192084] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T19:03:15.193323] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-16T19:03:15.494006] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:03:15.528097] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:03:15.676308] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-16T19:03:15.942799] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-16T19:03:16.076036] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-16T19:03:16.273950] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-16T19:03:16.742817] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-16T19:03:17.542868] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-16T19:03:18.345982] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-16T19:03:18.352777] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:03:18.804049] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T19:03:18.835077] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:03:19.142796] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-16T19:03:19.942842] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-16T19:03:20.742851] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-16T19:03:20.929407] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T19:03:21.027475] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:03:21.542787] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-16T19:03:22.342862] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-16T19:03:22.773121] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-16T19:03:22.797991] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:03:23.055281] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T19:03:23.142873] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-16T19:03:23.942882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-16T19:03:24.314901] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-16T19:03:24.701762] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:03:24.742837] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-16T19:03:25.542846] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-16T19:03:26.342814] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-16T19:03:26.511496] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:03:26.718480] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:03:27.142821] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-16T19:03:27.942848] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-16T19:03:28.410236] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T19:03:28.600592] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-16T19:03:28.742877] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-16T19:03:29.245729] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:03:29.542910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-16T19:03:29.914676] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T19:03:29.974908] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T19:03:30.342871] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-16T19:03:31.142846] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-16T19:03:31.942882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-16T19:03:32.452163] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-16T19:03:32.459430] [INFO ] [REMOTE ] FTWO: Full fetch complete (3332 records). [2025-10-16T19:03:32.459261] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:03:32.459632] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-16T19:03:32.744343] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-16T19:03:32.848563] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-16T19:03:32.848919] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-16T19:03:32.849330] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-16T19:03:32.849413] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-16T19:03:32.850346] [DEBUG] [LOCAL ] FTWO: Trimmed 3332 records to 1940 (keeping 200 days of data) [2025-10-16T19:03:32.862792] [DEBUG] [LOCAL ] FTWO: Primary data saved (1940 records). [2025-10-16T19:03:32.862917] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-16T19:03:32.863017] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 21.8s. Estimated remaining: 3h 28m 34s. Rate: 7.1 symbols/min [2025-10-16T19:03:33.060553] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:33.117759] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:03:33.162382] [DEBUG] [LOCAL ] FUL: Loaded 32393 existing records from primary storage. [2025-10-16T19:03:33.162688] [INFO ] [MAIN ] FUL: Loaded 32393 existing records. [2025-10-16T19:03:33.370103] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:33.370374] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-16T19:03:33.370425] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-16T19:03:33.371058] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-16T19:03:33.371138] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-16T19:03:33.547994] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-16T19:03:33.894194] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:34.252504] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T19:03:34.342778] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-16T19:03:34.979417] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T19:03:35.142866] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-16T19:03:35.315424] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:03:35.942913] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-16T19:03:36.529745] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:03:36.742847] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-16T19:03:37.542775] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-16T19:03:37.782279] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-16T19:03:38.064800] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T19:03:38.342809] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-16T19:03:38.979167] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:03:39.142826] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-16T19:03:39.260051] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:03:39.942838] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-16T19:03:40.742874] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-16T19:03:41.033452] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:03:41.464552] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:03:41.470280] [INFO ] [REMOTE ] FTS: Full fetch complete (60557 records). [2025-10-16T19:03:41.470431] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-16T19:03:41.550710] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-16T19:03:41.881302] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-16T19:03:41.881398] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-16T19:03:41.882456] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-16T19:03:41.883244] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-16T19:03:41.884829] [DEBUG] [LOCAL ] FTS: Trimmed 60557 records to 42838 (keeping 200 days of data) [2025-10-16T19:03:42.151263] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:03:42.213584] [DEBUG] [LOCAL ] FTS: Primary data saved (42838 records). [2025-10-16T19:03:42.213804] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-16T19:03:42.214750] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTS took 31.2s. Estimated remaining: 3h 28m 27s. Rate: 7.1 symbols/min [2025-10-16T19:03:42.358761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-16T19:03:42.394745] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:42.457923] [DEBUG] [LOCAL ] FUN: Loaded 51916 existing records from primary storage. [2025-10-16T19:03:42.458379] [INFO ] [MAIN ] FUN: Loaded 51916 existing records. [2025-10-16T19:03:42.650035] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:42.650378] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-16T19:03:42.650432] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-16T19:03:42.651376] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-16T19:03:42.651440] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-16T19:03:43.033524] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:43.142845] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-16T19:03:43.688363] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-16T19:03:43.732257] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:03:43.942833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-16T19:03:44.436718] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T19:03:44.742884] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-16T19:03:45.494474] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:03:45.542848] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-16T19:03:46.251333] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:03:46.258234] [INFO ] [REMOTE ] FTV: Full fetch complete (76635 records). [2025-10-16T19:03:46.258357] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-16T19:03:46.348750] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-16T19:03:46.687023] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-16T19:03:46.687182] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-16T19:03:46.688291] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-16T19:03:46.688425] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-16T19:03:46.689974] [DEBUG] [LOCAL ] FTV: Trimmed 76635 records to 53454 (keeping 200 days of data) [2025-10-16T19:03:46.810482] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T19:03:47.045277] [DEBUG] [LOCAL ] FTV: Primary data saved (53454 records). [2025-10-16T19:03:47.045443] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-16T19:03:47.045527] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 36.0s. Estimated remaining: 3h 28m 13s. Rate: 7.1 symbols/min [2025-10-16T19:03:47.145458] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-16T19:03:47.215065] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:03:47.235264] [DEBUG] [LOCAL ] FVR: Loaded 21190 existing records from primary storage. [2025-10-16T19:03:47.235501] [INFO ] [MAIN ] FVR: Loaded 21190 existing records. [2025-10-16T19:03:47.417808] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:03:47.418108] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-16T19:03:47.418163] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-16T19:03:47.418552] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-16T19:03:47.418634] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-16T19:03:47.793148] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:03:47.942834] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-16T19:03:48.628304] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-16T19:03:48.707016] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:03:48.742776] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-16T19:03:49.150826] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:03:49.542858] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-16T19:03:50.219308] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:03:50.342780] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-16T19:03:50.586799] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:03:51.142910] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-16T19:03:51.707636] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:03:51.942848] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-16T19:03:52.742877] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-16T19:03:52.959268] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:03:53.542834] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-16T19:03:53.763388] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-16T19:03:54.000614] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T19:03:54.342875] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-16T19:03:54.516808] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-16T19:03:55.142837] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-16T19:03:55.942831] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-16T19:03:56.176481] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-16T19:03:56.742860] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-16T19:03:57.078777] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-16T19:03:57.372155] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-16T19:03:57.542807] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-16T19:03:57.774798] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:03:58.342855] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-16T19:03:59.142863] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-16T19:03:59.642505] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:03:59.649403] [INFO ] [REMOTE ] FUBO: Full fetch complete (77869 records). [2025-10-16T19:03:59.649530] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-16T19:03:59.945243] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-16T19:04:00.056172] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-16T19:04:00.056521] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-16T19:04:00.058068] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-16T19:04:00.058152] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-16T19:04:00.087171] [DEBUG] [LOCAL ] FUBO: Trimmed 77869 records to 54108 (keeping 200 days of data) [2025-10-16T19:04:00.089177] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:04:00.199856] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:04:00.426506] [DEBUG] [LOCAL ] FUBO: Primary data saved (54108 records). [2025-10-16T19:04:00.426667] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-16T19:04:00.426767] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 49.4s. Estimated remaining: 3h 28m 13s. Rate: 7.1 symbols/min [2025-10-16T19:04:00.592402] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:00.630188] [DEBUG] [LOCAL ] FVRR: Loaded 40631 existing records from primary storage. [2025-10-16T19:04:00.630477] [INFO ] [MAIN ] FVRR: Loaded 40631 existing records. [2025-10-16T19:04:00.747912] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-16T19:04:00.813554] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:00.813839] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-16T19:04:00.813890] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-16T19:04:00.814413] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-16T19:04:00.814487] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-16T19:04:01.162772] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:01.319135] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:04:01.542809] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-16T19:04:01.669182] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T19:04:02.342840] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-16T19:04:03.067586] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:04:03.142820] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-16T19:04:03.942835] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-16T19:04:04.099543] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:04:04.637033] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:04:04.742780] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-16T19:04:05.262304] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:04:05.542788] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-16T19:04:05.715794] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:04:05.720084] [INFO ] [REMOTE ] FUL: Full fetch complete (47835 records). [2025-10-16T19:04:05.720243] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-16T19:04:06.112399] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-16T19:04:06.112494] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-16T19:04:06.113252] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-16T19:04:06.113313] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-16T19:04:06.114343] [DEBUG] [LOCAL ] FUL: Trimmed 47835 records to 32565 (keeping 200 days of data) [2025-10-16T19:04:06.310766] [DEBUG] [LOCAL ] FUL: Primary data saved (32565 records). [2025-10-16T19:04:06.310934] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-16T19:04:06.311029] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FUL took 33.4s. Estimated remaining: 3h 28m 0s. Rate: 7.1 symbols/min [2025-10-16T19:04:06.348045] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-16T19:04:06.487691] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:06.491388] [DEBUG] [LOCAL ] FXED: Loaded 1246 existing records from primary storage. [2025-10-16T19:04:06.491545] [INFO ] [MAIN ] FXED: Loaded 1246 existing records. [2025-10-16T19:04:06.669127] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:06.669349] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-16T19:04:06.669396] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-16T19:04:06.669510] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-16T19:04:06.669547] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-16T19:04:07.054015] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:07.142833] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-16T19:04:07.356921] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:04:07.398546] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-16T19:04:07.496825] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T19:04:07.942829] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-16T19:04:08.369469] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-16T19:04:08.742808] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-16T19:04:09.071491] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:04:09.542809] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-16T19:04:09.955628] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T19:04:10.342808] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-16T19:04:11.142810] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-16T19:04:11.837540] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:04:11.942769] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-16T19:04:12.117980] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:04:12.742832] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-16T19:04:13.170902] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-16T19:04:13.542840] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-16T19:04:13.591167] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:04:14.342803] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-16T19:04:14.587212] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-16T19:04:14.898184] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:04:15.142803] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-16T19:04:15.579015] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:04:15.942792] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-16T19:04:16.742806] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-16T19:04:17.542852] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-16T19:04:17.774507] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T19:04:18.006230] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:04:18.035152] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:04:18.342814] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-16T19:04:19.142818] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-16T19:04:19.555691] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-16T19:04:19.684856] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T19:04:19.942856] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-16T19:04:20.243965] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-16T19:04:20.742877] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-16T19:04:21.542862] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-16T19:04:21.988533] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-16T19:04:21.989300] [INFO ] [REMOTE ] FXED: Full fetch complete (1788 records). [2025-10-16T19:04:21.989368] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-16T19:04:22.336274] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-16T19:04:22.336349] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-16T19:04:22.336432] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-16T19:04:22.336472] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-16T19:04:22.336848] [DEBUG] [LOCAL ] FXED: Trimmed 1788 records to 1251 (keeping 200 days of data) [2025-10-16T19:04:22.342980] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-16T19:04:22.345801] [DEBUG] [LOCAL ] FXED: Primary data saved (1251 records). [2025-10-16T19:04:22.345864] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-16T19:04:22.345927] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FXED took 16.0s. Estimated remaining: 3h 28m 4s. Rate: 7.1 symbols/min [2025-10-16T19:04:22.519522] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:22.566132] [DEBUG] [LOCAL ] G: Loaded 50051 existing records from primary storage. [2025-10-16T19:04:22.566473] [INFO ] [MAIN ] G: Loaded 50051 existing records. [2025-10-16T19:04:22.742103] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-16T19:04:22.779126] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:22.779611] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-16T19:04:22.779725] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-16T19:04:22.780222] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-16T19:04:22.780281] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-16T19:04:23.144195] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:23.142832] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-16T19:04:23.184722] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:04:23.942826] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-16T19:04:24.677334] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:04:24.684505] [INFO ] [REMOTE ] FUN: Full fetch complete (73380 records). [2025-10-16T19:04:24.684632] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-16T19:04:24.748399] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-16T19:04:24.935820] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T19:04:25.106457] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-16T19:04:25.106537] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-16T19:04:25.107472] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-16T19:04:25.107534] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-16T19:04:25.108984] [DEBUG] [LOCAL ] FUN: Trimmed 73380 records to 52299 (keeping 200 days of data) [2025-10-16T19:04:25.420002] [DEBUG] [LOCAL ] FUN: Primary data saved (52299 records). [2025-10-16T19:04:25.420170] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-16T19:04:25.420705] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUN took 43.2s. Estimated remaining: 3h 27m 47s. Rate: 7.1 symbols/min [2025-10-16T19:04:25.547964] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-16T19:04:25.618917] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:25.653538] [DEBUG] [LOCAL ] GAB: Loaded 27709 existing records from primary storage. [2025-10-16T19:04:25.653849] [INFO ] [MAIN ] GAB: Loaded 27709 existing records. [2025-10-16T19:04:25.938242] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:25.938525] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-16T19:04:25.938629] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-16T19:04:25.938920] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-16T19:04:25.938980] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-16T19:04:26.347570] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-16T19:04:26.466529] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:26.523316] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T19:04:27.142814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-16T19:04:27.230270] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:04:27.484909] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:04:27.487536] [INFO ] [REMOTE ] FVR: Full fetch complete (29541 records). [2025-10-16T19:04:27.487609] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-16T19:04:27.850959] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-16T19:04:27.851047] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-16T19:04:27.851677] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-16T19:04:27.851738] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-16T19:04:27.852438] [DEBUG] [LOCAL ] FVR: Trimmed 29541 records to 21309 (keeping 200 days of data) [2025-10-16T19:04:27.944698] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-16T19:04:27.987916] [DEBUG] [LOCAL ] FVR: Primary data saved (21309 records). [2025-10-16T19:04:27.988022] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-16T19:04:27.988104] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FVR took 40.9s. Estimated remaining: 3h 27m 29s. Rate: 7.1 symbols/min [2025-10-16T19:04:28.168039] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:28.175220] [DEBUG] [LOCAL ] GAM: Loaded 3926 existing records from primary storage. [2025-10-16T19:04:28.175401] [INFO ] [MAIN ] GAM: Loaded 3926 existing records. [2025-10-16T19:04:28.372121] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:28.372430] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-16T19:04:28.372513] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-16T19:04:28.372702] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-16T19:04:28.372758] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-16T19:04:28.726980] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:28.747798] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-16T19:04:28.753041] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:04:29.219495] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:04:29.542833] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-16T19:04:29.599144] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:04:30.342814] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-16T19:04:31.143428] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-16T19:04:31.143342] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:04:31.302010] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:04:31.812594] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:04:31.942835] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-16T19:04:32.672571] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:04:32.742826] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-16T19:04:33.542871] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-16T19:04:34.084457] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:04:34.284585] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T19:04:34.342810] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-16T19:04:35.142836] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-16T19:04:35.942802] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-16T19:04:36.068220] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:04:36.075052] [INFO ] [REMOTE ] FVRR: Full fetch complete (59292 records). [2025-10-16T19:04:36.075199] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-16T19:04:36.471758] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-16T19:04:36.471925] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-16T19:04:36.472981] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-16T19:04:36.473130] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-16T19:04:36.474805] [DEBUG] [LOCAL ] FVRR: Trimmed 59292 records to 40901 (keeping 200 days of data) [2025-10-16T19:04:36.608719] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:04:36.742828] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-16T19:04:36.753419] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T19:04:36.764715] [DEBUG] [LOCAL ] FVRR: Primary data saved (40901 records). [2025-10-16T19:04:36.764820] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-16T19:04:36.764892] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 36.3s. Estimated remaining: 3h 27m 21s. Rate: 7.1 symbols/min [2025-10-16T19:04:36.941333] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:36.994279] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-16T19:04:36.994628] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-16T19:04:37.184587] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:37.184900] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-16T19:04:37.184954] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-16T19:04:37.185152] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-16T19:04:37.185206] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-16T19:04:37.535348] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:37.542783] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-16T19:04:37.811400] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T19:04:38.342817] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-16T19:04:38.865984] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-16T19:04:39.142813] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-16T19:04:39.942801] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-16T19:04:40.171601] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:04:40.221348] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T19:04:40.331874] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-16T19:04:40.742798] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-16T19:04:41.542830] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-16T19:04:42.191915] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-16T19:04:42.342781] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-16T19:04:42.395957] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T19:04:42.896288] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-16T19:04:43.142791] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-16T19:04:43.942820] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-16T19:04:44.742915] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-16T19:04:44.845839] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T19:04:45.062570] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-16T19:04:45.122195] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:04:45.542871] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-16T19:04:46.342834] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-16T19:04:46.908242] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:04:47.142808] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-16T19:04:47.240929] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:04:47.469308] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-16T19:04:47.942823] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-16T19:04:48.742876] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-16T19:04:49.542855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-16T19:04:50.265931] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-16T19:04:50.342790] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-16T19:04:51.003380] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-16T19:04:51.142801] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-16T19:04:51.629789] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-16T19:04:51.889526] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:04:51.942822] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-16T19:04:52.423311] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:04:52.742824] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-16T19:04:53.416278] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:04:53.417396] [INFO ] [REMOTE ] GAM: Full fetch complete (6511 records). [2025-10-16T19:04:53.417466] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-16T19:04:53.544785] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-16T19:04:53.784984] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-16T19:04:53.785087] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-16T19:04:53.785266] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-16T19:04:53.785441] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-16T19:04:53.786225] [DEBUG] [LOCAL ] GAM: Trimmed 6511 records to 3940 (keeping 200 days of data) [2025-10-16T19:04:53.835987] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T19:04:53.851931] [DEBUG] [LOCAL ] GAM: Primary data saved (3940 records). [2025-10-16T19:04:53.852056] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-16T19:04:53.852138] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. GAM took 25.9s. Estimated remaining: 3h 27m 27s. Rate: 7.1 symbols/min [2025-10-16T19:04:54.017336] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:04:54.036348] [DEBUG] [LOCAL ] GATX: Loaded 18079 existing records from primary storage. [2025-10-16T19:04:54.036620] [INFO ] [MAIN ] GATX: Loaded 18079 existing records. [2025-10-16T19:04:54.213974] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:04:54.214344] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-16T19:04:54.214404] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-16T19:04:54.214617] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-16T19:04:54.214741] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-16T19:04:54.351880] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-16T19:04:54.578932] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:04:55.142841] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-16T19:04:55.586638] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T19:04:55.614710] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-16T19:04:55.942805] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-16T19:04:56.174703] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:04:56.682088] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-16T19:04:56.742816] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-16T19:04:57.542860] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-16T19:04:58.342805] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-16T19:04:58.717001] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:04:58.933612] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:04:59.142814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-16T19:04:59.302339] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:04:59.942855] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-16T19:05:00.742795] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-16T19:05:00.970286] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:05:01.018511] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T19:05:01.025250] [INFO ] [REMOTE ] G: Full fetch complete (72153 records). [2025-10-16T19:05:01.025369] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-16T19:05:01.431482] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-16T19:05:01.431573] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-16T19:05:01.432540] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-16T19:05:01.432605] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-16T19:05:01.434126] [DEBUG] [LOCAL ] G: Trimmed 72153 records to 50433 (keeping 200 days of data) [2025-10-16T19:05:01.544381] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-16T19:05:01.741333] [DEBUG] [LOCAL ] G: Primary data saved (50433 records). [2025-10-16T19:05:01.741714] [INFO ] [MAIN ] G: Full history saved. [2025-10-16T19:05:01.742260] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. G took 39.4s. Estimated remaining: 3h 27m 18s. Rate: 7.1 symbols/min [2025-10-16T19:05:01.921743] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:01.936960] [DEBUG] [LOCAL ] GBAB: Loaded 12868 existing records from primary storage. [2025-10-16T19:05:01.937257] [INFO ] [MAIN ] GBAB: Loaded 12868 existing records. [2025-10-16T19:05:02.116265] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:02.116508] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-16T19:05:02.116557] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-16T19:05:02.116809] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-16T19:05:02.116867] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-16T19:05:02.343255] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-16T19:05:02.484969] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:02.706205] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-16T19:05:03.061272] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:05:03.065606] [INFO ] [REMOTE ] GAB: Full fetch complete (39356 records). [2025-10-16T19:05:03.065878] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-16T19:05:03.145961] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-16T19:05:03.160871] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:05:03.507882] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-16T19:05:03.507963] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-16T19:05:03.508631] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-16T19:05:03.508713] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-16T19:05:03.509718] [DEBUG] [LOCAL ] GAB: Trimmed 39356 records to 27933 (keeping 200 days of data) [2025-10-16T19:05:03.677581] [DEBUG] [LOCAL ] GAB: Primary data saved (27933 records). [2025-10-16T19:05:03.677765] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-16T19:05:03.677868] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAB took 38.3s. Estimated remaining: 3h 26m 59s. Rate: 7.1 symbols/min [2025-10-16T19:05:03.849482] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:03.886300] [DEBUG] [LOCAL ] GBCI: Loaded 40856 existing records from primary storage. [2025-10-16T19:05:03.886611] [INFO ] [MAIN ] GBCI: Loaded 40856 existing records. [2025-10-16T19:05:03.951044] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-16T19:05:04.071465] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:04.071717] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-16T19:05:04.071782] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-16T19:05:04.071998] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-16T19:05:04.072069] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-16T19:05:04.460775] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:04.742885] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-16T19:05:04.844357] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:05:05.261635] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:05:05.377866] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:05:05.542827] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-16T19:05:06.342820] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-16T19:05:07.142818] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-16T19:05:07.889047] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:05:07.942794] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-16T19:05:08.742845] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-16T19:05:08.868360] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:05:08.991598] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-16T19:05:09.226017] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T19:05:09.542799] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-16T19:05:10.342793] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-16T19:05:10.395595] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (4.85 seconds). [2025-10-16T19:05:10.449503] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:05:11.142808] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-16T19:05:11.942791] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-16T19:05:12.175940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-16T19:05:12.201355] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:05:12.742824] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-16T19:05:13.290235] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:05:13.542795] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-16T19:05:13.735848] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:05:14.342810] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-16T19:05:15.142861] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-16T19:05:15.237513] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:05:15.403837] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T19:05:15.411809] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-16T19:05:15.411953] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-16T19:05:15.869536] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-16T19:05:15.869695] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-16T19:05:15.870978] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-16T19:05:15.871049] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-16T19:05:15.872691] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 54043 (keeping 200 days of data) [2025-10-16T19:05:15.969815] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-16T19:05:16.115681] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-16T19:05:16.251396] [DEBUG] [LOCAL ] GAP: Primary data saved (54043 records). [2025-10-16T19:05:16.251562] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-16T19:05:16.252370] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GAP took 39.5s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-16T19:05:16.452897] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:16.453055] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-16T19:05:16.453093] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-16T19:05:16.453219] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-16T19:05:16.453279] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-16T19:05:16.453344] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-16T19:05:16.453411] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-16T19:05:16.749362] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-16T19:05:16.871486] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:17.239124] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T19:05:17.542795] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-16T19:05:17.596748] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T19:05:17.967381] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T19:05:18.342808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-16T19:05:19.020714] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T19:05:19.142787] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-16T19:05:19.942795] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-16T19:05:20.641131] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:05:20.748044] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-16T19:05:20.751747] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:05:21.542791] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-16T19:05:21.678806] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T19:05:22.342819] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-16T19:05:22.603534] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-16T19:05:23.051814] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:05:23.142792] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-16T19:05:23.942814] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-16T19:05:24.598399] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:05:24.742802] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-16T19:05:24.996227] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:05:24.998394] [INFO ] [REMOTE ] GATX: Full fetch complete (24902 records). [2025-10-16T19:05:24.998465] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-16T19:05:25.353879] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-16T19:05:25.353954] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-16T19:05:25.354449] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-16T19:05:25.354488] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-16T19:05:25.355136] [DEBUG] [LOCAL ] GATX: Trimmed 24902 records to 18184 (keeping 200 days of data) [2025-10-16T19:05:25.466826] [DEBUG] [LOCAL ] GATX: Primary data saved (18184 records). [2025-10-16T19:05:25.466935] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-16T19:05:25.467014] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GATX took 31.6s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-16T19:05:25.548050] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-16T19:05:25.633526] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:25.670131] [DEBUG] [LOCAL ] GBTG: Loaded 40255 existing records from primary storage. [2025-10-16T19:05:25.670452] [INFO ] [MAIN ] GBTG: Loaded 40255 existing records. [2025-10-16T19:05:25.847472] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:25.847704] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-16T19:05:25.847772] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-16T19:05:25.847976] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-16T19:05:25.848064] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-16T19:05:26.203678] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:26.198619] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T19:05:26.227925] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:05:26.342769] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-16T19:05:27.142822] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-16T19:05:27.781232] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:05:27.942769] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-16T19:05:28.547796] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:05:28.742821] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-16T19:05:29.408093] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:05:29.482144] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T19:05:29.542808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-16T19:05:30.330081] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:05:30.342777] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-16T19:05:30.981924] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:05:31.142902] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-16T19:05:31.741802] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-16T19:05:31.743614] [INFO ] [REMOTE ] GBAB: Full fetch complete (18919 records). [2025-10-16T19:05:31.743737] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-16T19:05:31.947985] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-16T19:05:32.122678] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-16T19:05:32.122787] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-16T19:05:32.123213] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-16T19:05:32.123273] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-16T19:05:32.123901] [DEBUG] [LOCAL ] GBAB: Trimmed 18919 records to 12918 (keeping 200 days of data) [2025-10-16T19:05:32.203156] [DEBUG] [LOCAL ] GBAB: Primary data saved (12918 records). [2025-10-16T19:05:32.203304] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-16T19:05:32.203384] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBAB took 30.5s. Estimated remaining: 3h 26m 39s. Rate: 7.1 symbols/min [2025-10-16T19:05:32.371012] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:32.404225] [DEBUG] [LOCAL ] GBX: Loaded 28929 existing records from primary storage. [2025-10-16T19:05:32.404529] [INFO ] [MAIN ] GBX: Loaded 28929 existing records. [2025-10-16T19:05:32.587081] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:32.587371] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-16T19:05:32.587430] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-16T19:05:32.587602] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-16T19:05:32.587687] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-16T19:05:32.763535] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-16T19:05:32.953094] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:33.385749] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T19:05:33.542881] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-16T19:05:34.302902] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:05:34.342905] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-16T19:05:34.639789] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:05:35.142860] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-16T19:05:35.761874] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:05:35.768096] [INFO ] [REMOTE ] GBCI: Full fetch complete (59077 records). [2025-10-16T19:05:35.768227] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-16T19:05:35.952052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-16T19:05:36.143847] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-16T19:05:36.143926] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-16T19:05:36.144793] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-16T19:05:36.144882] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-16T19:05:36.146069] [DEBUG] [LOCAL ] GBCI: Trimmed 59077 records to 41242 (keeping 200 days of data) [2025-10-16T19:05:36.403171] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:05:36.412238] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:05:36.428027] [DEBUG] [LOCAL ] GBCI: Primary data saved (41242 records). [2025-10-16T19:05:36.428135] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-16T19:05:36.428660] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBCI took 32.8s. Estimated remaining: 3h 26m 24s. Rate: 7.1 symbols/min [2025-10-16T19:05:36.592544] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:36.635031] [DEBUG] [LOCAL ] GCI: Loaded 43878 existing records from primary storage. [2025-10-16T19:05:36.635358] [INFO ] [MAIN ] GCI: Loaded 43878 existing records. [2025-10-16T19:05:36.747931] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-16T19:05:36.811799] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:36.811997] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-16T19:05:36.812044] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-16T19:05:36.812244] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-16T19:05:36.812302] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-16T19:05:37.162797] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:37.542799] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-16T19:05:38.252708] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:05:38.342795] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-16T19:05:38.860003] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:05:39.142834] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-16T19:05:39.562372] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T19:05:39.942797] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-16T19:05:40.367371] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:05:40.742905] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-16T19:05:41.126377] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-16T19:05:41.158217] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:05:41.542875] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-16T19:05:42.342873] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-16T19:05:42.475383] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T19:05:42.600066] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T19:05:43.142875] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-16T19:05:43.942915] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-16T19:05:44.536037] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:05:44.742831] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-16T19:05:45.339619] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-16T19:05:45.542774] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-16T19:05:45.626429] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:05:46.342817] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-16T19:05:47.091213] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:05:47.142842] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-16T19:05:47.366093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:05:47.942835] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-16T19:05:48.509090] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:05:48.742824] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-16T19:05:49.420081] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:05:49.542785] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-16T19:05:50.037481] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:05:50.342833] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-16T19:05:50.612775] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:05:51.142865] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-16T19:05:51.332530] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:05:51.408102] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-16T19:05:51.942802] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-16T19:05:52.256300] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T19:05:52.742894] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-16T19:05:53.542823] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-16T19:05:54.115349] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:05:54.342818] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-16T19:05:55.035537] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:05:55.142777] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-16T19:05:55.447437] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:05:55.942865] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-16T19:05:56.409944] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-16T19:05:56.415134] [INFO ] [REMOTE ] GBTG: Full fetch complete (56719 records). [2025-10-16T19:05:56.415237] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-16T19:05:56.747929] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-16T19:05:56.802056] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-16T19:05:56.802193] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-16T19:05:56.803216] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-16T19:05:56.803286] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-16T19:05:56.804626] [DEBUG] [LOCAL ] GBTG: Trimmed 56719 records to 40545 (keeping 200 days of data) [2025-10-16T19:05:57.040624] [DEBUG] [LOCAL ] GBTG: Primary data saved (40545 records). [2025-10-16T19:05:57.040780] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-16T19:05:57.040877] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBTG took 31.6s. Estimated remaining: 3h 26m 35s. Rate: 7.1 symbols/min [2025-10-16T19:05:57.219018] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:57.247102] [DEBUG] [LOCAL ] GCO: Loaded 23651 existing records from primary storage. [2025-10-16T19:05:57.247459] [INFO ] [MAIN ] GCO: Loaded 23651 existing records. [2025-10-16T19:05:57.431057] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:05:57.431260] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-16T19:05:57.431308] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-16T19:05:57.431475] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-16T19:05:57.431515] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-16T19:05:57.548054] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-16T19:05:57.797853] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:05:57.999771] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:05:58.106899] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:05:58.342814] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-16T19:05:59.142797] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-16T19:05:59.232873] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:05:59.236715] [INFO ] [REMOTE ] GBX: Full fetch complete (42871 records). [2025-10-16T19:05:59.236811] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-16T19:05:59.611707] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-16T19:05:59.611794] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-16T19:05:59.612558] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-16T19:05:59.612620] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-16T19:05:59.613569] [DEBUG] [LOCAL ] GBX: Trimmed 42871 records to 29120 (keeping 200 days of data) [2025-10-16T19:05:59.785403] [DEBUG] [LOCAL ] GBX: Primary data saved (29120 records). [2025-10-16T19:05:59.785536] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-16T19:05:59.785614] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 27.6s. Estimated remaining: 3h 26m 18s. Rate: 7.1 symbols/min [2025-10-16T19:05:59.960000] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:05:59.956526] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-16T19:05:59.980462] [DEBUG] [LOCAL ] GCTS: Loaded 20465 existing records from primary storage. [2025-10-16T19:05:59.980736] [INFO ] [MAIN ] GCTS: Loaded 20465 existing records. [2025-10-16T19:06:00.157722] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:00.157933] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-16T19:06:00.157981] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-16T19:06:00.158220] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-16T19:06:00.158278] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-16T19:06:00.524987] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:00.742795] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-16T19:06:01.072182] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (5.13 seconds). [2025-10-16T19:06:01.542833] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-16T19:06:01.937971] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:06:02.342857] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-16T19:06:02.441491] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (3.30 seconds). [2025-10-16T19:06:02.459509] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-16T19:06:02.696347] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T19:06:03.142890] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-16T19:06:03.361046] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:06:03.942856] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-16T19:06:04.742796] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-16T19:06:04.880581] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:06:05.542824] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-16T19:06:05.655441] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:06:05.707748] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:06:06.342808] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-16T19:06:06.556409] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:06:06.776567] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T19:06:06.777390] [INFO ] [REMOTE ] GBLI: Full fetch complete (1282 records). [2025-10-16T19:06:06.777458] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-16T19:06:06.959127] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-16T19:06:06.959301] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:06:06.959345] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:06:06.959394] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-16T19:06:06.959448] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-16T19:06:06.959505] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-16T19:06:06.959572] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-16T19:06:06.959627] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GBLI took 50.7s. Estimated remaining: 3h 26m 7s. Rate: 7.1 symbols/min [2025-10-16T19:06:07.137083] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:07.144230] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-16T19:06:07.149609] [DEBUG] [LOCAL ] GCV: Loaded 7804 existing records from primary storage. [2025-10-16T19:06:07.149857] [INFO ] [MAIN ] GCV: Loaded 7804 existing records. [2025-10-16T19:06:07.345079] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:07.345359] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-16T19:06:07.345411] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-16T19:06:07.345563] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-16T19:06:07.345601] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-16T19:06:07.703410] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:07.942882] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-16T19:06:08.510343] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:06:08.742811] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-16T19:06:09.413488] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:06:09.542770] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-16T19:06:10.342887] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-16T19:06:10.972080] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:06:11.028941] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-16T19:06:11.142833] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-16T19:06:11.942787] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-16T19:06:12.016692] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:06:12.438006] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-16T19:06:12.742785] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-16T19:06:12.798188] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:06:13.364611] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T19:06:13.542820] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-16T19:06:14.208159] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-16T19:06:14.342827] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-16T19:06:15.142838] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-16T19:06:15.531923] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:06:15.942807] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-16T19:06:16.436200] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T19:06:16.753833] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-16T19:06:16.756705] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:06:17.542823] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-16T19:06:17.794741] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:06:18.342868] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-16T19:06:18.901102] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:06:18.906736] [INFO ] [REMOTE ] GCI: Full fetch complete (63438 records). [2025-10-16T19:06:18.906886] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-16T19:06:19.147920] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-16T19:06:19.161233] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-16T19:06:19.319105] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-16T19:06:19.319194] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-16T19:06:19.320125] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-16T19:06:19.320190] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-16T19:06:19.321674] [DEBUG] [LOCAL ] GCI: Trimmed 63438 records to 44182 (keeping 200 days of data) [2025-10-16T19:06:19.569502] [DEBUG] [LOCAL ] GCI: Primary data saved (44182 records). [2025-10-16T19:06:19.569917] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-16T19:06:19.570638] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCI took 43.1s. Estimated remaining: 3h 26m 6s. Rate: 7.1 symbols/min [2025-10-16T19:06:19.738530] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:19.784173] [DEBUG] [LOCAL ] GD: Loaded 46735 existing records from primary storage. [2025-10-16T19:06:19.784475] [INFO ] [MAIN ] GD: Loaded 46735 existing records. [2025-10-16T19:06:19.956585] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-16T19:06:19.961105] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:19.961317] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-16T19:06:19.961537] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-16T19:06:19.962321] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-16T19:06:19.962374] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-16T19:06:20.319457] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:20.354733] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:06:20.742802] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-16T19:06:21.382412] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T19:06:21.542840] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-16T19:06:22.342810] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-16T19:06:23.142785] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-16T19:06:23.181946] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:06:23.476936] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-16T19:06:23.910815] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:06:23.943685] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-16T19:06:23.950868] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-16T19:06:24.559557] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T19:06:24.742800] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-16T19:06:25.542885] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-16T19:06:25.881287] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:06:25.884893] [INFO ] [REMOTE ] GCO: Full fetch complete (35064 records). [2025-10-16T19:06:25.885046] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-16T19:06:26.034444] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:06:26.305823] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-16T19:06:26.305914] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-16T19:06:26.306586] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-16T19:06:26.306633] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-16T19:06:26.307635] [DEBUG] [LOCAL ] GCO: Trimmed 35064 records to 23761 (keeping 200 days of data) [2025-10-16T19:06:26.359860] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-16T19:06:26.493011] [DEBUG] [LOCAL ] GCO: Primary data saved (23761 records). [2025-10-16T19:06:26.493205] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-16T19:06:26.493313] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCO took 29.5s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-16T19:06:26.752182] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:26.819362] [DEBUG] [LOCAL ] GDDY: Loaded 49776 existing records from primary storage. [2025-10-16T19:06:26.819925] [INFO ] [MAIN ] GDDY: Loaded 49776 existing records. [2025-10-16T19:06:27.101444] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:27.101830] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-16T19:06:27.101882] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-16T19:06:27.102078] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-16T19:06:27.102137] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-16T19:06:27.147926] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-16T19:06:27.218133] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T19:06:27.497846] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:27.942788] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-16T19:06:28.742787] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-16T19:06:28.753733] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:06:29.008956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:06:29.542795] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-16T19:06:30.135575] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T19:06:30.205867] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:06:30.207849] [INFO ] [REMOTE ] GCV: Full fetch complete (9852 records). [2025-10-16T19:06:30.207930] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-16T19:06:30.354956] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-16T19:06:30.578044] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-16T19:06:30.578117] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-16T19:06:30.578357] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-16T19:06:30.578396] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-16T19:06:30.578874] [DEBUG] [LOCAL ] GCV: Trimmed 9852 records to 7864 (keeping 200 days of data) [2025-10-16T19:06:30.633002] [DEBUG] [LOCAL ] GCV: Primary data saved (7864 records). [2025-10-16T19:06:30.633166] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-16T19:06:30.633255] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCV took 23.7s. Estimated remaining: 3h 25m 39s. Rate: 7.1 symbols/min [2025-10-16T19:06:30.797010] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:30.803215] [DEBUG] [LOCAL ] GDIV: Loaded 3598 existing records from primary storage. [2025-10-16T19:06:30.803404] [INFO ] [MAIN ] GDIV: Loaded 3598 existing records. [2025-10-16T19:06:30.976846] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:30.977107] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-16T19:06:30.977183] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-16T19:06:30.977341] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-16T19:06:30.977396] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-16T19:06:31.150097] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-16T19:06:31.337706] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:31.942779] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-16T19:06:32.021130] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:06:32.742791] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-16T19:06:33.011610] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:06:33.244830] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-16T19:06:33.542856] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-16T19:06:33.996242] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T19:06:34.342781] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-16T19:06:34.439902] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:06:35.142814] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-16T19:06:35.560542] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T19:06:35.942824] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-16T19:06:36.036022] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:06:36.742816] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-16T19:06:37.542846] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-16T19:06:37.862610] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:06:37.995028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:06:38.342789] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-16T19:06:38.598378] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:06:39.142874] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-16T19:06:39.942838] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-16T19:06:40.566421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T19:06:40.742864] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-16T19:06:40.844911] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:06:41.542793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-16T19:06:41.651092] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T19:06:42.170581] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:06:42.342814] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-16T19:06:42.691492] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-16T19:06:42.694373] [INFO ] [REMOTE ] GCTS: Full fetch complete (26992 records). [2025-10-16T19:06:42.694448] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-16T19:06:43.088147] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-16T19:06:43.088344] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-16T19:06:43.089539] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-16T19:06:43.089625] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-16T19:06:43.091077] [DEBUG] [LOCAL ] GCTS: Trimmed 26992 records to 20570 (keeping 200 days of data) [2025-10-16T19:06:43.150317] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-16T19:06:43.239355] [DEBUG] [LOCAL ] GCTS: Primary data saved (20570 records). [2025-10-16T19:06:43.239559] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-16T19:06:43.239715] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCTS took 43.5s. Estimated remaining: 3h 25m 38s. Rate: 7.1 symbols/min [2025-10-16T19:06:43.419668] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:06:43.425913] [DEBUG] [LOCAL ] GDL: Loaded 2523 existing records from primary storage. [2025-10-16T19:06:43.426237] [INFO ] [MAIN ] GDL: Loaded 2523 existing records. [2025-10-16T19:06:43.629944] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:06:43.630434] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-16T19:06:43.630531] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-16T19:06:43.630736] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-16T19:06:43.630797] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-16T19:06:43.990470] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-16T19:06:44.001034] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:06:44.038821] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-16T19:06:44.580332] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:06:44.742775] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-16T19:06:44.854199] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:06:45.085691] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-16T19:06:45.542826] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-16T19:06:46.001947] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:06:46.342843] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-16T19:06:46.793333] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:06:47.142826] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-16T19:06:47.732593] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:06:47.942806] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-16T19:06:48.528738] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:06:48.742817] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-16T19:06:49.308491] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:06:49.542824] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-16T19:06:49.980731] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:06:50.342821] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-16T19:06:50.770463] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-16T19:06:51.142824] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-16T19:06:51.701345] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-16T19:06:51.942819] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-16T19:06:52.409672] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:06:52.742812] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-16T19:06:53.542815] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-16T19:06:54.013993] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-16T19:06:54.342808] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-16T19:06:54.445043] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:06:54.679790] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-16T19:06:55.142884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-16T19:06:55.942832] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-16T19:06:56.301862] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T19:06:56.742794] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-16T19:06:57.151886] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T19:06:57.155881] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:06:57.542820] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-16T19:06:58.342836] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-16T19:06:58.747796] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:06:58.793830] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T19:06:59.142797] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-16T19:06:59.597235] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:06:59.942876] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-16T19:07:00.742825] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-16T19:07:01.542811] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-16T19:07:01.737546] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:07:01.741424] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:07:01.741591] [INFO ] [REMOTE ] GDIV: Full fetch complete (5423 records). [2025-10-16T19:07:01.741832] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-16T19:07:02.046278] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T19:07:02.126781] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-16T19:07:02.126861] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-16T19:07:02.127026] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-16T19:07:02.127066] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-16T19:07:02.127488] [DEBUG] [LOCAL ] GDIV: Trimmed 5423 records to 3621 (keeping 200 days of data) [2025-10-16T19:07:02.149330] [DEBUG] [LOCAL ] GDIV: Primary data saved (3621 records). [2025-10-16T19:07:02.149414] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-16T19:07:02.149525] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDIV took 31.5s. Estimated remaining: 3h 25m 46s. Rate: 7.1 symbols/min [2025-10-16T19:07:02.314933] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:02.325983] [DEBUG] [LOCAL ] GDO: Loaded 5849 existing records from primary storage. [2025-10-16T19:07:02.326272] [INFO ] [MAIN ] GDO: Loaded 5849 existing records. [2025-10-16T19:07:02.350146] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-16T19:07:02.513292] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:02.513541] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-16T19:07:02.513589] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-16T19:07:02.513759] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-16T19:07:02.513815] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-16T19:07:02.869271] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:03.142831] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-16T19:07:03.839400] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:07:03.942814] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-16T19:07:03.957976] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:07:04.742834] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-16T19:07:05.420980] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T19:07:05.426733] [INFO ] [REMOTE ] GD: Full fetch complete (69806 records). [2025-10-16T19:07:05.426875] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-16T19:07:05.548028] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-16T19:07:05.819582] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-16T19:07:05.819700] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-16T19:07:05.820630] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-16T19:07:05.820714] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-16T19:07:05.822103] [DEBUG] [LOCAL ] GD: Trimmed 69806 records to 47051 (keeping 200 days of data) [2025-10-16T19:07:05.986251] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:07:06.095240] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:07:06.177300] [DEBUG] [LOCAL ] GD: Primary data saved (47051 records). [2025-10-16T19:07:06.177495] [INFO ] [MAIN ] GD: Full history saved. [2025-10-16T19:07:06.178293] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GD took 46.6s. Estimated remaining: 3h 25m 31s. Rate: 7.1 symbols/min [2025-10-16T19:07:06.341241] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:06.342880] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-16T19:07:06.380471] [DEBUG] [LOCAL ] GDOT: Loaded 37755 existing records from primary storage. [2025-10-16T19:07:06.380813] [INFO ] [MAIN ] GDOT: Loaded 37755 existing records. [2025-10-16T19:07:06.550081] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:06.550263] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-16T19:07:06.550347] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-16T19:07:06.550541] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-16T19:07:06.550580] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-16T19:07:06.841088] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T19:07:06.903371] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:07.142769] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-16T19:07:07.942854] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-16T19:07:08.504119] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:07:08.505334] [INFO ] [REMOTE ] GDL: Full fetch complete (3495 records). [2025-10-16T19:07:08.505518] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-16T19:07:08.607812] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:07:08.750161] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-16T19:07:08.923253] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-16T19:07:08.923325] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-16T19:07:08.923466] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-16T19:07:08.923504] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-16T19:07:08.923868] [DEBUG] [LOCAL ] GDL: Trimmed 3495 records to 2541 (keeping 200 days of data) [2025-10-16T19:07:08.938520] [DEBUG] [LOCAL ] GDL: Primary data saved (2541 records). [2025-10-16T19:07:08.938608] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-16T19:07:08.938718] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDL took 25.7s. Estimated remaining: 3h 25m 13s. Rate: 7.1 symbols/min [2025-10-16T19:07:09.100624] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:09.119426] [DEBUG] [LOCAL ] GDV: Loaded 19531 existing records from primary storage. [2025-10-16T19:07:09.119664] [INFO ] [MAIN ] GDV: Loaded 19531 existing records. [2025-10-16T19:07:09.291409] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:09.291620] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-16T19:07:09.291711] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-16T19:07:09.291895] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-16T19:07:09.291935] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-16T19:07:09.420819] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-16T19:07:09.547920] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-16T19:07:09.650881] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:10.342814] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-16T19:07:11.142844] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-16T19:07:11.186884] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:07:11.678429] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-16T19:07:11.854799] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:07:11.942775] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-16T19:07:12.521495] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:07:12.742854] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-16T19:07:13.542812] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-16T19:07:14.033777] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T19:07:14.114564] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:07:14.342839] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-16T19:07:15.142934] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-16T19:07:15.712079] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:07:15.942824] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-16T19:07:16.149890] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:07:16.742941] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-16T19:07:17.485918] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:07:17.542824] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-16T19:07:18.192284] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:07:18.199090] [INFO ] [REMOTE ] GDDY: Full fetch complete (72162 records). [2025-10-16T19:07:18.199260] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-16T19:07:18.352102] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-16T19:07:18.607908] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-16T19:07:18.608122] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-16T19:07:18.609490] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-16T19:07:18.609597] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-16T19:07:18.634140] [DEBUG] [LOCAL ] GDDY: Trimmed 72162 records to 50151 (keeping 200 days of data) [2025-10-16T19:07:18.635233] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:07:18.943742] [DEBUG] [LOCAL ] GDDY: Primary data saved (50151 records). [2025-10-16T19:07:18.943895] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-16T19:07:18.943982] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDDY took 52.5s. Estimated remaining: 3h 25m 7s. Rate: 7.1 symbols/min [2025-10-16T19:07:19.116506] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:19.144351] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-16T19:07:19.168266] [DEBUG] [LOCAL ] GE: Loaded 53699 existing records from primary storage. [2025-10-16T19:07:19.168624] [INFO ] [MAIN ] GE: Loaded 53699 existing records. [2025-10-16T19:07:19.354931] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:19.355309] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-16T19:07:19.355447] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-16T19:07:19.355761] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-16T19:07:19.355826] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-16T19:07:19.579431] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:07:19.925177] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:19.942881] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-16T19:07:20.606030] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:07:20.742834] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-16T19:07:21.542889] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-16T19:07:22.065135] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:07:22.223122] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-16T19:07:22.342794] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-16T19:07:22.593088] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T19:07:23.142933] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-16T19:07:23.769397] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T19:07:23.942781] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-16T19:07:24.033086] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:07:24.742830] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-16T19:07:25.048663] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-16T19:07:25.542933] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-16T19:07:26.224392] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T19:07:26.342816] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-16T19:07:26.831600] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-16T19:07:27.142838] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-16T19:07:27.373143] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T19:07:27.586185] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T19:07:27.942838] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-16T19:07:28.742807] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-16T19:07:28.988530] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:07:29.542801] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-16T19:07:30.342839] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-16T19:07:30.644637] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:07:30.688773] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:07:30.775081] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-16T19:07:30.776216] [INFO ] [REMOTE ] GDO: Full fetch complete (8549 records). [2025-10-16T19:07:30.776290] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-16T19:07:31.132627] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-16T19:07:31.132731] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-16T19:07:31.132967] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-16T19:07:31.133027] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-16T19:07:31.133415] [DEBUG] [LOCAL ] GDO: Trimmed 8549 records to 5863 (keeping 200 days of data) [2025-10-16T19:07:31.148147] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-16T19:07:31.171496] [DEBUG] [LOCAL ] GDO: Primary data saved (5863 records). [2025-10-16T19:07:31.171704] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-16T19:07:31.171811] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDO took 29.0s. Estimated remaining: 3h 25m 5s. Rate: 7.1 symbols/min [2025-10-16T19:07:31.346733] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:31.368522] [DEBUG] [LOCAL ] GEF: Loaded 20790 existing records from primary storage. [2025-10-16T19:07:31.368844] [INFO ] [MAIN ] GEF: Loaded 20790 existing records. [2025-10-16T19:07:31.549898] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:31.550103] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-16T19:07:31.550152] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-16T19:07:31.550385] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-16T19:07:31.550442] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-16T19:07:31.928189] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:31.942784] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-16T19:07:32.581567] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-16T19:07:32.661942] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-16T19:07:32.742767] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-16T19:07:33.542793] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-16T19:07:33.757325] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:07:34.342789] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-16T19:07:34.481198] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T19:07:35.142803] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-16T19:07:35.167241] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:07:35.942792] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-16T19:07:36.434234] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:07:36.489690] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T19:07:36.742828] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-16T19:07:37.542822] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-16T19:07:38.342838] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-16T19:07:38.588357] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:07:38.591273] [INFO ] [REMOTE ] GDV: Full fetch complete (28465 records). [2025-10-16T19:07:38.591359] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-16T19:07:38.965804] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-16T19:07:38.966002] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-16T19:07:38.966856] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-16T19:07:38.966957] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-16T19:07:38.967994] [DEBUG] [LOCAL ] GDV: Trimmed 28465 records to 19620 (keeping 200 days of data) [2025-10-16T19:07:39.090684] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-16T19:07:39.132552] [DEBUG] [LOCAL ] GDV: Primary data saved (19620 records). [2025-10-16T19:07:39.132740] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-16T19:07:39.132839] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDV took 30.2s. Estimated remaining: 3h 24m 56s. Rate: 7.1 symbols/min [2025-10-16T19:07:39.147919] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-16T19:07:39.306101] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:39.341869] [DEBUG] [LOCAL ] GEL: Loaded 31836 existing records from primary storage. [2025-10-16T19:07:39.342328] [INFO ] [MAIN ] GEL: Loaded 31836 existing records. [2025-10-16T19:07:39.534389] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:39.535930] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T19:07:39.535087] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-16T19:07:39.537775] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-16T19:07:39.541854] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-16T19:07:39.541955] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-16T19:07:39.893149] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:39.942799] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-16T19:07:40.512840] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:07:40.517870] [INFO ] [REMOTE ] GDOT: Full fetch complete (53585 records). [2025-10-16T19:07:40.517987] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-16T19:07:40.750720] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-16T19:07:40.900007] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-16T19:07:40.900085] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-16T19:07:40.900886] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-16T19:07:40.900948] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-16T19:07:40.902072] [DEBUG] [LOCAL ] GDOT: Trimmed 53585 records to 38078 (keeping 200 days of data) [2025-10-16T19:07:41.116847] [DEBUG] [LOCAL ] GDOT: Primary data saved (38078 records). [2025-10-16T19:07:41.116988] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-16T19:07:41.117068] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDOT took 34.9s. Estimated remaining: 3h 24m 37s. Rate: 7.1 symbols/min [2025-10-16T19:07:41.302338] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:41.353758] [DEBUG] [LOCAL ] GENI: Loaded 52942 existing records from primary storage. [2025-10-16T19:07:41.354096] [INFO ] [MAIN ] GENI: Loaded 52942 existing records. [2025-10-16T19:07:41.539319] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:41.539541] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-16T19:07:41.539589] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-16T19:07:41.539892] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-16T19:07:41.539974] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-16T19:07:41.553712] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-16T19:07:41.923212] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:41.935930] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T19:07:42.144710] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-16T19:07:42.342777] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-16T19:07:42.572798] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:07:43.142864] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-16T19:07:43.942918] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-16T19:07:44.464145] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:07:44.629406] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-16T19:07:44.650423] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:07:44.742772] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-16T19:07:45.542825] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-16T19:07:45.654620] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:07:46.342840] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-16T19:07:46.803327] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:07:47.142874] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-16T19:07:47.942891] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-16T19:07:47.959692] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T19:07:48.067842] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-16T19:07:48.742858] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-16T19:07:49.542796] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-16T19:07:49.643901] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T19:07:49.675376] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:07:50.342874] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-16T19:07:50.474562] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:07:51.142879] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-16T19:07:51.942853] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-16T19:07:52.052722] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T19:07:52.311097] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T19:07:52.742875] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-16T19:07:53.097718] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-16T19:07:53.442202] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T19:07:53.445167] [INFO ] [REMOTE ] GEF: Full fetch complete (29399 records). [2025-10-16T19:07:53.445246] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-16T19:07:53.543429] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-16T19:07:53.819326] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-16T19:07:53.819399] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-16T19:07:53.820031] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-16T19:07:53.820093] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-16T19:07:53.820764] [DEBUG] [LOCAL ] GEF: Trimmed 29399 records to 20966 (keeping 200 days of data) [2025-10-16T19:07:53.944420] [DEBUG] [LOCAL ] GEF: Primary data saved (20966 records). [2025-10-16T19:07:53.944546] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-16T19:07:53.944618] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GEF took 22.8s. Estimated remaining: 3h 24m 36s. Rate: 7.1 symbols/min [2025-10-16T19:07:54.126683] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:07:54.175759] [DEBUG] [LOCAL ] GEO: Loaded 51820 existing records from primary storage. [2025-10-16T19:07:54.176347] [INFO ] [MAIN ] GEO: Loaded 51820 existing records. [2025-10-16T19:07:54.346683] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-16T19:07:54.350234] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:07:54.351271] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-16T19:07:54.351360] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-16T19:07:54.352037] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-16T19:07:54.352097] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-16T19:07:54.704924] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:07:55.030231] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T19:07:55.142813] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-16T19:07:55.699074] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:07:55.942849] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-16T19:07:56.553842] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T19:07:56.742807] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-16T19:07:57.542887] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-16T19:07:58.142188] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-16T19:07:58.204966] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:07:58.342807] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-16T19:07:58.912959] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:07:59.142864] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-16T19:07:59.685418] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:07:59.942841] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-16T19:08:00.054493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-16T19:08:00.742859] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-16T19:08:01.542845] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-16T19:08:02.150400] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-16T19:08:02.342790] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-16T19:08:02.867204] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-16T19:08:03.032415] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:08:03.142835] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-16T19:08:03.223866] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:08:03.230984] [INFO ] [REMOTE ] GE: Full fetch complete (77862 records). [2025-10-16T19:08:03.231129] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-16T19:08:03.610576] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-16T19:08:03.610680] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-16T19:08:03.611736] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-16T19:08:03.611799] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-16T19:08:03.613169] [DEBUG] [LOCAL ] GE: Trimmed 77862 records to 54088 (keeping 200 days of data) [2025-10-16T19:08:03.942919] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-16T19:08:03.950708] [DEBUG] [LOCAL ] GE: Primary data saved (54088 records). [2025-10-16T19:08:03.950928] [INFO ] [MAIN ] GE: Full history saved. [2025-10-16T19:08:03.951095] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GE took 45.0s. Estimated remaining: 3h 24m 30s. Rate: 7.1 symbols/min [2025-10-16T19:08:04.119517] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:04.155095] [DEBUG] [LOCAL ] GES: Loaded 38288 existing records from primary storage. [2025-10-16T19:08:04.155400] [INFO ] [MAIN ] GES: Loaded 38288 existing records. [2025-10-16T19:08:04.331856] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:04.332224] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-16T19:08:04.332334] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-16T19:08:04.332670] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-16T19:08:04.332733] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-16T19:08:04.704955] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:04.707783] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:08:04.742791] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-16T19:08:05.377888] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:08:05.542826] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-16T19:08:06.141235] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:08:06.342870] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-16T19:08:06.910397] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:08:07.142813] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-16T19:08:07.942840] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-16T19:08:08.303943] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T19:08:08.572090] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:08:08.742782] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-16T19:08:09.089102] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T19:08:09.542817] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-16T19:08:10.295139] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:08:10.342770] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-16T19:08:10.631039] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T19:08:10.634242] [INFO ] [REMOTE ] GEL: Full fetch complete (48191 records). [2025-10-16T19:08:10.634316] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-16T19:08:11.007271] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-16T19:08:11.007381] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-16T19:08:11.008261] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-16T19:08:11.008325] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-16T19:08:11.009453] [DEBUG] [LOCAL ] GEL: Trimmed 48191 records to 31983 (keeping 200 days of data) [2025-10-16T19:08:11.162406] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-16T19:08:11.205054] [DEBUG] [LOCAL ] GEL: Primary data saved (31983 records). [2025-10-16T19:08:11.205594] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-16T19:08:11.205722] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GEL took 32.1s. Estimated remaining: 3h 24m 20s. Rate: 7.1 symbols/min [2025-10-16T19:08:11.369147] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:11.401680] [DEBUG] [LOCAL ] GETY: Loaded 34990 existing records from primary storage. [2025-10-16T19:08:11.401955] [INFO ] [MAIN ] GETY: Loaded 34990 existing records. [2025-10-16T19:08:11.581678] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:11.581933] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-16T19:08:11.582022] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-16T19:08:11.582242] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-16T19:08:11.582317] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-16T19:08:11.893971] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:08:11.944740] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-16T19:08:11.985780] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:12.742892] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-16T19:08:12.813132] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:08:13.542906] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-16T19:08:13.660496] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:08:14.163463] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:08:14.342835] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-16T19:08:15.067891] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:08:15.142797] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-16T19:08:15.942837] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-16T19:08:16.268309] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-16T19:08:16.528979] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:08:16.742859] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-16T19:08:17.542821] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-16T19:08:17.732458] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:08:18.187730] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-16T19:08:18.342830] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-16T19:08:18.728625] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-16T19:08:19.142822] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-16T19:08:19.640267] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:08:19.942833] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-16T19:08:20.744058] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-16T19:08:20.749416] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:08:21.430773] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:08:21.542839] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-16T19:08:22.342803] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-16T19:08:22.499861] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:08:23.142836] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-16T19:08:23.611882] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-16T19:08:23.619701] [INFO ] [REMOTE ] GENI: Full fetch complete (76003 records). [2025-10-16T19:08:23.619857] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-16T19:08:23.943584] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-16T19:08:24.000822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T19:08:24.103452] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-16T19:08:24.103546] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-16T19:08:24.104574] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-16T19:08:24.104664] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-16T19:08:24.106291] [DEBUG] [LOCAL ] GENI: Trimmed 76003 records to 53328 (keeping 200 days of data) [2025-10-16T19:08:24.432881] [DEBUG] [LOCAL ] GENI: Primary data saved (53328 records). [2025-10-16T19:08:24.433020] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-16T19:08:24.433858] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GENI took 43.3s. Estimated remaining: 3h 24m 19s. Rate: 7.1 symbols/min [2025-10-16T19:08:24.604325] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:24.660300] [DEBUG] [LOCAL ] GEV: Loaded 53000 existing records from primary storage. [2025-10-16T19:08:24.660690] [INFO ] [MAIN ] GEV: Loaded 53000 existing records. [2025-10-16T19:08:24.750047] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-16T19:08:24.839506] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:24.839817] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-16T19:08:24.840029] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-16T19:08:24.840240] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-16T19:08:24.840280] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-16T19:08:25.149853] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T19:08:25.236327] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:25.306371] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T19:08:25.542858] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-16T19:08:26.228442] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:08:26.342841] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-16T19:08:27.142895] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-16T19:08:27.254114] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-16T19:08:27.942871] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-16T19:08:28.314397] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-16T19:08:28.696234] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:08:28.742769] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-16T19:08:28.901630] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:08:29.542811] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-16T19:08:30.261453] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:08:30.342788] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-16T19:08:31.142862] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-16T19:08:31.721509] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-16T19:08:31.942747] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-16T19:08:32.260766] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-16T19:08:32.342614] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T19:08:32.742825] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-16T19:08:33.542800] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-16T19:08:34.196816] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-16T19:08:34.342850] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-16T19:08:34.439168] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:08:34.686093] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:08:34.690800] [INFO ] [REMOTE ] GES: Full fetch complete (58706 records). [2025-10-16T19:08:34.690907] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-16T19:08:35.066258] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-16T19:08:35.066341] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-16T19:08:35.067267] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-16T19:08:35.067333] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-16T19:08:35.068627] [DEBUG] [LOCAL ] GES: Trimmed 58706 records to 38584 (keeping 200 days of data) [2025-10-16T19:08:35.156702] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-16T19:08:35.306125] [DEBUG] [LOCAL ] GES: Primary data saved (38584 records). [2025-10-16T19:08:35.306277] [INFO ] [MAIN ] GES: Full history saved. [2025-10-16T19:08:35.306360] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GES took 31.4s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-16T19:08:35.480185] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:35.485164] [DEBUG] [LOCAL ] GF: Loaded 2697 existing records from primary storage. [2025-10-16T19:08:35.485320] [INFO ] [MAIN ] GF: Loaded 2697 existing records. [2025-10-16T19:08:35.655471] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:35.655700] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-16T19:08:35.655757] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-16T19:08:35.655895] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-16T19:08:35.655950] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-16T19:08:35.947864] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-16T19:08:36.008508] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:36.464743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T19:08:36.487958] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:08:36.742818] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-16T19:08:37.542894] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-16T19:08:37.817964] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:08:37.824596] [INFO ] [REMOTE ] GEO: Full fetch complete (75583 records). [2025-10-16T19:08:37.824764] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-16T19:08:37.941385] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:08:37.996704] [INFO ] [REMOTE ] GETY: Full fetch complete (55624 records). [2025-10-16T19:08:38.013411] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-16T19:08:38.222016] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-16T19:08:38.352731] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-16T19:08:38.455773] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-16T19:08:38.468595] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-16T19:08:38.482449] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-16T19:08:38.502816] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-16T19:08:38.565147] [DEBUG] [LOCAL ] GEO: Trimmed 75583 records to 52187 (keeping 200 days of data) [2025-10-16T19:08:38.753463] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-16T19:08:38.756954] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-16T19:08:38.758036] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-16T19:08:38.758119] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-16T19:08:38.770095] [DEBUG] [LOCAL ] GETY: Trimmed 55624 records to 35351 (keeping 200 days of data) [2025-10-16T19:08:39.069265] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T19:08:39.157473] [DEBUG] [LOCAL ] GEO: Primary data saved (52187 records). [2025-10-16T19:08:39.152567] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-16T19:08:39.158961] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-16T19:08:39.160184] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GEO took 45.2s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-16T19:08:39.351446] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:08:39.368114] [DEBUG] [LOCAL ] GETY: Primary data saved (35351 records). [2025-10-16T19:08:39.368405] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-16T19:08:39.368524] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GETY took 28.2s. Estimated remaining: 3h 23m 37s. Rate: 7.1 symbols/min [2025-10-16T19:08:39.394695] [DEBUG] [LOCAL ] GFF: Loaded 30002 existing records from primary storage. [2025-10-16T19:08:39.395017] [INFO ] [MAIN ] GFF: Loaded 30002 existing records. [2025-10-16T19:08:39.575845] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:08:39.576091] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-16T19:08:39.576140] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-16T19:08:39.576323] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-16T19:08:39.576361] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-16T19:08:39.918910] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:08:39.942778] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-16T19:08:40.742852] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-16T19:08:41.224308] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:08:41.542786] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-16T19:08:41.734750] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-16T19:08:41.749921] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:08:42.342910] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-16T19:08:42.826059] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:08:42.903674] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T19:08:43.142815] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-16T19:08:43.697881] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T19:08:43.942817] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-16T19:08:44.742861] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-16T19:08:45.338939] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T19:08:45.542792] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-16T19:08:46.287918] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T19:08:46.347887] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-16T19:08:46.357528] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:08:46.887404] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:08:47.142911] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-16T19:08:47.577918] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-16T19:08:47.942894] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-16T19:08:48.742876] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-16T19:08:49.190879] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:08:49.542854] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-16T19:08:49.989762] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T19:08:50.344331] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-16T19:08:50.350251] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-16T19:08:51.142898] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-16T19:08:51.842243] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:08:51.942803] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-16T19:08:52.742909] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-16T19:08:53.208382] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-16T19:08:53.209366] [INFO ] [REMOTE ] GF: Full fetch complete (4878 records). [2025-10-16T19:08:53.209435] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-16T19:08:53.581935] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-16T19:08:53.582073] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-16T19:08:53.582431] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-16T19:08:53.582679] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-16T19:08:53.583451] [DEBUG] [LOCAL ] GF: Trimmed 4878 records to 2700 (keeping 200 days of data) [2025-10-16T19:08:53.622364] [DEBUG] [LOCAL ] GF: Primary data saved (2700 records). [2025-10-16T19:08:53.622595] [INFO ] [MAIN ] GF: Full history saved. [2025-10-16T19:08:53.624590] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:08:53.623378] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GF took 18.3s. Estimated remaining: 3h 23m 38s. Rate: 7.1 symbols/min [2025-10-16T19:08:53.633747] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-16T19:08:53.677601] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-16T19:08:54.342811] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-16T19:08:54.968268] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:08:55.142881] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-16T19:08:56.099796] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T19:08:56.106096] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-16T19:08:56.726795] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T19:08:56.742771] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-16T19:08:57.041290] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T19:08:57.542791] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-16T19:08:58.929029] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T19:08:58.936801] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-16T19:08:59.042493] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-16T19:08:59.142801] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-16T19:08:59.891188] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:08:59.942768] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-16T19:09:01.223759] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:09:01.228286] [INFO ] [REMOTE ] GFF: Full fetch complete (44020 records). [2025-10-16T19:09:01.228511] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-16T19:09:01.668763] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-16T19:09:01.669030] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-16T19:09:01.670081] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-16T19:09:01.670170] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-16T19:09:01.671782] [DEBUG] [LOCAL ] GFF: Trimmed 44020 records to 30148 (keeping 200 days of data) [2025-10-16T19:09:01.702743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-16T19:09:01.781837] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-16T19:09:01.922929] [DEBUG] [LOCAL ] GFF: Primary data saved (30148 records). [2025-10-16T19:09:01.923095] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-16T19:09:01.923191] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 22.8s. Estimated remaining: 3h 23m 29s. Rate: 7.1 symbols/min [2025-10-16T19:09:04.397490] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-16T19:09:04.405258] [INFO ] [REMOTE ] GEV: Full fetch complete (77024 records). [2025-10-16T19:09:04.405494] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-16T19:09:04.818532] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-16T19:09:04.818692] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-16T19:09:04.820119] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-16T19:09:04.820193] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-16T19:09:04.822173] [DEBUG] [LOCAL ] GEV: Trimmed 77024 records to 53389 (keeping 200 days of data) [2025-10-16T19:09:05.192591] [DEBUG] [LOCAL ] GEV: Primary data saved (53389 records). [2025-10-16T19:09:05.192911] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-16T19:09:05.193794] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GEV took 40.8s. Estimated remaining: 3h 23m 13s. Rate: 7.1 symbols/min [2025-10-16T19:09:05.837183] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.911859] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.957486] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.951477] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:05.957958] [DEBUG] [LOCAL ] GFR: No existing data file found in primary storage. [2025-10-16T19:09:05.958163] [WARN ] [MAIN ] GFR: No existing data found, performing full refresh instead. [2025-10-16T19:09:05.958848] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-16T19:09:05.958912] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-16T19:09:05.959102] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-10-16T19:09:05.959179] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-16T19:09:06.291909] [DEBUG] [LOCAL ] GFL: Loaded 47671 existing records from primary storage. [2025-10-16T19:09:06.309008] [INFO ] [MAIN ] GFL: Loaded 47671 existing records. [2025-10-16T19:09:06.340073] [DEBUG] [LOCAL ] GGB: Loaded 51471 existing records from primary storage. [2025-10-16T19:09:06.387098] [INFO ] [MAIN ] GGB: Loaded 51471 existing records. [2025-10-16T19:09:06.512371] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-16T19:09:06.588624] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-16T19:09:06.896173] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:06.929238] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:06.968369] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-16T19:09:06.967682] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:06.967922] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-16T19:09:06.975575] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-16T19:09:06.981125] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-16T19:09:06.991772] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-16T19:09:07.002778] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-16T19:09:07.002637] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-16T19:09:07.103123] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:07.108819] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-16T19:09:07.108671] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-16T19:09:07.129615] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-16T19:09:07.129789] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-16T19:09:07.190598] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-16T19:09:07.213535] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-16T19:09:07.902785] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:09:07.943752] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-16T19:09:08.142336] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.147933] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-16T19:09:08.314255] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.320134] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:08.320450] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-16T19:09:08.320924] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-16T19:09:08.803205] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:09:08.805774] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-16T19:09:09.571067] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T19:09:09.574409] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-16T19:09:09.699405] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:09:09.708025] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-16T19:09:09.941977] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:09:09.952321] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-16T19:09:10.061590] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:09:10.071968] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-16T19:09:10.335547] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T19:09:10.339931] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-16T19:09:10.900495] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-16T19:09:10.903908] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-16T19:09:11.372136] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:09:11.389022] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T19:09:11.389295] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-16T19:09:11.543433] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:09:11.594215] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-16T19:09:11.942814] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-16T19:09:12.540308] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-16T19:09:12.742832] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-16T19:09:13.542801] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-16T19:09:13.596140] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:09:13.921461] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-16T19:09:14.342788] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-16T19:09:14.615206] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T19:09:14.721061] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:09:15.142810] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-16T19:09:15.942880] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-16T19:09:16.742825] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-16T19:09:17.301667] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-16T19:09:17.373483] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:09:17.542793] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-16T19:09:18.342791] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-16T19:09:18.500331] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:09:18.769606] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T19:09:19.142826] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-16T19:09:19.187761] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:09:19.831287] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-16T19:09:19.942839] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-16T19:09:20.742898] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-16T19:09:21.542848] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-16T19:09:21.676823] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:09:21.707879] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:09:21.709517] [INFO ] [REMOTE ] GFR: Full fetch complete (12109 records). [2025-10-16T19:09:21.709609] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-16T19:09:22.077981] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-16T19:09:22.078063] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-16T19:09:22.078367] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-16T19:09:22.078409] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-16T19:09:22.078908] [DEBUG] [LOCAL ] GFR: Trimmed 12109 records to 7789 (keeping 200 days of data) [2025-10-16T19:09:22.119688] [DEBUG] [LOCAL ] GFR: Primary data saved (7789 records). [2025-10-16T19:09:22.119789] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-16T19:09:22.119856] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 16.9s. Estimated remaining: 3h 23m 18s. Rate: 7.1 symbols/min [2025-10-16T19:09:22.288777] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:22.325801] [DEBUG] [LOCAL ] GGG: Loaded 40679 existing records from primary storage. [2025-10-16T19:09:22.326081] [INFO ] [MAIN ] GGG: Loaded 40679 existing records. [2025-10-16T19:09:22.348059] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-16T19:09:22.504382] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:22.504603] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-16T19:09:22.504810] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-16T19:09:22.505010] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-16T19:09:22.505066] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-16T19:09:22.847936] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:23.142829] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-16T19:09:23.558488] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-16T19:09:23.694176] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T19:09:23.942835] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-16T19:09:24.535453] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:09:24.742780] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-16T19:09:25.493877] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:09:25.542818] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-16T19:09:26.328782] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:09:26.342789] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-16T19:09:27.142798] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-16T19:09:27.250971] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-16T19:09:27.942839] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-16T19:09:28.179454] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:09:28.742679] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:09:28.742861] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-16T19:09:29.240401] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:09:29.542816] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-16T19:09:30.342882] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-16T19:09:30.713950] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-16T19:09:31.142786] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-16T19:09:31.192682] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:09:31.765864] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:09:31.942816] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-16T19:09:32.742795] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-16T19:09:33.204126] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T19:09:33.542815] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-16T19:09:33.678773] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:09:34.342805] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-16T19:09:34.623613] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T19:09:35.006579] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:09:35.142843] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-16T19:09:35.942801] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-16T19:09:35.995844] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:09:36.002506] [INFO ] [REMOTE ] GGB: Full fetch complete (74329 records). [2025-10-16T19:09:36.002619] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-16T19:09:36.388709] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-16T19:09:36.388794] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-16T19:09:36.389789] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-16T19:09:36.389850] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-16T19:09:36.391195] [DEBUG] [LOCAL ] GGB: Trimmed 74329 records to 51854 (keeping 200 days of data) [2025-10-16T19:09:36.686799] [DEBUG] [LOCAL ] GGB: Primary data saved (51854 records). [2025-10-16T19:09:36.686939] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-16T19:09:36.687463] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 31.5s. Estimated remaining: 3h 23m 19s. Rate: 7.1 symbols/min [2025-10-16T19:09:36.755777] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-16T19:09:36.861150] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:36.890702] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:09:36.909824] [DEBUG] [LOCAL ] GGT: Loaded 14408 existing records from primary storage. [2025-10-16T19:09:36.910060] [INFO ] [MAIN ] GGT: Loaded 14408 existing records. [2025-10-16T19:09:37.085933] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:37.086126] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-16T19:09:37.086173] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-16T19:09:37.086344] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-16T19:09:37.086398] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-16T19:09:37.450210] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:37.542805] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-16T19:09:37.607255] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:09:37.999932] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-16T19:09:38.342852] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-16T19:09:38.363520] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:09:39.142819] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-16T19:09:39.851739] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:09:39.855538] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:09:39.942812] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-16T19:09:40.742894] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-16T19:09:41.243553] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-16T19:09:41.542834] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-16T19:09:42.277097] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:09:42.342779] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-16T19:09:42.503931] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T19:09:43.134111] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:09:43.142757] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-16T19:09:43.942862] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-16T19:09:43.968161] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-16T19:09:44.742910] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-16T19:09:45.542840] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-16T19:09:46.112721] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-16T19:09:46.120143] [INFO ] [REMOTE ] GFI: Full fetch complete (76826 records). [2025-10-16T19:09:46.120331] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-16T19:09:46.362210] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-16T19:09:46.532203] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:09:46.564633] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-16T19:09:46.565594] [INFO ] [REMOTE ] GFL: Full fetch complete (69463 records). [2025-10-16T19:09:46.566464] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:09:46.566764] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-16T19:09:46.566637] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-16T19:09:46.572246] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-16T19:09:46.573027] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-16T19:09:46.673700] [DEBUG] [LOCAL ] GFI: Trimmed 76826 records to 53505 (keeping 200 days of data) [2025-10-16T19:09:47.169739] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-16T19:09:47.169323] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-16T19:09:47.172741] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-16T19:09:47.181826] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-16T19:09:47.190093] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-16T19:09:47.205019] [DEBUG] [LOCAL ] GFL: Trimmed 69463 records to 48000 (keeping 200 days of data) [2025-10-16T19:09:47.384750] [DEBUG] [LOCAL ] GFI: Primary data saved (53505 records). [2025-10-16T19:09:47.385753] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-16T19:09:47.386144] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFI took 42.2s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-16T19:09:47.584603] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:47.596270] [DEBUG] [LOCAL ] GGZ: Loaded 2401 existing records from primary storage. [2025-10-16T19:09:47.598200] [INFO ] [MAIN ] GGZ: Loaded 2401 existing records. [2025-10-16T19:09:47.808491] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:47.860577] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-16T19:09:47.869536] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-16T19:09:47.898465] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-16T19:09:47.899784] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-16T19:09:48.050354] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:09:48.082286] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-16T19:09:48.069844] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-16T19:09:48.355859] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:48.422541] [DEBUG] [LOCAL ] GFL: Primary data saved (48000 records). [2025-10-16T19:09:48.422739] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-16T19:09:48.422844] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GFL took 43.2s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-16T19:09:48.592384] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:09:48.597486] [DEBUG] [LOCAL ] GHC: Loaded 2926 existing records from primary storage. [2025-10-16T19:09:48.597667] [INFO ] [MAIN ] GHC: Loaded 2926 existing records. [2025-10-16T19:09:48.750707] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-16T19:09:48.782850] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:09:48.783360] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-16T19:09:48.783429] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-16T19:09:48.783598] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-16T19:09:48.783688] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-16T19:09:49.134312] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:09:49.202076] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:09:49.340017] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:09:49.542850] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-16T19:09:49.976444] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-16T19:09:50.342844] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-16T19:09:51.142879] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-16T19:09:51.932595] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:09:51.933562] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:09:51.942910] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-16T19:09:52.505301] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-16T19:09:52.742846] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-16T19:09:53.542846] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-16T19:09:54.202890] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:09:54.342838] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-16T19:09:54.504958] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:09:54.863474] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:09:55.142821] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-16T19:09:55.634832] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-16T19:09:55.942869] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-16T19:09:56.530468] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:09:56.742828] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-16T19:09:57.542864] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-16T19:09:58.199699] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-16T19:09:58.229973] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:09:58.342813] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-16T19:09:59.142813] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-16T19:09:59.850020] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-16T19:09:59.852508] [INFO ] [REMOTE ] GGT: Full fetch complete (18930 records). [2025-10-16T19:09:59.852592] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-16T19:09:59.947024] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-16T19:09:59.973566] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:10:00.026158] [INFO ] [REMOTE ] GGG: Full fetch complete (59516 records). [2025-10-16T19:10:00.037998] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-16T19:10:00.486113] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-16T19:10:00.486025] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-16T19:10:00.492795] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-16T19:10:00.493377] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-16T19:10:00.527363] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-16T19:10:00.553593] [DEBUG] [LOCAL ] GGT: Trimmed 18930 records to 14507 (keeping 200 days of data) [2025-10-16T19:10:00.706783] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-16T19:10:00.707147] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-16T19:10:00.708379] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-16T19:10:00.708726] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-16T19:10:00.712889] [DEBUG] [LOCAL ] GGG: Trimmed 59516 records to 40973 (keeping 200 days of data) [2025-10-16T19:10:00.768911] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-16T19:10:00.840841] [DEBUG] [LOCAL ] GGT: Primary data saved (14507 records). [2025-10-16T19:10:00.842881] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-16T19:10:00.843238] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGT took 24.2s. Estimated remaining: 3h 22m 52s. Rate: 7.1 symbols/min [2025-10-16T19:10:01.022287] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:01.029575] [DEBUG] [LOCAL ] GHG: Loaded 3296 existing records from primary storage. [2025-10-16T19:10:01.030013] [INFO ] [MAIN ] GHG: Loaded 3296 existing records. [2025-10-16T19:10:01.221557] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:01.279116] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-16T19:10:01.279464] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-16T19:10:01.309522] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-16T19:10:01.309681] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-16T19:10:01.309269] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:10:01.547937] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-16T19:10:01.703806] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:01.719759] [DEBUG] [LOCAL ] GGG: Primary data saved (40973 records). [2025-10-16T19:10:01.719885] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-16T19:10:01.719987] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGG took 39.6s. Estimated remaining: 3h 22m 32s. Rate: 7.1 symbols/min [2025-10-16T19:10:01.893586] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:01.904493] [DEBUG] [LOCAL ] GHI: Loaded 7364 existing records from primary storage. [2025-10-16T19:10:01.904752] [INFO ] [MAIN ] GHI: Loaded 7364 existing records. [2025-10-16T19:10:02.083553] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:02.086307] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-16T19:10:02.086444] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T19:10:02.086503] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-16T19:10:02.087970] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-16T19:10:02.088029] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-16T19:10:02.347928] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-16T19:10:02.437589] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:02.870225] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:10:03.142811] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-16T19:10:03.532918] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:10:03.942836] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-16T19:10:04.742790] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-16T19:10:05.003952] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:10:05.262919] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-16T19:10:05.542812] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-16T19:10:05.852260] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T19:10:06.342832] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-16T19:10:07.142798] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-16T19:10:07.144784] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:10:07.518217] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:10:07.942847] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-16T19:10:08.293970] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-16T19:10:08.742815] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-16T19:10:09.174582] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:10:09.542856] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-16T19:10:10.257321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T19:10:10.342836] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-16T19:10:10.833977] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:10:11.142822] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-16T19:10:11.570751] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:10:11.942831] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-16T19:10:12.515418] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:10:12.742811] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-16T19:10:13.108949] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-16T19:10:13.542879] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-16T19:10:14.096114] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-16T19:10:14.342816] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-16T19:10:14.840001] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:10:15.142835] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-16T19:10:15.661281] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:10:15.942814] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-16T19:10:16.560758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:10:16.742898] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-16T19:10:17.234906] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-16T19:10:17.542803] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-16T19:10:17.865880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-16T19:10:18.342829] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-16T19:10:18.790705] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:10:19.142794] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-16T19:10:19.696309] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-16T19:10:19.697251] [INFO ] [REMOTE ] GGZ: Full fetch complete (3975 records). [2025-10-16T19:10:19.697321] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-16T19:10:19.947944] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-16T19:10:20.060629] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-16T19:10:20.060731] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-16T19:10:20.060860] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-16T19:10:20.060898] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-16T19:10:20.061233] [DEBUG] [LOCAL ] GGZ: Trimmed 3975 records to 2437 (keeping 200 days of data) [2025-10-16T19:10:20.076270] [DEBUG] [LOCAL ] GGZ: Primary data saved (2437 records). [2025-10-16T19:10:20.076399] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-16T19:10:20.076478] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGZ took 32.7s. Estimated remaining: 3h 22m 39s. Rate: 7.1 symbols/min [2025-10-16T19:10:20.245158] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:20.251702] [DEBUG] [LOCAL ] GHLD: Loaded 4222 existing records from primary storage. [2025-10-16T19:10:20.251877] [INFO ] [MAIN ] GHLD: Loaded 4222 existing records. [2025-10-16T19:10:20.428610] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:20.428850] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-16T19:10:20.428896] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-16T19:10:20.429025] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-16T19:10:20.429061] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-16T19:10:20.687088] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T19:10:20.747917] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-16T19:10:20.802972] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:21.316493] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T19:10:21.542813] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-16T19:10:22.003329] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-16T19:10:22.342819] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-16T19:10:23.015208] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:10:23.016452] [INFO ] [REMOTE ] GHC: Full fetch complete (3619 records). [2025-10-16T19:10:23.016542] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-16T19:10:23.155860] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-16T19:10:23.413858] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-16T19:10:23.413933] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-16T19:10:23.414048] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-16T19:10:23.414085] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-16T19:10:23.414417] [DEBUG] [LOCAL ] GHC: Trimmed 3619 records to 2948 (keeping 200 days of data) [2025-10-16T19:10:23.433190] [DEBUG] [LOCAL ] GHC: Primary data saved (2948 records). [2025-10-16T19:10:23.433251] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-16T19:10:23.433319] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 35.0s. Estimated remaining: 3h 22m 23s. Rate: 7.1 symbols/min [2025-10-16T19:10:23.623061] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:23.638405] [DEBUG] [LOCAL ] GHM: Loaded 14368 existing records from primary storage. [2025-10-16T19:10:23.638705] [INFO ] [MAIN ] GHM: Loaded 14368 existing records. [2025-10-16T19:10:23.842233] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:23.842473] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-16T19:10:23.842521] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-16T19:10:23.842987] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-16T19:10:23.843079] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-16T19:10:23.948005] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-16T19:10:23.992860] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-16T19:10:24.274490] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:24.465816] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T19:10:24.742829] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-16T19:10:25.542813] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-16T19:10:25.591564] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:10:26.277474] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:10:26.342789] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-16T19:10:27.142800] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-16T19:10:27.154175] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:10:27.156460] [INFO ] [REMOTE ] GHI: Full fetch complete (11295 records). [2025-10-16T19:10:27.156548] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-16T19:10:27.541231] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-16T19:10:27.541344] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-16T19:10:27.542027] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-16T19:10:27.542096] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-16T19:10:27.542974] [DEBUG] [LOCAL ] GHI: Trimmed 11295 records to 7465 (keeping 200 days of data) [2025-10-16T19:10:27.596411] [DEBUG] [LOCAL ] GHI: Primary data saved (7465 records). [2025-10-16T19:10:27.596576] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-16T19:10:27.596689] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 25.9s. Estimated remaining: 3h 22m 7s. Rate: 7.1 symbols/min [2025-10-16T19:10:27.769420] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:27.791796] [DEBUG] [LOCAL ] GHY: Loaded 20928 existing records from primary storage. [2025-10-16T19:10:27.792042] [INFO ] [MAIN ] GHY: Loaded 20928 existing records. [2025-10-16T19:10:27.944092] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-16T19:10:27.975439] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:27.975671] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-16T19:10:27.975739] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-16T19:10:27.975945] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-16T19:10:27.976001] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-16T19:10:28.167112] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:10:28.354017] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:28.418510] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:10:28.742891] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-16T19:10:29.157451] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T19:10:29.542808] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-16T19:10:30.342784] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-16T19:10:30.670422] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T19:10:30.795323] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T19:10:31.142810] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-16T19:10:31.942786] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-16T19:10:31.983491] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:10:32.433553] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:10:32.742928] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-16T19:10:33.542810] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-16T19:10:33.807813] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:10:34.333093] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:10:34.342767] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-16T19:10:35.124766] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:10:35.142772] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-16T19:10:35.942773] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-16T19:10:35.992010] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-16T19:10:36.518803] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:10:36.742831] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-16T19:10:37.462189] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-16T19:10:37.542779] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-16T19:10:38.342792] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-16T19:10:38.474934] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:10:39.004226] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:10:39.005320] [INFO ] [REMOTE ] GHG: Full fetch complete (4173 records). [2025-10-16T19:10:39.005390] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-16T19:10:39.151172] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-16T19:10:39.355218] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-16T19:10:39.355294] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-16T19:10:39.355433] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-16T19:10:39.355472] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-16T19:10:39.355861] [DEBUG] [LOCAL ] GHG: Trimmed 4173 records to 3303 (keeping 200 days of data) [2025-10-16T19:10:39.373779] [DEBUG] [LOCAL ] GHG: Primary data saved (3303 records). [2025-10-16T19:10:39.373848] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-16T19:10:39.373916] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHG took 38.5s. Estimated remaining: 3h 22m 4s. Rate: 7.1 symbols/min [2025-10-16T19:10:39.537673] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:39.570139] [DEBUG] [LOCAL ] GIB: Loaded 31659 existing records from primary storage. [2025-10-16T19:10:39.570407] [INFO ] [MAIN ] GIB: Loaded 31659 existing records. [2025-10-16T19:10:39.643603] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T19:10:39.749197] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:39.749414] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-16T19:10:39.749460] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-16T19:10:39.749689] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-16T19:10:39.749746] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-16T19:10:39.952467] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-16T19:10:40.097857] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:40.742833] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-16T19:10:40.975037] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:10:41.542882] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-16T19:10:41.588089] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:10:42.342891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-16T19:10:42.699508] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-16T19:10:42.702526] [INFO ] [REMOTE ] GHM: Full fetch complete (22139 records). [2025-10-16T19:10:42.702620] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-16T19:10:43.064575] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-16T19:10:43.064678] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-16T19:10:43.065222] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-16T19:10:43.065283] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-16T19:10:43.065972] [DEBUG] [LOCAL ] GHM: Trimmed 22139 records to 14491 (keeping 200 days of data) [2025-10-16T19:10:43.143057] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-16T19:10:43.151528] [DEBUG] [LOCAL ] GHM: Primary data saved (14491 records). [2025-10-16T19:10:43.151707] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-16T19:10:43.151803] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHM took 19.7s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-16T19:10:43.335088] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:43.354379] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:10:43.372298] [DEBUG] [LOCAL ] GIC: Loaded 13411 existing records from primary storage. [2025-10-16T19:10:43.372538] [INFO ] [MAIN ] GIC: Loaded 13411 existing records. [2025-10-16T19:10:43.477369] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:10:43.557111] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:43.557317] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-16T19:10:43.557363] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-16T19:10:43.557506] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-16T19:10:43.557544] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-16T19:10:43.912188] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:43.942773] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-16T19:10:44.696391] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-16T19:10:44.742781] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-16T19:10:45.542806] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-16T19:10:45.660396] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:10:45.845629] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-16T19:10:46.342805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-16T19:10:46.833551] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-16T19:10:47.142898] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-16T19:10:47.942875] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-16T19:10:48.181620] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:10:48.742833] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-16T19:10:49.082204] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:10:49.549461] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-16T19:10:49.554984] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-16T19:10:50.342835] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-16T19:10:50.573379] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:10:50.917990] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:10:51.142869] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-16T19:10:51.942812] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-16T19:10:52.547483] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T19:10:52.571299] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:10:52.742885] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-16T19:10:53.420870] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-16T19:10:53.542863] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-16T19:10:54.121393] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:10:54.342828] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-16T19:10:55.142891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-16T19:10:55.772507] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:10:55.942872] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-16T19:10:56.311684] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T19:10:56.549055] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-16T19:10:56.550266] [INFO ] [REMOTE ] GHLD: Full fetch complete (5072 records). [2025-10-16T19:10:56.550343] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-16T19:10:56.747995] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-16T19:10:56.910109] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-16T19:10:56.910185] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-16T19:10:56.910335] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-16T19:10:56.910373] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-16T19:10:56.910797] [DEBUG] [LOCAL ] GHLD: Trimmed 5072 records to 4312 (keeping 200 days of data) [2025-10-16T19:10:56.937166] [DEBUG] [LOCAL ] GHLD: Primary data saved (4312 records). [2025-10-16T19:10:56.937357] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-16T19:10:56.937466] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHLD took 36.9s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-16T19:10:57.106893] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:10:57.147947] [DEBUG] [LOCAL ] GIL: Loaded 43829 existing records from primary storage. [2025-10-16T19:10:57.148286] [INFO ] [MAIN ] GIL: Loaded 43829 existing records. [2025-10-16T19:10:57.329941] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:10:57.330249] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-16T19:10:57.330312] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-16T19:10:57.330516] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-16T19:10:57.330574] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-16T19:10:57.552537] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-16T19:10:57.690334] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:10:58.038873] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:10:58.143320] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-16T19:10:58.342862] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-16T19:10:59.142835] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-16T19:10:59.746005] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:10:59.904879] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-16T19:10:59.942763] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-16T19:11:00.742786] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-16T19:11:00.798928] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:11:01.542781] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-16T19:11:01.739985] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:11:02.342824] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-16T19:11:02.382223] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:11:03.005254] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:11:03.142819] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-16T19:11:03.942780] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-16T19:11:04.342582] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-16T19:11:04.742816] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-16T19:11:05.407602] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:11:05.452610] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:11:05.542868] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-16T19:11:06.342843] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-16T19:11:06.768349] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:11:07.142824] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-16T19:11:07.208295] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:11:07.942853] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-16T19:11:08.708132] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:11:08.742789] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-16T19:11:09.155972] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T19:11:09.542809] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-16T19:11:10.034794] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:11:10.335466] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:11:10.342790] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-16T19:11:11.142826] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-16T19:11:11.326413] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:11:11.942865] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-16T19:11:12.031983] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:11:12.696797] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T19:11:12.742828] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-16T19:11:13.542796] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-16T19:11:14.049879] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:11:14.342835] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-16T19:11:14.674087] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T19:11:14.677881] [INFO ] [REMOTE ] GHY: Full fetch complete (32502 records). [2025-10-16T19:11:14.678016] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-16T19:11:15.051063] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-16T19:11:15.051148] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-16T19:11:15.051834] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-16T19:11:15.051895] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-16T19:11:15.052593] [DEBUG] [LOCAL ] GHY: Trimmed 32502 records to 21076 (keeping 200 days of data) [2025-10-16T19:11:15.143181] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-16T19:11:15.186272] [DEBUG] [LOCAL ] GHY: Primary data saved (21076 records). [2025-10-16T19:11:15.186411] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-16T19:11:15.186488] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GHY took 47.6s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-16T19:11:15.354370] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:15.404393] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-16T19:11:15.404829] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-10-16T19:11:15.579226] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:15.579442] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-16T19:11:15.579490] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-16T19:11:15.579814] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-16T19:11:15.579873] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-16T19:11:15.943815] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:15.944086] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-16T19:11:15.971972] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:11:16.059733] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:11:16.742876] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-16T19:11:17.332110] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:11:17.542812] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-16T19:11:18.342800] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-16T19:11:18.485946] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:11:18.881506] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:11:18.885520] [INFO ] [REMOTE ] GIB: Full fetch complete (46159 records). [2025-10-16T19:11:18.885598] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-16T19:11:19.147883] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-16T19:11:19.262497] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-16T19:11:19.262586] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-16T19:11:19.263391] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-16T19:11:19.263481] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-16T19:11:19.264714] [DEBUG] [LOCAL ] GIB: Trimmed 46159 records to 31938 (keeping 200 days of data) [2025-10-16T19:11:19.484758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:11:19.495465] [DEBUG] [LOCAL ] GIB: Primary data saved (31938 records). [2025-10-16T19:11:19.495957] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-16T19:11:19.496071] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIB took 40.1s. Estimated remaining: 3h 21m 40s. Rate: 7.1 symbols/min [2025-10-16T19:11:19.662094] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:19.698995] [DEBUG] [LOCAL ] GKOS: Loaded 42541 existing records from primary storage. [2025-10-16T19:11:19.699301] [INFO ] [MAIN ] GKOS: Loaded 42541 existing records. [2025-10-16T19:11:19.872587] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:19.872828] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-16T19:11:19.872877] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-16T19:11:19.873499] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-16T19:11:19.873554] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-16T19:11:19.947949] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-16T19:11:20.229124] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:20.742841] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-16T19:11:20.845262] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:11:20.847404] [INFO ] [REMOTE ] GIC: Full fetch complete (19960 records). [2025-10-16T19:11:20.847485] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-16T19:11:21.221311] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-16T19:11:21.221416] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-16T19:11:21.221922] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-16T19:11:21.222066] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-16T19:11:21.249221] [DEBUG] [LOCAL ] GIC: Trimmed 19960 records to 13495 (keeping 200 days of data) [2025-10-16T19:11:21.250580] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-16T19:11:21.343099] [DEBUG] [LOCAL ] GIC: Primary data saved (13495 records). [2025-10-16T19:11:21.343252] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-16T19:11:21.343338] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIC took 38.2s. Estimated remaining: 3h 21m 22s. Rate: 7.1 symbols/min [2025-10-16T19:11:21.510760] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:21.547999] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-16T19:11:21.550511] [DEBUG] [LOCAL ] GL: Loaded 37640 existing records from primary storage. [2025-10-16T19:11:21.550767] [INFO ] [MAIN ] GL: Loaded 37640 existing records. [2025-10-16T19:11:21.724033] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:21.724217] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-16T19:11:21.724263] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-16T19:11:21.724469] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-16T19:11:21.724525] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-16T19:11:22.084263] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:22.108378] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T19:11:22.342805] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-16T19:11:23.046351] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:11:23.142808] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-16T19:11:23.789921] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:11:23.942822] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-16T19:11:24.619765] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:11:24.742934] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-16T19:11:25.331004] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T19:11:25.542813] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-16T19:11:25.902014] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:11:26.342826] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-16T19:11:26.659566] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:11:27.142867] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-16T19:11:27.947679] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-16T19:11:27.953274] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:11:28.742849] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-16T19:11:29.101259] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:11:29.139220] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-16T19:11:29.542868] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-16T19:11:29.854820] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:11:30.342804] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-16T19:11:31.142818] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-16T19:11:31.242279] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:11:31.942790] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-16T19:11:32.023764] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:11:32.742801] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-16T19:11:32.868732] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:11:32.874852] [INFO ] [REMOTE ] GIL: Full fetch complete (62316 records). [2025-10-16T19:11:32.874997] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-16T19:11:33.255931] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-16T19:11:33.256044] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-16T19:11:33.257133] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-16T19:11:33.257220] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-16T19:11:33.258718] [DEBUG] [LOCAL ] GIL: Trimmed 62316 records to 44162 (keeping 200 days of data) [2025-10-16T19:11:33.523927] [DEBUG] [LOCAL ] GIL: Primary data saved (44162 records). [2025-10-16T19:11:33.524108] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-16T19:11:33.524593] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 36.6s. Estimated remaining: 3h 21m 19s. Rate: 7.1 symbols/min [2025-10-16T19:11:33.555990] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-16T19:11:33.720633] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:33.755628] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:11:33.808825] [DEBUG] [LOCAL ] GLOB: Loaded 47983 existing records from primary storage. [2025-10-16T19:11:33.809237] [INFO ] [MAIN ] GLOB: Loaded 47983 existing records. [2025-10-16T19:11:34.046743] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:34.047105] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-16T19:11:34.047215] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-16T19:11:34.055638] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-16T19:11:34.068255] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-16T19:11:34.141773] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:11:34.347959] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-16T19:11:34.504398] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:35.142868] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-16T19:11:35.238529] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:11:35.935985] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:11:35.946351] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-16T19:11:36.525006] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:11:36.742859] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-16T19:11:36.874775] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-16T19:11:37.542900] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-16T19:11:38.342831] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-16T19:11:38.589083] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:11:39.142856] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-16T19:11:39.225983] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:11:39.307025] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:11:39.942813] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-16T19:11:40.742797] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-16T19:11:41.094759] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-16T19:11:41.194954] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-16T19:11:41.542803] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-16T19:11:42.277714] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:11:42.342799] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-16T19:11:43.089598] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:11:43.142785] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-16T19:11:43.490541] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:11:43.942837] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-16T19:11:44.625260] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:11:44.742817] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-16T19:11:45.539590] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:11:45.547002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-16T19:11:46.217305] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:11:46.342813] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-16T19:11:47.142787] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-16T19:11:47.609011] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-16T19:11:47.886376] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:11:47.942838] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-16T19:11:48.393576] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T19:11:48.742882] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-16T19:11:49.304587] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:11:49.542814] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-16T19:11:49.578088] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-16T19:11:49.585796] [INFO ] [REMOTE ] GIS: Full fetch complete (77836 records). [2025-10-16T19:11:49.585996] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-16T19:11:50.009928] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-16T19:11:50.010021] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-16T19:11:50.011165] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-16T19:11:50.011231] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-16T19:11:50.012986] [DEBUG] [LOCAL ] GIS: Trimmed 77836 records to 54063 (keeping 200 days of data) [2025-10-16T19:11:50.343056] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-16T19:11:50.352691] [DEBUG] [LOCAL ] GIS: Primary data saved (54063 records). [2025-10-16T19:11:50.352844] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-16T19:11:50.353454] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GIS took 35.2s. Estimated remaining: 3h 21m 24s. Rate: 7.1 symbols/min [2025-10-16T19:11:50.518785] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:50.529606] [DEBUG] [LOCAL ] GLP: Loaded 9278 existing records from primary storage. [2025-10-16T19:11:50.529856] [INFO ] [MAIN ] GLP: Loaded 9278 existing records. [2025-10-16T19:11:50.702985] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:50.703212] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-16T19:11:50.703460] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-16T19:11:50.703873] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-16T19:11:50.703936] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-16T19:11:51.120328] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:51.134065] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:11:51.139080] [INFO ] [REMOTE ] GL: Full fetch complete (55147 records). [2025-10-16T19:11:51.139218] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-16T19:11:51.151102] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-16T19:11:51.523900] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-16T19:11:51.523981] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-16T19:11:51.524809] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-16T19:11:51.524871] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-16T19:11:51.526011] [DEBUG] [LOCAL ] GL: Trimmed 55147 records to 37863 (keeping 200 days of data) [2025-10-16T19:11:51.766011] [DEBUG] [LOCAL ] GL: Primary data saved (37863 records). [2025-10-16T19:11:51.766177] [INFO ] [MAIN ] GL: Full history saved. [2025-10-16T19:11:51.766292] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GL took 30.4s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-16T19:11:51.940493] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:51.942783] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-16T19:11:51.968534] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:11:52.005126] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:11:52.027561] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-16T19:11:52.027932] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-16T19:11:52.201166] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:52.201401] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-16T19:11:52.201449] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-16T19:11:52.202461] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-16T19:11:52.202519] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-16T19:11:52.551400] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:52.742817] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-16T19:11:53.462704] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:11:53.542827] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-16T19:11:54.342819] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-16T19:11:54.525090] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T19:11:54.681759] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:11:54.687035] [INFO ] [REMOTE ] GKOS: Full fetch complete (60375 records). [2025-10-16T19:11:54.687176] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-16T19:11:55.064274] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-16T19:11:55.064364] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-16T19:11:55.065259] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-16T19:11:55.065327] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-16T19:11:55.066626] [DEBUG] [LOCAL ] GKOS: Trimmed 60375 records to 42824 (keeping 200 days of data) [2025-10-16T19:11:55.152974] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-16T19:11:55.331208] [DEBUG] [LOCAL ] GKOS: Primary data saved (42824 records). [2025-10-16T19:11:55.331347] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-16T19:11:55.331953] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GKOS took 35.8s. Estimated remaining: 3h 20m 49s. Rate: 7.1 symbols/min [2025-10-16T19:11:55.525817] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:11:55.577341] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-16T19:11:55.577667] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-16T19:11:55.755907] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:11:55.756149] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-16T19:11:55.756204] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-16T19:11:55.757202] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-16T19:11:55.757261] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-16T19:11:55.950901] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-16T19:11:56.129976] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:11:56.163456] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T19:11:56.742802] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-16T19:11:56.818091] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:11:57.073714] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T19:11:57.542897] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-16T19:11:58.342873] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-16T19:11:58.669534] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:11:59.142817] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-16T19:11:59.171536] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T19:11:59.217290] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:11:59.942823] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-16T19:12:00.663752] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:12:00.742807] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-16T19:12:01.554158] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-16T19:12:01.559811] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-16T19:12:02.002016] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:12:02.277744] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:12:02.342813] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-16T19:12:03.094862] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:12:03.142798] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-16T19:12:03.942842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-16T19:12:03.951778] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:12:04.742859] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-16T19:12:05.542842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-16T19:12:05.714187] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:12:06.245741] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:12:06.342882] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-16T19:12:06.470459] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-16T19:12:07.142850] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-16T19:12:07.907337] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:12:07.942782] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-16T19:12:08.387757] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-16T19:12:08.742813] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-16T19:12:09.542828] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-16T19:12:09.618335] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T19:12:09.722054] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:12:10.342859] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-16T19:12:11.142793] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-16T19:12:11.232381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:12:11.942823] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-16T19:12:12.056031] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:12:12.742856] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-16T19:12:13.123452] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:12:13.446257] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-16T19:12:13.447926] [INFO ] [REMOTE ] GLP: Full fetch complete (14287 records). [2025-10-16T19:12:13.447997] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-16T19:12:13.543111] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-16T19:12:13.827575] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-16T19:12:13.827723] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-16T19:12:13.828122] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-16T19:12:13.828258] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-16T19:12:13.829129] [DEBUG] [LOCAL ] GLP: Trimmed 14287 records to 9346 (keeping 200 days of data) [2025-10-16T19:12:13.912970] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:12:13.926931] [DEBUG] [LOCAL ] GLP: Primary data saved (9346 records). [2025-10-16T19:12:13.927372] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-16T19:12:13.927467] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 23.6s. Estimated remaining: 3h 20m 56s. Rate: 7.1 symbols/min [2025-10-16T19:12:14.095377] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:14.148257] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-16T19:12:14.148592] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-16T19:12:14.324004] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:14.324223] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-16T19:12:14.324271] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-16T19:12:14.324478] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-16T19:12:14.324548] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-16T19:12:14.349314] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-16T19:12:14.692892] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:15.142825] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-16T19:12:15.571402] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T19:12:15.942814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-16T19:12:16.228614] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-16T19:12:16.235196] [INFO ] [REMOTE ] GLOB: Full fetch complete (65695 records). [2025-10-16T19:12:16.235352] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-16T19:12:16.618205] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-16T19:12:16.618284] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-16T19:12:16.619264] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-16T19:12:16.619327] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-16T19:12:16.620706] [DEBUG] [LOCAL ] GLOB: Trimmed 65695 records to 48330 (keeping 200 days of data) [2025-10-16T19:12:16.783735] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-16T19:12:16.899157] [DEBUG] [LOCAL ] GLOB: Primary data saved (48330 records). [2025-10-16T19:12:16.899297] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-16T19:12:16.899374] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLOB took 43.4s. Estimated remaining: 3h 20m 39s. Rate: 7.1 symbols/min [2025-10-16T19:12:17.068659] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:17.111809] [DEBUG] [LOCAL ] GMED: Loaded 48294 existing records from primary storage. [2025-10-16T19:12:17.112119] [INFO ] [MAIN ] GMED: Loaded 48294 existing records. [2025-10-16T19:12:17.286503] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:17.286770] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-16T19:12:17.286821] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-16T19:12:17.287065] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-16T19:12:17.287121] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-16T19:12:17.706986] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:17.707545] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-16T19:12:17.771354] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-16T19:12:17.812547] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:12:18.287687] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T19:12:18.342775] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-16T19:12:19.142909] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-16T19:12:19.188323] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:12:19.942798] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-16T19:12:20.091054] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:12:20.742910] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-16T19:12:21.515127] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:12:21.542818] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-16T19:12:21.721297] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-16T19:12:22.342841] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-16T19:12:22.708617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:12:22.748518] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:12:23.142874] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-16T19:12:23.942842] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-16T19:12:24.230069] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:12:24.481209] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:12:24.742833] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-16T19:12:25.542832] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-16T19:12:25.726471] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:12:26.342795] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-16T19:12:26.912440] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-16T19:12:27.142861] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-16T19:12:27.833138] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:12:27.840067] [INFO ] [REMOTE ] GLW: Full fetch complete (77790 records). [2025-10-16T19:12:27.840184] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-16T19:12:27.946485] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-16T19:12:28.210065] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-16T19:12:28.306148] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-16T19:12:28.306738] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-16T19:12:28.307923] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-16T19:12:28.308006] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-16T19:12:28.335764] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T19:12:28.334426] [DEBUG] [LOCAL ] GLW: Trimmed 77790 records to 54026 (keeping 200 days of data) [2025-10-16T19:12:28.670728] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-16T19:12:28.670880] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-16T19:12:28.670963] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GLW took 36.9s. Estimated remaining: 3h 20m 36s. Rate: 7.1 symbols/min [2025-10-16T19:12:28.747916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-16T19:12:28.839883] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:28.874410] [DEBUG] [LOCAL ] GMRE: Loaded 37100 existing records from primary storage. [2025-10-16T19:12:28.874714] [INFO ] [MAIN ] GMRE: Loaded 37100 existing records. [2025-10-16T19:12:29.048366] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:29.048593] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-16T19:12:29.048676] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-16T19:12:29.048968] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-16T19:12:29.049025] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-16T19:12:29.423385] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:29.542831] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-16T19:12:29.765058] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:12:30.342791] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-16T19:12:30.506911] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:12:30.883596] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:12:31.142842] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-16T19:12:31.942843] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-16T19:12:32.186858] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T19:12:32.490043] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:12:32.742896] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-16T19:12:33.542815] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-16T19:12:33.604119] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:12:33.611097] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-16T19:12:33.611240] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-16T19:12:33.996544] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-16T19:12:33.996622] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-16T19:12:33.997674] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-16T19:12:33.997740] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-16T19:12:33.999169] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54119 (keeping 200 days of data) [2025-10-16T19:12:34.327299] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-16T19:12:34.327474] [INFO ] [MAIN ] GM: Full history saved. [2025-10-16T19:12:34.328105] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 39.0s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-16T19:12:34.350146] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-16T19:12:34.526439] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:34.538448] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-16T19:12:34.565780] [DEBUG] [LOCAL ] GNE: Loaded 18040 existing records from primary storage. [2025-10-16T19:12:34.566034] [INFO ] [MAIN ] GNE: Loaded 18040 existing records. [2025-10-16T19:12:34.747503] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:34.747692] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-16T19:12:34.747749] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-16T19:12:34.747919] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-16T19:12:34.747974] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-16T19:12:35.110328] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:35.136310] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:12:35.145276] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-16T19:12:35.660546] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:12:35.854785] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:12:35.942932] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-16T19:12:36.742864] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-16T19:12:37.542787] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-16T19:12:37.647560] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:12:38.342844] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-16T19:12:38.353706] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T19:12:38.889422] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-16T19:12:39.142838] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-16T19:12:39.889607] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:12:39.890507] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:12:39.942830] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-16T19:12:40.735226] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:12:40.742786] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-16T19:12:41.542880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-16T19:12:42.115713] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:12:42.342868] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-16T19:12:43.142877] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-16T19:12:43.696130] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:12:43.780703] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-16T19:12:43.902846] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:12:43.942823] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-16T19:12:44.742891] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-16T19:12:45.542844] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-16T19:12:46.271547] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:12:46.278005] [INFO ] [REMOTE ] GMED: Full fetch complete (69986 records). [2025-10-16T19:12:46.278128] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-16T19:12:46.344404] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-16T19:12:46.566381] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:12:46.701508] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-16T19:12:46.755927] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-16T19:12:46.756164] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-16T19:12:46.757234] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-16T19:12:46.757327] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-16T19:12:46.759120] [DEBUG] [LOCAL ] GMED: Trimmed 69986 records to 48602 (keeping 200 days of data) [2025-10-16T19:12:47.040174] [DEBUG] [LOCAL ] GMED: Primary data saved (48602 records). [2025-10-16T19:12:47.040321] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-16T19:12:47.040963] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMED took 30.1s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-16T19:12:47.147958] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-16T19:12:47.214141] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:47.255469] [DEBUG] [LOCAL ] GNK: Loaded 40065 existing records from primary storage. [2025-10-16T19:12:47.255829] [INFO ] [MAIN ] GNK: Loaded 40065 existing records. [2025-10-16T19:12:47.433561] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:47.433824] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-16T19:12:47.433874] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-16T19:12:47.434058] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-16T19:12:47.434096] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-16T19:12:47.805147] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:47.945040] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-16T19:12:47.948293] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T19:12:48.339953] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:12:48.742865] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-16T19:12:49.420470] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:12:49.542780] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-16T19:12:49.811471] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:12:50.342859] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-16T19:12:51.142828] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-16T19:12:51.843285] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:12:51.942774] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-16T19:12:52.071447] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:12:52.328748] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-16T19:12:52.742808] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-16T19:12:53.038338] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:12:53.542842] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-16T19:12:54.124608] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:12:54.179114] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:12:54.342808] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-16T19:12:55.142838] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-16T19:12:55.319085] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:12:55.321275] [INFO ] [REMOTE ] GNE: Full fetch complete (22508 records). [2025-10-16T19:12:55.321344] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-16T19:12:55.681150] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-16T19:12:55.681225] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-16T19:12:55.681744] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-16T19:12:55.681805] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-16T19:12:55.682452] [DEBUG] [LOCAL ] GNE: Trimmed 22508 records to 18130 (keeping 200 days of data) [2025-10-16T19:12:55.789701] [DEBUG] [LOCAL ] GNE: Primary data saved (18130 records). [2025-10-16T19:12:55.789838] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-16T19:12:55.789915] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 21.5s. Estimated remaining: 3h 20m 13s. Rate: 7.1 symbols/min [2025-10-16T19:12:55.954854] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-16T19:12:55.957536] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:12:56.004631] [DEBUG] [LOCAL ] GNL: Loaded 46728 existing records from primary storage. [2025-10-16T19:12:56.004984] [INFO ] [MAIN ] GNL: Loaded 46728 existing records. [2025-10-16T19:12:56.180146] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:12:56.180356] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-16T19:12:56.180402] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-16T19:12:56.180672] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-16T19:12:56.180729] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-16T19:12:56.540977] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:12:56.564142] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T19:12:56.742799] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-16T19:12:57.542839] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-16T19:12:58.276884] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:12:58.342627] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T19:12:58.342807] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-16T19:12:58.995014] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:12:59.142770] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-16T19:12:59.891237] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:12:59.942800] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-16T19:13:00.493637] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:13:00.742859] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-16T19:13:01.423323] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:13:01.542828] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-16T19:13:01.987300] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:13:02.342825] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-16T19:13:03.142865] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-16T19:13:03.563374] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:13:03.942827] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-16T19:13:04.180971] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-16T19:13:04.677862] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T19:13:04.742778] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-16T19:13:05.133964] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:13:05.542817] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-16T19:13:06.127202] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:13:06.131000] [INFO ] [REMOTE ] GMRE: Full fetch complete (52567 records). [2025-10-16T19:13:06.131098] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-16T19:13:06.351505] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-16T19:13:06.509241] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-16T19:13:06.509328] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-16T19:13:06.510096] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-16T19:13:06.510162] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-16T19:13:06.511298] [DEBUG] [LOCAL ] GMRE: Trimmed 52567 records to 37278 (keeping 200 days of data) [2025-10-16T19:13:06.731155] [DEBUG] [LOCAL ] GMRE: Primary data saved (37278 records). [2025-10-16T19:13:06.731883] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-16T19:13:06.731977] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GMRE took 38.1s. Estimated remaining: 3h 20m 8s. Rate: 7.1 symbols/min [2025-10-16T19:13:06.896598] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:06.938638] [DEBUG] [LOCAL ] GNRC: Loaded 45508 existing records from primary storage. [2025-10-16T19:13:06.938959] [INFO ] [MAIN ] GNRC: Loaded 45508 existing records. [2025-10-16T19:13:07.136666] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:07.137117] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-16T19:13:07.137245] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-16T19:13:07.137528] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-16T19:13:07.137608] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-16T19:13:07.142976] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-16T19:13:07.438351] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:13:07.682171] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:07.876592] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T19:13:07.942888] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-16T19:13:08.742882] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-16T19:13:09.449297] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:13:09.542807] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-16T19:13:09.639042] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-16T19:13:09.646480] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-16T19:13:09.646639] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-16T19:13:09.986763] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T19:13:10.094889] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-16T19:13:10.094995] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-16T19:13:10.096163] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-16T19:13:10.096241] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-16T19:13:10.097900] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 54171 (keeping 200 days of data) [2025-10-16T19:13:10.382334] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-16T19:13:10.434544] [DEBUG] [LOCAL ] GME: Primary data saved (54171 records). [2025-10-16T19:13:10.434706] [INFO ] [MAIN ] GME: Full history saved. [2025-10-16T19:13:10.435545] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GME took 56.5s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-16T19:13:10.603763] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:10.614795] [DEBUG] [LOCAL ] GNT: Loaded 8426 existing records from primary storage. [2025-10-16T19:13:10.615016] [INFO ] [MAIN ] GNT: Loaded 8426 existing records. [2025-10-16T19:13:10.787488] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:10.787730] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-16T19:13:10.787783] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-16T19:13:10.787945] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-16T19:13:10.787999] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-16T19:13:11.136420] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:11.142775] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-16T19:13:11.233369] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:13:11.586920] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:13:11.593474] [INFO ] [REMOTE ] GNK: Full fetch complete (57305 records). [2025-10-16T19:13:11.593598] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-16T19:13:11.732405] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:13:11.947947] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-16T19:13:11.998710] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-16T19:13:11.998794] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-16T19:13:11.999728] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-16T19:13:11.999790] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-16T19:13:12.000992] [DEBUG] [LOCAL ] GNK: Trimmed 57305 records to 40280 (keeping 200 days of data) [2025-10-16T19:13:12.238634] [DEBUG] [LOCAL ] GNK: Primary data saved (40280 records). [2025-10-16T19:13:12.238810] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-16T19:13:12.239459] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNK took 25.2s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-16T19:13:12.403193] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:12.455516] [DEBUG] [LOCAL ] GNW: Loaded 51403 existing records from primary storage. [2025-10-16T19:13:12.455909] [INFO ] [MAIN ] GNW: Loaded 51403 existing records. [2025-10-16T19:13:12.629315] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:12.629591] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-16T19:13:12.629681] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-16T19:13:12.629908] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-16T19:13:12.629964] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-16T19:13:12.734812] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T19:13:12.747894] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-16T19:13:12.999960] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:13.542847] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-16T19:13:14.342817] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-16T19:13:14.417232] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:13:15.142871] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-16T19:13:15.322125] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:13:15.942833] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-16T19:13:15.974977] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:13:16.742789] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-16T19:13:16.770741] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T19:13:17.137702] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-16T19:13:17.243118] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-16T19:13:17.542794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-16T19:13:18.342829] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-16T19:13:18.803265] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:13:18.804056] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:13:19.142857] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-16T19:13:19.942838] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-16T19:13:20.706921] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:13:20.742769] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-16T19:13:21.551989] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-16T19:13:21.559316] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:13:22.012223] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T19:13:22.342812] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-16T19:13:23.044883] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-16T19:13:23.142803] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-16T19:13:23.573904] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:13:23.942835] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-16T19:13:24.508937] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:13:24.742865] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-16T19:13:25.259861] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:13:25.265744] [INFO ] [REMOTE ] GNL: Full fetch complete (68190 records). [2025-10-16T19:13:25.265844] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-16T19:13:25.547954] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-16T19:13:25.651311] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-16T19:13:25.651387] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-16T19:13:25.652383] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-16T19:13:25.652447] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-16T19:13:25.653737] [DEBUG] [LOCAL ] GNL: Trimmed 68190 records to 47059 (keeping 200 days of data) [2025-10-16T19:13:25.926005] [DEBUG] [LOCAL ] GNL: Primary data saved (47059 records). [2025-10-16T19:13:25.926142] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-16T19:13:25.926625] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 30.1s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-16T19:13:26.105957] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:26.148946] [DEBUG] [LOCAL ] GOF: Loaded 42604 existing records from primary storage. [2025-10-16T19:13:26.149242] [INFO ] [MAIN ] GOF: Loaded 42604 existing records. [2025-10-16T19:13:26.332223] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:26.340706] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:13:26.341174] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-16T19:13:26.343449] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-16T19:13:26.343922] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-16T19:13:26.345684] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-16T19:13:26.345872] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-16T19:13:26.476558] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:13:26.739226] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:27.142859] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-16T19:13:27.942839] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-16T19:13:28.073728] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:13:28.742868] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-16T19:13:28.821949] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:13:29.322084] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:13:29.542802] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-16T19:13:30.272610] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:13:30.342801] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-16T19:13:31.119892] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:13:31.142777] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-16T19:13:31.504122] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:13:31.942902] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-16T19:13:32.692178] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:13:32.742874] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-16T19:13:33.465846] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:13:33.518171] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:13:33.542788] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-16T19:13:34.342841] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-16T19:13:34.352286] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:13:35.142839] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-16T19:13:35.942830] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-16T19:13:36.005629] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:13:36.742806] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-16T19:13:36.814809] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T19:13:37.325348] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-16T19:13:37.503280] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:13:37.542801] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-16T19:13:38.169352] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-16T19:13:38.342807] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-16T19:13:39.142845] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-16T19:13:39.924344] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:13:39.942775] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-16T19:13:40.043783] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:13:40.742887] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-16T19:13:40.761124] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T19:13:40.763144] [INFO ] [REMOTE ] GNT: Full fetch complete (11242 records). [2025-10-16T19:13:40.763253] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-16T19:13:41.144928] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-16T19:13:41.145009] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-16T19:13:41.145354] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-16T19:13:41.145417] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-16T19:13:41.145955] [DEBUG] [LOCAL ] GNT: Trimmed 11242 records to 8541 (keeping 200 days of data) [2025-10-16T19:13:41.196512] [DEBUG] [LOCAL ] GNT: Primary data saved (8541 records). [2025-10-16T19:13:41.196683] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-16T19:13:41.196806] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNT took 30.8s. Estimated remaining: 3h 19m 36s. Rate: 7.1 symbols/min [2025-10-16T19:13:41.377788] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:41.409247] [DEBUG] [LOCAL ] GOLF: Loaded 30944 existing records from primary storage. [2025-10-16T19:13:41.409522] [INFO ] [MAIN ] GOLF: Loaded 30944 existing records. [2025-10-16T19:13:41.557572] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-16T19:13:41.605277] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:41.605576] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-16T19:13:41.605627] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-16T19:13:41.605891] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-16T19:13:41.605948] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-16T19:13:41.966073] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:42.342805] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-16T19:13:42.453316] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:13:43.028153] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:13:43.142809] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-16T19:13:43.415384] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-16T19:13:43.942822] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-16T19:13:44.291596] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:13:44.742821] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-16T19:13:45.542786] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-16T19:13:45.684609] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:13:45.770056] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:13:46.342842] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-16T19:13:47.146871] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-16T19:13:47.152110] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T19:13:47.376539] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T19:13:47.942820] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-16T19:13:48.742790] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-16T19:13:48.979312] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-16T19:13:48.985435] [INFO ] [REMOTE ] GNRC: Full fetch complete (65713 records). [2025-10-16T19:13:48.985619] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-16T19:13:49.429903] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-16T19:13:49.430002] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-16T19:13:49.431040] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-16T19:13:49.431166] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-16T19:13:49.432813] [DEBUG] [LOCAL ] GNRC: Trimmed 65713 records to 45849 (keeping 200 days of data) [2025-10-16T19:13:49.544775] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-16T19:13:49.552570] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:13:49.745033] [DEBUG] [LOCAL ] GNRC: Primary data saved (45849 records). [2025-10-16T19:13:49.745175] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-16T19:13:49.745257] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNRC took 43.0s. Estimated remaining: 3h 19m 27s. Rate: 7.1 symbols/min [2025-10-16T19:13:49.922544] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:49.964914] [DEBUG] [LOCAL ] GOOS: Loaded 44661 existing records from primary storage. [2025-10-16T19:13:49.965201] [INFO ] [MAIN ] GOOS: Loaded 44661 existing records. [2025-10-16T19:13:50.149810] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:50.150091] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-16T19:13:50.150212] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-16T19:13:50.150560] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-16T19:13:50.150629] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-16T19:13:50.348463] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-16T19:13:50.517892] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:13:50.563010] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:50.676814] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:13:51.142812] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-16T19:13:51.942826] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-16T19:13:52.169936] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:13:52.517996] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-16T19:13:52.742830] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-16T19:13:53.368005] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:13:53.542808] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-16T19:13:53.942829] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T19:13:54.342810] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-16T19:13:55.142810] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-16T19:13:55.364708] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:13:55.703197] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-16T19:13:55.942813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-16T19:13:56.284172] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:13:56.742812] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-16T19:13:57.470347] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:13:57.476845] [INFO ] [REMOTE ] GOF: Full fetch complete (62389 records). [2025-10-16T19:13:57.476995] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-16T19:13:57.555204] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-16T19:13:57.935054] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-16T19:13:57.935144] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-16T19:13:57.936182] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-16T19:13:57.936246] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-16T19:13:57.937513] [DEBUG] [LOCAL ] GOF: Trimmed 62389 records to 42964 (keeping 200 days of data) [2025-10-16T19:13:58.215421] [DEBUG] [LOCAL ] GOF: Primary data saved (42964 records). [2025-10-16T19:13:58.215567] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-16T19:13:58.216097] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 32.3s. Estimated remaining: 3h 19m 19s. Rate: 7.1 symbols/min [2025-10-16T19:13:58.359763] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-16T19:13:58.445488] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:13:58.447964] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T19:13:58.489508] [DEBUG] [LOCAL ] GOTU: Loaded 37301 existing records from primary storage. [2025-10-16T19:13:58.489842] [INFO ] [MAIN ] GOTU: Loaded 37301 existing records. [2025-10-16T19:13:58.662301] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:13:58.662526] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-16T19:13:58.662572] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-16T19:13:58.662782] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-16T19:13:58.662861] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-16T19:13:59.019544] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:13:59.048825] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:13:59.142792] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-16T19:13:59.669071] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-16T19:13:59.942872] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-16T19:14:00.640433] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:14:00.652243] [INFO ] [REMOTE ] GNW: Full fetch complete (73880 records). [2025-10-16T19:14:00.652549] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-16T19:14:00.756291] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-16T19:14:01.141241] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-16T19:14:01.141320] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-16T19:14:01.142304] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-16T19:14:01.142370] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-16T19:14:01.143786] [DEBUG] [LOCAL ] GNW: Trimmed 73880 records to 51779 (keeping 200 days of data) [2025-10-16T19:14:01.463269] [DEBUG] [LOCAL ] GNW: Primary data saved (51779 records). [2025-10-16T19:14:01.463572] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-16T19:14:01.464219] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 49.2s. Estimated remaining: 3h 19m 3s. Rate: 7.1 symbols/min [2025-10-16T19:14:01.559341] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-16T19:14:01.618060] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:14:01.696987] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:01.744089] [DEBUG] [LOCAL ] GPC: Loaded 46017 existing records from primary storage. [2025-10-16T19:14:01.744442] [INFO ] [MAIN ] GPC: Loaded 46017 existing records. [2025-10-16T19:14:01.923858] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:01.924118] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-16T19:14:01.924167] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-16T19:14:01.924401] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-16T19:14:01.924459] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-16T19:14:02.322101] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T19:14:02.325309] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:02.342766] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-16T19:14:03.142791] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-16T19:14:03.215918] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:14:03.942796] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-16T19:14:03.972537] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:14:04.106409] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:14:04.742861] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-16T19:14:05.283041] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:14:05.477892] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-16T19:14:05.542812] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-16T19:14:06.342832] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-16T19:14:06.846590] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:14:06.850934] [INFO ] [REMOTE ] GOLF: Full fetch complete (45367 records). [2025-10-16T19:14:06.851057] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-16T19:14:07.148807] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-16T19:14:07.235293] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-16T19:14:07.235363] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-16T19:14:07.236085] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-16T19:14:07.236148] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-16T19:14:07.237131] [DEBUG] [LOCAL ] GOLF: Trimmed 45367 records to 31115 (keeping 200 days of data) [2025-10-16T19:14:07.423121] [DEBUG] [LOCAL ] GOLF: Primary data saved (31115 records). [2025-10-16T19:14:07.423248] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-16T19:14:07.423340] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOLF took 26.2s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-16T19:14:07.589327] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:07.605040] [DEBUG] [LOCAL ] GPI: Loaded 14894 existing records from primary storage. [2025-10-16T19:14:07.605258] [INFO ] [MAIN ] GPI: Loaded 14894 existing records. [2025-10-16T19:14:07.782587] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:07.782865] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-16T19:14:07.782938] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-16T19:14:07.783181] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-16T19:14:07.783237] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-16T19:14:07.943279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-16T19:14:08.140920] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:08.166910] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:14:08.742786] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-16T19:14:08.799289] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:14:09.317100] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:14:09.542797] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-16T19:14:09.601078] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:14:10.342807] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-16T19:14:10.877567] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:14:11.142796] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-16T19:14:11.279062] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T19:14:11.942825] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-16T19:14:12.588379] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-16T19:14:12.742811] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-16T19:14:12.863606] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:14:13.542811] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-16T19:14:14.241460] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:14:14.342816] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-16T19:14:14.855216] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:14:15.142788] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-16T19:14:15.942794] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-16T19:14:16.018160] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:14:16.672621] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-16T19:14:16.727208] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T19:14:16.742764] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-16T19:14:17.542791] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-16T19:14:17.889071] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T19:14:18.342809] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-16T19:14:19.055754] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:14:19.142775] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-16T19:14:19.200833] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:14:19.942816] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-16T19:14:20.614346] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:14:20.742817] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-16T19:14:21.376811] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:14:21.381953] [INFO ] [REMOTE ] GOOS: Full fetch complete (64904 records). [2025-10-16T19:14:21.382056] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-16T19:14:21.555976] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-16T19:14:21.776772] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-16T19:14:21.776853] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-16T19:14:21.777757] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-16T19:14:21.777818] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-16T19:14:21.779161] [DEBUG] [LOCAL ] GOOS: Trimmed 64904 records to 44895 (keeping 200 days of data) [2025-10-16T19:14:22.038858] [DEBUG] [LOCAL ] GOOS: Primary data saved (44895 records). [2025-10-16T19:14:22.038995] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-16T19:14:22.039077] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOOS took 32.3s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-16T19:14:22.217619] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:22.225818] [DEBUG] [LOCAL ] GPJA: Loaded 4202 existing records from primary storage. [2025-10-16T19:14:22.226015] [INFO ] [MAIN ] GPJA: Loaded 4202 existing records. [2025-10-16T19:14:22.355202] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-16T19:14:22.446021] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:22.446421] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-16T19:14:22.446579] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-16T19:14:22.449291] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-16T19:14:22.449221] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T19:14:22.449407] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-16T19:14:22.767899] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:14:22.839477] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:23.142873] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-16T19:14:23.925565] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T19:14:23.942777] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-16T19:14:24.742873] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-16T19:14:24.811898] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:14:25.542814] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-16T19:14:25.713051] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:14:26.247061] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-16T19:14:26.342851] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-16T19:14:26.794071] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-16T19:14:27.142838] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-16T19:14:27.681323] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T19:14:27.942819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-16T19:14:28.467515] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:14:28.742870] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-16T19:14:29.353598] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:14:29.354317] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T19:14:29.542823] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-16T19:14:30.342822] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-16T19:14:30.495474] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T19:14:31.142818] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-16T19:14:31.548040] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-16T19:14:31.942869] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-16T19:14:32.434747] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:14:32.725289] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:14:32.742765] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-16T19:14:33.101145] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-16T19:14:33.542814] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-16T19:14:34.126940] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:14:34.342810] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-16T19:14:35.142877] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-16T19:14:35.895977] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T19:14:35.930729] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:14:35.942776] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-16T19:14:36.742832] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-16T19:14:37.542860] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-16T19:14:37.557912] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:14:37.583565] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T19:14:37.591994] [INFO ] [REMOTE ] GPC: Full fetch complete (68708 records). [2025-10-16T19:14:37.592179] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-16T19:14:37.994116] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-16T19:14:37.994211] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-16T19:14:37.995144] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-16T19:14:37.995206] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-16T19:14:37.996584] [DEBUG] [LOCAL ] GPC: Trimmed 68708 records to 46350 (keeping 200 days of data) [2025-10-16T19:14:38.330313] [DEBUG] [LOCAL ] GPC: Primary data saved (46350 records). [2025-10-16T19:14:38.330482] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-16T19:14:38.330585] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPC took 36.9s. Estimated remaining: 3h 18m 55s. Rate: 7.1 symbols/min [2025-10-16T19:14:38.351541] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-16T19:14:38.508193] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:14:38.557571] [DEBUG] [LOCAL ] GPK: Loaded 52775 existing records from primary storage. [2025-10-16T19:14:38.557937] [INFO ] [MAIN ] GPK: Loaded 52775 existing records. [2025-10-16T19:14:38.747249] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:14:38.747614] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-16T19:14:38.747709] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-16T19:14:38.747921] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-16T19:14:38.747977] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-16T19:14:38.949458] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-16T19:14:39.144502] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-16T19:14:39.157185] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-16T19:14:39.160506] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:14:39.942788] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-16T19:14:40.254864] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:14:40.257476] [INFO ] [REMOTE ] GPI: Full fetch complete (21638 records). [2025-10-16T19:14:40.257558] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-16T19:14:40.637526] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-16T19:14:40.637610] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-16T19:14:40.638127] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-16T19:14:40.638188] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-16T19:14:40.638852] [DEBUG] [LOCAL ] GPI: Trimmed 21638 records to 15026 (keeping 200 days of data) [2025-10-16T19:14:40.730923] [DEBUG] [LOCAL ] GPI: Primary data saved (15026 records). [2025-10-16T19:14:40.731068] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-16T19:14:40.731150] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GPI took 33.3s. Estimated remaining: 3h 18m 37s. Rate: 7.1 symbols/min [2025-10-16T19:14:40.742777] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-16T19:14:41.315203] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:14:41.542832] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-16T19:14:42.171715] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:14:42.176321] [INFO ] [REMOTE ] GOTU: Full fetch complete (58581 records). [2025-10-16T19:14:42.176463] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-16T19:14:42.349685] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-16T19:14:42.577065] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-16T19:14:42.577150] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-16T19:14:42.578104] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-16T19:14:42.578169] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-16T19:14:42.579401] [DEBUG] [LOCAL ] GOTU: Trimmed 58581 records to 37487 (keeping 200 days of data) [2025-10-16T19:14:42.800780] [DEBUG] [LOCAL ] GOTU: Primary data saved (37487 records). [2025-10-16T19:14:42.800981] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-16T19:14:42.801083] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GOTU took 44.6s. Estimated remaining: 3h 18m 19s. Rate: 7.1 symbols/min [2025-10-16T19:14:42.989522] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T19:14:43.148046] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-16T19:14:43.168717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-16T19:14:43.788721] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T19:14:43.942853] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-16T19:14:44.336442] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-16T19:14:44.742907] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-16T19:14:45.542817] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-16T19:14:46.122050] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:14:46.135745] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-16T19:14:46.342809] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-16T19:14:47.025967] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:14:47.026907] [INFO ] [REMOTE ] GPJA: Full fetch complete (6986 records). [2025-10-16T19:14:47.026974] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-16T19:14:47.147973] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-16T19:14:47.385255] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-16T19:14:47.385353] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-16T19:14:47.385566] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-16T19:14:47.385634] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-16T19:14:47.386073] [DEBUG] [LOCAL ] GPJA: Trimmed 6986 records to 4213 (keeping 200 days of data) [2025-10-16T19:14:47.411561] [DEBUG] [LOCAL ] GPJA: Primary data saved (4213 records). [2025-10-16T19:14:47.411660] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-16T19:14:47.411751] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPJA took 25.4s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-16T19:14:48.913214] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-16T19:14:48.923996] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-16T19:14:50.340835] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:14:50.351585] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-16T19:14:52.129723] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:14:52.142440] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-16T19:14:53.790914] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:14:53.801588] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-16T19:14:55.552846] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:14:55.564808] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-16T19:14:57.340224] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:14:57.351915] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-16T19:14:59.039908] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:14:59.051455] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-16T19:15:00.842239] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:15:00.849115] [INFO ] [REMOTE ] GPK: Full fetch complete (75965 records). [2025-10-16T19:15:00.849251] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-16T19:15:01.292699] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-16T19:15:01.292795] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-16T19:15:01.294025] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-16T19:15:01.294093] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-16T19:15:01.295707] [DEBUG] [LOCAL ] GPK: Trimmed 75965 records to 53165 (keeping 200 days of data) [2025-10-16T19:15:01.661680] [DEBUG] [LOCAL ] GPK: Primary data saved (53165 records). [2025-10-16T19:15:01.661866] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-16T19:15:01.662427] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 23.3s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-16T19:15:02.424254] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.448717] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.417702] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.425189] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:02.499847] [DEBUG] [LOCAL ] GPOR: Loaded 23324 existing records from primary storage. [2025-10-16T19:15:02.500562] [DEBUG] [LOCAL ] GPMT: Loaded 25932 existing records from primary storage. [2025-10-16T19:15:02.501015] [INFO ] [MAIN ] GPMT: Loaded 25932 existing records. [2025-10-16T19:15:02.501129] [INFO ] [MAIN ] GPOR: Loaded 23324 existing records. [2025-10-16T19:15:02.734249] [DEBUG] [LOCAL ] GPN: Loaded 52001 existing records from primary storage. [2025-10-16T19:15:02.748200] [DEBUG] [LOCAL ] GPRK: Loaded 39736 existing records from primary storage. [2025-10-16T19:15:02.765038] [INFO ] [MAIN ] GPN: Loaded 52001 existing records. [2025-10-16T19:15:02.780912] [INFO ] [MAIN ] GPRK: Loaded 39736 existing records. [2025-10-16T19:15:03.118637] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.173978] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.174502] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.175008] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.174832] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-16T19:15:03.185897] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-16T19:15:03.201671] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-16T19:15:03.212133] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-16T19:15:03.217378] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-16T19:15:03.246030] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-16T19:15:03.518704] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.464369] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:03.548246] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.556994] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-16T19:15:03.562845] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-16T19:15:03.566383] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-16T19:15:03.611533] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-16T19:15:03.642896] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-16T19:15:03.632493] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-16T19:15:03.661694] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-16T19:15:04.526760] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.594561] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.643961] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-16T19:15:04.658278] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-16T19:15:04.915284] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.917188] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-16T19:15:04.938204] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:04.938614] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-16T19:15:05.684233] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:15:05.690067] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-16T19:15:05.883553] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T19:15:05.891771] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-16T19:15:05.992787] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:15:05.998393] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-16T19:15:06.597039] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:15:06.607221] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-16T19:15:06.646622] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:15:06.651796] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-16T19:15:07.329137] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:15:07.335407] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-16T19:15:07.431921] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-16T19:15:07.440857] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-16T19:15:07.543064] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-16T19:15:07.547935] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-16T19:15:07.819020] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T19:15:07.828969] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-16T19:15:08.423203] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:15:08.428621] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-16T19:15:08.639444] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T19:15:08.644331] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-16T19:15:08.790346] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:15:08.798197] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-16T19:15:09.061356] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:15:09.072604] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-16T19:15:09.515579] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:15:09.523771] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-16T19:15:09.855037] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-16T19:15:09.862189] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-16T19:15:09.890014] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:15:09.898938] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-16T19:15:10.506836] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:15:10.519410] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-16T19:15:10.547033] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-16T19:15:10.555111] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-16T19:15:10.671192] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-16T19:15:11.142883] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-16T19:15:11.242071] [DEBUG] [REMOTE ] GPOR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-16T19:15:11.242712] [WARN ] [REMOTE ] GPOR: No data returned for month 2025-05 [2025-10-16T19:15:11.242848] [FATAL] [REMOTE ] GPOR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:15:11.242998] [FATAL] [MAIN ] GPOR: Failed to fetch primary data. [2025-10-16T19:15:11.243088] [WARN ] [MAIN ] GPOR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:15:11.243181] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-16T19:15:11.243282] [DEBUG] [LOCAL ] GPOR: No primary data file found to delete. [2025-10-16T19:15:11.243346] [INFO ] [LOCAL ] GPOR: Starting deletion of derivative data. [2025-10-16T19:15:11.243591] [DEBUG] [LOCAL ] GPOR: Deleted derivative data file. [2025-10-16T19:15:11.243749] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPOR took 9.6s. Estimated remaining: 3h 17m 59s. Rate: 7.1 symbols/min [2025-10-16T19:15:11.460614] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:15:11.490866] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:11.522164] [DEBUG] [LOCAL ] GRBK: Loaded 27164 existing records from primary storage. [2025-10-16T19:15:11.522562] [INFO ] [MAIN ] GRBK: Loaded 27164 existing records. [2025-10-16T19:15:11.705797] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:11.706168] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-16T19:15:11.706249] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-16T19:15:11.706542] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-16T19:15:11.706619] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-16T19:15:11.875601] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:15:11.947952] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-16T19:15:12.110739] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:12.393051] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T19:15:12.742849] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-16T19:15:13.232783] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:15:13.542854] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-16T19:15:14.342775] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-16T19:15:14.545700] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:15:14.956954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:15:15.142803] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-16T19:15:15.618193] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:15:15.942839] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-16T19:15:16.683252] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:15:16.742783] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-16T19:15:17.246377] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:15:17.542847] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-16T19:15:17.846227] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T19:15:18.342804] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-16T19:15:19.074536] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:15:19.142806] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-16T19:15:19.382058] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T19:15:19.942811] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-16T19:15:20.742820] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-16T19:15:20.954374] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:15:21.012753] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-16T19:15:21.542877] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-16T19:15:22.157128] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:15:22.342836] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-16T19:15:22.540462] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:15:23.142865] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-16T19:15:23.811017] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-16T19:15:23.937592] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:15:23.942781] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-16T19:15:23.943180] [INFO ] [REMOTE ] GPRK: Full fetch complete (58153 records). [2025-10-16T19:15:23.944448] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-16T19:15:24.320993] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-16T19:15:24.321071] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-16T19:15:24.321953] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-16T19:15:24.322016] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-16T19:15:24.323238] [DEBUG] [LOCAL ] GPRK: Trimmed 58153 records to 40056 (keeping 200 days of data) [2025-10-16T19:15:24.548151] [DEBUG] [LOCAL ] GPRK: Primary data saved (40056 records). [2025-10-16T19:15:24.548333] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-16T19:15:24.548756] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPRK took 22.9s. Estimated remaining: 3h 17m 57s. Rate: 7.1 symbols/min [2025-10-16T19:15:24.715535] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:24.727712] [DEBUG] [LOCAL ] GRC: Loaded 9292 existing records from primary storage. [2025-10-16T19:15:24.727933] [INFO ] [MAIN ] GRC: Loaded 9292 existing records. [2025-10-16T19:15:24.748042] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-16T19:15:24.906593] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:24.906802] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-16T19:15:24.906849] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-16T19:15:24.906988] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-16T19:15:24.907025] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-16T19:15:25.266673] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:25.283383] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:15:25.542880] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-16T19:15:26.342850] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-16T19:15:26.363212] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:15:26.619168] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-16T19:15:27.142805] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-16T19:15:27.342944] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:15:27.904439] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:15:27.942822] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-16T19:15:28.742844] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-16T19:15:29.542832] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-16T19:15:29.664220] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:15:29.667226] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:15:29.680137] [INFO ] [REMOTE ] GPMT: Full fetch complete (36701 records). [2025-10-16T19:15:29.680364] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-16T19:15:30.041254] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-16T19:15:30.041364] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-16T19:15:30.042080] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-16T19:15:30.042141] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-16T19:15:30.043130] [DEBUG] [LOCAL ] GPMT: Trimmed 36701 records to 26072 (keeping 200 days of data) [2025-10-16T19:15:30.190933] [DEBUG] [LOCAL ] GPMT: Primary data saved (26072 records). [2025-10-16T19:15:30.191063] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-16T19:15:30.191141] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPMT took 28.5s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-16T19:15:30.354032] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-16T19:15:30.356622] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:30.381274] [DEBUG] [LOCAL ] GRDN: Loaded 20984 existing records from primary storage. [2025-10-16T19:15:30.381505] [INFO ] [MAIN ] GRDN: Loaded 20984 existing records. [2025-10-16T19:15:30.560681] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:30.561093] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-16T19:15:30.561224] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-16T19:15:30.561448] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-16T19:15:30.561579] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-16T19:15:30.667531] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:15:30.938364] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:31.101134] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:15:31.142790] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-16T19:15:31.942828] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-16T19:15:32.222041] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:15:32.398776] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-16T19:15:32.742814] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-16T19:15:33.542867] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-16T19:15:34.342882] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-16T19:15:34.530872] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:15:34.541348] [INFO ] [REMOTE ] GPN: Full fetch complete (75111 records). [2025-10-16T19:15:34.541536] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-16T19:15:34.885294] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-16T19:15:34.965821] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-16T19:15:34.965910] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-16T19:15:34.966899] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-16T19:15:34.966962] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-16T19:15:34.968404] [DEBUG] [LOCAL ] GPN: Trimmed 75111 records to 52372 (keeping 200 days of data) [2025-10-16T19:15:35.148258] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-16T19:15:35.209006] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T19:15:35.303869] [DEBUG] [LOCAL ] GPN: Primary data saved (52372 records). [2025-10-16T19:15:35.304005] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-16T19:15:35.305095] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 33.6s. Estimated remaining: 3h 17m 32s. Rate: 7.1 symbols/min [2025-10-16T19:15:35.499902] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:35.542508] [DEBUG] [LOCAL ] GRMN: Loaded 40425 existing records from primary storage. [2025-10-16T19:15:35.542813] [INFO ] [MAIN ] GRMN: Loaded 40425 existing records. [2025-10-16T19:15:35.721455] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:35.721732] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-16T19:15:35.721787] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-16T19:15:35.721969] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-16T19:15:35.722007] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-16T19:15:35.946032] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-16T19:15:36.093637] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:36.095342] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-16T19:15:36.742876] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-16T19:15:36.763517] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T19:15:37.542918] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-16T19:15:37.556073] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:15:38.126167] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:15:38.343121] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-16T19:15:38.865472] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-16T19:15:39.142930] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-16T19:15:39.942853] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-16T19:15:40.201705] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:15:40.691341] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T19:15:40.742847] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-16T19:15:41.542851] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-16T19:15:41.972722] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:15:42.342812] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-16T19:15:42.449081] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T19:15:43.142847] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-16T19:15:43.436941] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:15:43.942838] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-16T19:15:44.542240] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:15:44.742890] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-16T19:15:44.908289] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:15:44.917081] [INFO ] [REMOTE ] GRBK: Full fetch complete (40406 records). [2025-10-16T19:15:44.917397] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-16T19:15:45.461391] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-16T19:15:45.461502] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-16T19:15:45.462949] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-16T19:15:45.463018] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-16T19:15:45.464371] [DEBUG] [LOCAL ] GRBK: Trimmed 40406 records to 27274 (keeping 200 days of data) [2025-10-16T19:15:45.554437] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-16T19:15:45.632123] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:15:45.649186] [DEBUG] [LOCAL ] GRBK: Primary data saved (27274 records). [2025-10-16T19:15:45.649352] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-16T19:15:45.649444] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRBK took 34.4s. Estimated remaining: 3h 17m 26s. Rate: 7.1 symbols/min [2025-10-16T19:15:45.821012] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:45.866515] [DEBUG] [LOCAL ] GRND: Loaded 50119 existing records from primary storage. [2025-10-16T19:15:45.866888] [INFO ] [MAIN ] GRND: Loaded 50119 existing records. [2025-10-16T19:15:46.045153] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:46.045396] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-16T19:15:46.045445] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-16T19:15:46.045633] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-16T19:15:46.045735] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-16T19:15:46.347963] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-16T19:15:46.417545] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:46.515998] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-16T19:15:47.079467] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:15:47.081605] [INFO ] [REMOTE ] GRC: Full fetch complete (13359 records). [2025-10-16T19:15:47.081728] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-16T19:15:47.147963] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-16T19:15:47.453057] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-16T19:15:47.453133] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-16T19:15:47.453458] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-16T19:15:47.453497] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-16T19:15:47.454030] [DEBUG] [LOCAL ] GRC: Trimmed 13359 records to 9376 (keeping 200 days of data) [2025-10-16T19:15:47.511196] [DEBUG] [LOCAL ] GRC: Primary data saved (9376 records). [2025-10-16T19:15:47.511344] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-16T19:15:47.511428] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRC took 23.0s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-16T19:15:47.706960] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:15:47.741314] [DEBUG] [LOCAL ] GRNT: Loaded 33966 existing records from primary storage. [2025-10-16T19:15:47.741665] [INFO ] [MAIN ] GRNT: Loaded 33966 existing records. [2025-10-16T19:15:47.944894] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-16T19:15:47.944755] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:15:47.946262] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-16T19:15:47.946334] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-16T19:15:47.946512] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-16T19:15:47.946552] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-16T19:15:48.311573] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:15:48.742848] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-16T19:15:48.789044] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:15:49.144209] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:15:49.542879] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-16T19:15:49.664930] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-16T19:15:50.342815] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-16T19:15:51.114090] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:15:51.142814] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-16T19:15:51.375019] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:15:51.942828] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-16T19:15:52.566551] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-16T19:15:52.742845] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-16T19:15:53.503390] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:15:53.542821] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-16T19:15:53.752155] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:15:54.342824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-16T19:15:54.830780] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:15:55.142818] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-16T19:15:55.650372] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:15:55.942833] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-16T19:15:56.742822] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-16T19:15:56.869117] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:15:57.363442] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:15:57.542854] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-16T19:15:58.028197] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:15:58.342828] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-16T19:15:58.771268] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:15:59.142840] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-16T19:15:59.571188] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-16T19:15:59.942856] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-16T19:16:00.742840] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-16T19:16:00.946254] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:16:01.016161] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:16:01.542846] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-16T19:16:02.101296] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T19:16:02.342824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-16T19:16:02.789895] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:16:03.142818] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-16T19:16:03.329917] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:16:03.942880] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-16T19:16:04.742859] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-16T19:16:05.054338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-16T19:16:05.086193] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T19:16:05.542874] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-16T19:16:05.738822] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:16:05.742161] [INFO ] [REMOTE ] GRDN: Full fetch complete (26350 records). [2025-10-16T19:16:05.742279] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-16T19:16:06.111151] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-16T19:16:06.111231] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-16T19:16:06.111817] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-16T19:16:06.111880] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-16T19:16:06.112600] [DEBUG] [LOCAL ] GRDN: Trimmed 26350 records to 21092 (keeping 200 days of data) [2025-10-16T19:16:06.235845] [DEBUG] [LOCAL ] GRDN: Primary data saved (21092 records). [2025-10-16T19:16:06.236013] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-16T19:16:06.236114] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 36.0s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-16T19:16:06.348050] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-16T19:16:06.421939] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:06.433598] [DEBUG] [LOCAL ] GROV: Loaded 8760 existing records from primary storage. [2025-10-16T19:16:06.433881] [INFO ] [MAIN ] GROV: Loaded 8760 existing records. [2025-10-16T19:16:06.614003] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:06.614283] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-16T19:16:06.614340] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-16T19:16:06.614507] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-16T19:16:06.614574] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-16T19:16:06.983000] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:07.002608] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:16:07.142809] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-16T19:16:07.942783] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-16T19:16:08.055380] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:16:08.342514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T19:16:08.473056] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T19:16:08.742837] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-16T19:16:09.542825] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-16T19:16:10.090804] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:16:10.219923] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-16T19:16:10.342868] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-16T19:16:11.142812] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-16T19:16:11.939044] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:11.942778] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-16T19:16:12.531426] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-16T19:16:12.704839] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:16:12.742798] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-16T19:16:13.542844] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-16T19:16:14.335160] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:16:14.343994] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-16T19:16:14.380965] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:16:15.142846] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-16T19:16:15.548948] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:16:15.644219] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-16T19:16:15.942824] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-16T19:16:16.742864] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-16T19:16:17.306898] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:16:17.542834] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-16T19:16:18.299247] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:16:18.343925] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-16T19:16:18.345827] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T19:16:19.142815] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-16T19:16:19.408301] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:16:19.412811] [INFO ] [REMOTE ] GRNT: Full fetch complete (48329 records). [2025-10-16T19:16:19.412937] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-16T19:16:19.797320] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-16T19:16:19.797417] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-16T19:16:19.798324] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-16T19:16:19.798391] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-16T19:16:19.799773] [DEBUG] [LOCAL ] GRNT: Trimmed 48329 records to 34222 (keeping 200 days of data) [2025-10-16T19:16:19.894973] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:16:19.957070] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-16T19:16:20.008084] [DEBUG] [LOCAL ] GRNT: Primary data saved (34222 records). [2025-10-16T19:16:20.008240] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-16T19:16:20.008323] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRNT took 32.5s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-16T19:16:20.172392] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:20.179015] [DEBUG] [LOCAL ] GRX: Loaded 4797 existing records from primary storage. [2025-10-16T19:16:20.179195] [INFO ] [MAIN ] GRX: Loaded 4797 existing records. [2025-10-16T19:16:20.350395] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:20.350638] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-16T19:16:20.350723] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-16T19:16:20.350900] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-16T19:16:20.350957] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-16T19:16:20.707966] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:20.742821] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-16T19:16:20.950872] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:16:21.542822] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-16T19:16:22.138542] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:16:22.206513] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-16T19:16:22.342813] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-16T19:16:22.803612] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T19:16:23.142815] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-16T19:16:23.688067] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:16:23.942816] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-16T19:16:24.591306] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:16:24.742823] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-16T19:16:25.542842] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-16T19:16:26.342797] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-16T19:16:26.389584] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-16T19:16:26.969065] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T19:16:26.983638] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:16:26.988741] [INFO ] [REMOTE ] GRMN: Full fetch complete (59704 records). [2025-10-16T19:16:26.988907] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-16T19:16:27.149003] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-16T19:16:27.376123] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-16T19:16:27.376204] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-16T19:16:27.377077] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-16T19:16:27.377141] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-16T19:16:27.378380] [DEBUG] [LOCAL ] GRMN: Trimmed 59704 records to 40670 (keeping 200 days of data) [2025-10-16T19:16:27.654495] [DEBUG] [LOCAL ] GRMN: Primary data saved (40670 records). [2025-10-16T19:16:27.654708] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-16T19:16:27.655403] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRMN took 52.4s. Estimated remaining: 3h 17m 4s. Rate: 7.1 symbols/min [2025-10-16T19:16:27.771605] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:16:27.842140] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:27.892403] [DEBUG] [LOCAL ] GS: Loaded 51783 existing records from primary storage. [2025-10-16T19:16:27.892760] [INFO ] [MAIN ] GS: Loaded 51783 existing records. [2025-10-16T19:16:27.948006] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-16T19:16:28.076289] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:28.076496] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-16T19:16:28.076543] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-16T19:16:28.076808] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-16T19:16:28.076866] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-16T19:16:28.437313] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:28.742815] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-16T19:16:29.386806] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:16:29.388315] [INFO ] [REMOTE ] GROV: Full fetch complete (13955 records). [2025-10-16T19:16:29.388392] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-16T19:16:29.545247] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-16T19:16:29.799449] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:16:29.799903] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-16T19:16:29.807692] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-16T19:16:29.808361] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-16T19:16:29.808425] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-16T19:16:29.809460] [DEBUG] [LOCAL ] GROV: Trimmed 13955 records to 8795 (keeping 200 days of data) [2025-10-16T19:16:29.808984] [INFO ] [REMOTE ] GRND: Full fetch complete (71590 records). [2025-10-16T19:16:29.810203] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-16T19:16:29.938861] [DEBUG] [LOCAL ] GROV: Primary data saved (8795 records). [2025-10-16T19:16:29.945081] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-16T19:16:29.951692] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GROV took 23.7s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-16T19:16:30.283390] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:30.254209] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:16:30.348106] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-16T19:16:30.485948] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-16T19:16:30.486027] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-16T19:16:30.486965] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-16T19:16:30.487124] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-16T19:16:30.488687] [DEBUG] [LOCAL ] GRND: Trimmed 71590 records to 50505 (keeping 200 days of data) [2025-10-16T19:16:30.559367] [DEBUG] [LOCAL ] GSBD: Loaded 39619 existing records from primary storage. [2025-10-16T19:16:30.589790] [INFO ] [MAIN ] GSBD: Loaded 39619 existing records. [2025-10-16T19:16:30.861779] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:30.892396] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-16T19:16:30.892727] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-16T19:16:30.898207] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-16T19:16:30.899046] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-16T19:16:30.967227] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:16:31.143592] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-16T19:16:31.149696] [DEBUG] [LOCAL ] GRND: Primary data saved (50505 records). [2025-10-16T19:16:31.163826] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-16T19:16:31.165051] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 45.5s. Estimated remaining: 3h 16m 28s. Rate: 7.1 symbols/min [2025-10-16T19:16:31.534268] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:31.582905] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:31.628862] [DEBUG] [LOCAL ] GSK: Loaded 53505 existing records from primary storage. [2025-10-16T19:16:31.629231] [INFO ] [MAIN ] GSK: Loaded 53505 existing records. [2025-10-16T19:16:31.806914] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:31.807165] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-16T19:16:31.807218] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-16T19:16:31.807475] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-16T19:16:31.807531] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-16T19:16:31.948027] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-16T19:16:32.158711] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:32.742812] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-16T19:16:33.264810] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:16:33.307538] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-16T19:16:33.542856] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-16T19:16:34.077154] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-16T19:16:34.342795] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-16T19:16:34.516777] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:16:35.142819] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-16T19:16:35.494139] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:16:35.942813] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-16T19:16:36.576981] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-16T19:16:36.742796] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-16T19:16:37.266596] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-16T19:16:37.542860] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-16T19:16:38.111268] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-16T19:16:38.342835] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-16T19:16:39.142788] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-16T19:16:39.573758] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-16T19:16:39.613045] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-16T19:16:39.942896] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-16T19:16:40.742824] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-16T19:16:41.006977] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:16:41.311838] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:16:41.542810] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-16T19:16:42.130501] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T19:16:42.342810] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-16T19:16:42.467005] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:16:43.066586] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-16T19:16:43.142841] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-16T19:16:43.942814] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-16T19:16:44.742813] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-16T19:16:44.943033] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:16:45.542817] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-16T19:16:45.960555] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:16:46.044732] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T19:16:46.045966] [INFO ] [REMOTE ] GRX: Full fetch complete (6527 records). [2025-10-16T19:16:46.046035] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-16T19:16:46.332233] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-16T19:16:46.343414] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-16T19:16:46.458041] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-16T19:16:46.458121] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-16T19:16:46.458298] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-16T19:16:46.458337] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-16T19:16:46.458858] [DEBUG] [LOCAL ] GRX: Trimmed 6527 records to 4828 (keeping 200 days of data) [2025-10-16T19:16:46.488197] [DEBUG] [LOCAL ] GRX: Primary data saved (4828 records). [2025-10-16T19:16:46.488353] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-16T19:16:46.488444] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 26.5s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-16T19:16:46.669470] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:16:46.705768] [DEBUG] [LOCAL ] GSL: Loaded 33284 existing records from primary storage. [2025-10-16T19:16:46.706101] [INFO ] [MAIN ] GSL: Loaded 33284 existing records. [2025-10-16T19:16:46.916300] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:16:46.916513] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-16T19:16:46.916562] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-16T19:16:46.916784] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-16T19:16:46.916842] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-16T19:16:47.153366] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-16T19:16:47.309846] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:16:47.942880] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-16T19:16:48.223064] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:16:48.742824] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-16T19:16:49.403399] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:16:49.476189] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-16T19:16:49.542811] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-16T19:16:50.236217] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:16:50.342811] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-16T19:16:51.034383] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:16:51.142773] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-16T19:16:51.942800] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-16T19:16:52.033037] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:16:52.742842] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-16T19:16:52.956233] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-16T19:16:53.385306] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:16:53.542785] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-16T19:16:54.127353] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T19:16:54.342826] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-16T19:16:55.141986] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:55.150944] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-16T19:16:55.942848] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-16T19:16:56.251626] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-16T19:16:56.742798] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-16T19:16:57.001315] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T19:16:57.417093] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:16:57.542851] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-16T19:16:58.340593] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:16:58.351312] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-16T19:16:59.142845] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-16T19:16:59.242492] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:16:59.271576] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:16:59.942859] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-16T19:17:00.158054] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:17:00.742811] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-16T19:17:01.542855] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-16T19:17:01.643764] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:17:01.651098] [INFO ] [REMOTE ] GS: Full fetch complete (75813 records). [2025-10-16T19:17:01.651277] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-16T19:17:02.127028] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-16T19:17:02.129884] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-16T19:17:02.129793] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-16T19:17:02.131046] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-16T19:17:02.142343] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-16T19:17:02.144483] [DEBUG] [LOCAL ] GS: Trimmed 75813 records to 52170 (keeping 200 days of data) [2025-10-16T19:17:02.363338] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-16T19:17:02.478988] [DEBUG] [LOCAL ] GS: Primary data saved (52170 records). [2025-10-16T19:17:02.479138] [INFO ] [MAIN ] GS: Full history saved. [2025-10-16T19:17:02.479219] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GS took 34.8s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-16T19:17:02.657259] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:02.703454] [DEBUG] [LOCAL ] GTES: Loaded 50380 existing records from primary storage. [2025-10-16T19:17:02.703841] [INFO ] [MAIN ] GTES: Loaded 50380 existing records. [2025-10-16T19:17:02.884846] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:02.885107] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-16T19:17:02.885256] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-16T19:17:02.885523] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-16T19:17:02.885734] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-16T19:17:03.077422] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:17:03.148095] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-16T19:17:03.300723] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:03.942810] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-16T19:17:04.003328] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T19:17:04.742802] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-16T19:17:04.796350] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:17:04.802397] [INFO ] [REMOTE ] GSBD: Full fetch complete (58671 records). [2025-10-16T19:17:04.802508] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-16T19:17:05.182438] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-16T19:17:05.182576] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-16T19:17:05.183511] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-16T19:17:05.183621] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-16T19:17:05.185838] [DEBUG] [LOCAL ] GSBD: Trimmed 58671 records to 39923 (keeping 200 days of data) [2025-10-16T19:17:05.215115] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T19:17:05.461285] [DEBUG] [LOCAL ] GSBD: Primary data saved (39923 records). [2025-10-16T19:17:05.461438] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-16T19:17:05.461517] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 35.5s. Estimated remaining: 3h 16m 16s. Rate: 7.1 symbols/min [2025-10-16T19:17:05.549964] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-16T19:17:05.634793] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:05.677266] [DEBUG] [LOCAL ] GTLS: Loaded 43272 existing records from primary storage. [2025-10-16T19:17:05.677592] [INFO ] [MAIN ] GTLS: Loaded 43272 existing records. [2025-10-16T19:17:05.852010] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:05.852229] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-16T19:17:05.852277] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-16T19:17:05.852529] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-16T19:17:05.852586] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-16T19:17:06.197208] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:06.342824] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-16T19:17:06.755297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-16T19:17:06.762290] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-16T19:17:06.762416] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-16T19:17:07.143544] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-16T19:17:07.167179] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-16T19:17:07.167485] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-16T19:17:07.168495] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-16T19:17:07.168723] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-16T19:17:07.170244] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 53895 (keeping 200 days of data) [2025-10-16T19:17:07.302684] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:17:07.538634] [DEBUG] [LOCAL ] GSK: Primary data saved (53895 records). [2025-10-16T19:17:07.538885] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-16T19:17:07.539147] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 36.4s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-16T19:17:07.665278] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:17:07.744486] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:07.783096] [DEBUG] [LOCAL ] GTN: Loaded 45215 existing records from primary storage. [2025-10-16T19:17:07.783377] [INFO ] [MAIN ] GTN: Loaded 45215 existing records. [2025-10-16T19:17:07.944262] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-16T19:17:07.958405] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:07.958737] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-16T19:17:07.958811] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-16T19:17:07.959005] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-16T19:17:07.959043] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-16T19:17:08.309146] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:08.374511] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:17:08.742892] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-16T19:17:09.332413] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:17:09.542849] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-16T19:17:10.303611] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:17:10.342810] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-16T19:17:10.941791] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T19:17:11.142898] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-16T19:17:11.415341] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:17:11.942900] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-16T19:17:12.742924] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-16T19:17:12.893157] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:17:13.468698] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:17:13.542839] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-16T19:17:13.852121] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-16T19:17:14.342843] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-16T19:17:15.142818] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-16T19:17:15.337729] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:17:15.633385] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:17:15.942812] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-16T19:17:16.131337] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:17:16.742897] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-16T19:17:17.367630] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:17:17.542845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-16T19:17:18.147092] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:17:18.342861] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-16T19:17:19.114049] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:17:19.142789] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-16T19:17:19.772046] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:17:19.942869] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-16T19:17:20.365490] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:17:20.742872] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-16T19:17:21.542843] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-16T19:17:21.584115] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T19:17:22.036890] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:17:22.342845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-16T19:17:22.877053] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:17:23.142846] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-16T19:17:23.627595] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:17:23.942806] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-16T19:17:24.422026] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T19:17:24.742869] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-16T19:17:25.542799] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-16T19:17:25.668349] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:17:25.675171] [INFO ] [REMOTE ] GTES: Full fetch complete (73938 records). [2025-10-16T19:17:25.675289] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-16T19:17:26.070987] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-16T19:17:26.071165] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-16T19:17:26.072266] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-16T19:17:26.072376] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-16T19:17:26.073978] [DEBUG] [LOCAL ] GTES: Trimmed 73938 records to 50766 (keeping 200 days of data) [2025-10-16T19:17:26.182124] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:17:26.363857] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-16T19:17:26.402146] [DEBUG] [LOCAL ] GTES: Primary data saved (50766 records). [2025-10-16T19:17:26.402257] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-16T19:17:26.402775] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GTES took 23.9s. Estimated remaining: 3h 16m 4s. Rate: 7.1 symbols/min [2025-10-16T19:17:26.575813] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:26.609532] [DEBUG] [LOCAL ] GTY: Loaded 30274 existing records from primary storage. [2025-10-16T19:17:26.609872] [INFO ] [MAIN ] GTY: Loaded 30274 existing records. [2025-10-16T19:17:26.793331] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:26.793825] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-16T19:17:26.793907] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-16T19:17:26.794226] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-16T19:17:26.794295] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-16T19:17:26.958190] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T19:17:27.148175] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-16T19:17:27.188276] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:27.484611] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:17:27.942799] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-16T19:17:28.644493] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:17:28.648933] [INFO ] [REMOTE ] GSL: Full fetch complete (48316 records). [2025-10-16T19:17:28.649010] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-16T19:17:28.749896] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-16T19:17:28.976397] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-16T19:17:29.064866] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-16T19:17:29.064945] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-16T19:17:29.065803] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-16T19:17:29.065877] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-16T19:17:29.066888] [DEBUG] [LOCAL ] GSL: Trimmed 48316 records to 33526 (keeping 200 days of data) [2025-10-16T19:17:29.262873] [DEBUG] [LOCAL ] GSL: Primary data saved (33526 records). [2025-10-16T19:17:29.263003] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-16T19:17:29.263082] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GSL took 42.8s. Estimated remaining: 3h 15m 48s. Rate: 7.1 symbols/min [2025-10-16T19:17:29.427591] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:29.440861] [DEBUG] [LOCAL ] GUG: Loaded 12167 existing records from primary storage. [2025-10-16T19:17:29.441067] [INFO ] [MAIN ] GUG: Loaded 12167 existing records. [2025-10-16T19:17:29.548003] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-16T19:17:29.619409] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:29.619825] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-16T19:17:29.619879] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-16T19:17:29.620063] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-16T19:17:29.620120] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-16T19:17:29.978253] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:30.342828] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-16T19:17:30.404507] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:17:30.924139] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T19:17:30.971519] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:17:31.142790] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-16T19:17:31.942912] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-16T19:17:32.700228] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:17:32.742778] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-16T19:17:33.491957] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:17:33.542785] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-16T19:17:34.352504] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-16T19:17:34.358264] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:17:35.142842] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-16T19:17:35.206991] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:17:35.261633] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:17:35.942853] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-16T19:17:36.480356] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T19:17:36.742838] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-16T19:17:37.381943] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-16T19:17:37.425841] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-16T19:17:37.542806] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-16T19:17:38.342813] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-16T19:17:39.136068] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:17:39.142261] [INFO ] [REMOTE ] GTLS: Full fetch complete (61626 records). [2025-10-16T19:17:39.142562] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-16T19:17:39.142960] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-16T19:17:39.289963] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:17:39.552707] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-16T19:17:39.552822] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-16T19:17:39.553706] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-16T19:17:39.553766] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-16T19:17:39.555929] [DEBUG] [LOCAL ] GTLS: Trimmed 61626 records to 43612 (keeping 200 days of data) [2025-10-16T19:17:39.813832] [DEBUG] [LOCAL ] GTLS: Primary data saved (43612 records). [2025-10-16T19:17:39.813960] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-16T19:17:39.814038] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 34.4s. Estimated remaining: 3h 15m 43s. Rate: 7.1 symbols/min [2025-10-16T19:17:39.952190] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-16T19:17:39.989049] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:39.998385] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:17:40.014945] [DEBUG] [LOCAL ] GUT: Loaded 15593 existing records from primary storage. [2025-10-16T19:17:40.015211] [INFO ] [MAIN ] GUT: Loaded 15593 existing records. [2025-10-16T19:17:40.192765] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:40.192976] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-16T19:17:40.193023] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-16T19:17:40.193405] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-16T19:17:40.193463] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-16T19:17:40.541575] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:40.742784] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-16T19:17:41.018719] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T19:17:41.542837] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-16T19:17:41.805887] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:17:42.342818] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-16T19:17:43.004403] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:17:43.142827] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-16T19:17:43.302254] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:17:43.942809] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-16T19:17:44.753703] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-16T19:17:44.760395] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:17:44.805403] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:17:45.542854] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-16T19:17:45.963766] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:17:46.342856] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-16T19:17:46.727101] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:17:46.732989] [INFO ] [REMOTE ] GTN: Full fetch complete (66129 records). [2025-10-16T19:17:46.733154] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-16T19:17:47.115618] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-16T19:17:47.115730] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-16T19:17:47.116630] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-16T19:17:47.116726] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-16T19:17:47.118087] [DEBUG] [LOCAL ] GTN: Trimmed 66129 records to 45496 (keeping 200 days of data) [2025-10-16T19:17:47.164940] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-16T19:17:47.299755] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:17:47.389217] [DEBUG] [LOCAL ] GTN: Primary data saved (45496 records). [2025-10-16T19:17:47.389350] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-16T19:17:47.389428] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 39.9s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-16T19:17:47.554560] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:17:47.584880] [DEBUG] [LOCAL ] GVA: Loaded 32702 existing records from primary storage. [2025-10-16T19:17:47.585205] [INFO ] [MAIN ] GVA: Loaded 32702 existing records. [2025-10-16T19:17:47.760160] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:17:47.760360] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-16T19:17:47.760407] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-16T19:17:47.761073] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-16T19:17:47.761130] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-16T19:17:47.958842] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-16T19:17:48.142948] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:17:48.441235] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:17:48.742835] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-16T19:17:49.000975] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:17:49.457851] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-16T19:17:49.542795] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-16T19:17:50.342801] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-16T19:17:50.490718] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T19:17:51.142808] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-16T19:17:51.342824] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:17:51.942816] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-16T19:17:52.198767] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:17:52.742827] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-16T19:17:53.112627] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:17:53.542878] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-16T19:17:54.151754] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:17:54.171707] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:17:54.342832] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-16T19:17:55.142813] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-16T19:17:55.795779] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-16T19:17:55.942833] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-16T19:17:56.014860] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:17:56.719619] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T19:17:56.742790] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-16T19:17:57.542813] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-16T19:17:58.041677] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-16T19:17:58.342787] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-16T19:17:58.409276] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:17:59.142779] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-16T19:17:59.323605] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:17:59.942850] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-16T19:18:00.237533] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:18:00.742857] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-16T19:18:01.260789] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:18:01.265302] [INFO ] [REMOTE ] GTY: Full fetch complete (43940 records). [2025-10-16T19:18:01.265440] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-16T19:18:01.551718] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-16T19:18:01.650929] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-16T19:18:01.651012] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-16T19:18:01.651792] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-16T19:18:01.651856] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-16T19:18:01.652872] [DEBUG] [LOCAL ] GTY: Trimmed 43940 records to 30529 (keeping 200 days of data) [2025-10-16T19:18:01.839077] [DEBUG] [LOCAL ] GTY: Primary data saved (30529 records). [2025-10-16T19:18:01.839225] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-16T19:18:01.839307] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTY took 35.4s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-16T19:18:02.012266] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:02.030049] [DEBUG] [LOCAL ] GWH: Loaded 18636 existing records from primary storage. [2025-10-16T19:18:02.030339] [INFO ] [MAIN ] GWH: Loaded 18636 existing records. [2025-10-16T19:18:02.219096] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:02.219372] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-16T19:18:02.219451] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-16T19:18:02.219897] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-16T19:18:02.219954] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-16T19:18:02.344054] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-16T19:18:02.446045] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:18:02.649200] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:02.655200] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T19:18:03.040113] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:18:03.142805] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-16T19:18:03.942787] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-16T19:18:04.108474] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:18:04.742949] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-16T19:18:04.850437] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:18:04.852375] [INFO ] [REMOTE ] GUG: Full fetch complete (19097 records). [2025-10-16T19:18:04.852444] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-16T19:18:05.207050] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-16T19:18:05.207127] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-16T19:18:05.207534] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-16T19:18:05.207615] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-16T19:18:05.208173] [DEBUG] [LOCAL ] GUG: Trimmed 19097 records to 12217 (keeping 200 days of data) [2025-10-16T19:18:05.279919] [DEBUG] [LOCAL ] GUG: Primary data saved (12217 records). [2025-10-16T19:18:05.280052] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-16T19:18:05.280130] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 36.0s. Estimated remaining: 3h 15m 17s. Rate: 7.1 symbols/min [2025-10-16T19:18:05.451809] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:05.487967] [DEBUG] [LOCAL ] GWRE: Loaded 39928 existing records from primary storage. [2025-10-16T19:18:05.488273] [INFO ] [MAIN ] GWRE: Loaded 39928 existing records. [2025-10-16T19:18:05.549201] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-16T19:18:05.669573] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:05.669838] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-16T19:18:05.669888] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-16T19:18:05.670544] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-16T19:18:05.670600] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-16T19:18:05.778353] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:18:05.841895] [INFO ] [REMOTE ] GUT: Full fetch complete (22610 records). [2025-10-16T19:18:05.858813] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-16T19:18:06.251525] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:06.347356] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-16T19:18:06.458722] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-16T19:18:06.458827] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-16T19:18:06.459404] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-16T19:18:06.467615] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-16T19:18:06.468944] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:18:06.473029] [DEBUG] [LOCAL ] GUT: Trimmed 22610 records to 15736 (keeping 200 days of data) [2025-10-16T19:18:06.561575] [DEBUG] [LOCAL ] GUT: Primary data saved (15736 records). [2025-10-16T19:18:06.561792] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-16T19:18:06.561896] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 26.7s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-16T19:18:06.726096] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:06.745521] [DEBUG] [LOCAL ] GWW: Loaded 19562 existing records from primary storage. [2025-10-16T19:18:06.745796] [INFO ] [MAIN ] GWW: Loaded 19562 existing records. [2025-10-16T19:18:06.919366] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:06.919571] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-16T19:18:06.919618] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-16T19:18:06.920248] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-16T19:18:06.920319] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-16T19:18:07.149972] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-16T19:18:07.273486] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:07.535173] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-16T19:18:07.942798] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-16T19:18:08.057903] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:18:08.742819] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-16T19:18:08.788993] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:18:09.542811] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-16T19:18:10.211453] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:18:10.322094] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:18:10.342815] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-16T19:18:11.142785] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-16T19:18:11.211491] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-16T19:18:11.942793] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-16T19:18:12.198045] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T19:18:12.742843] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-16T19:18:13.542859] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-16T19:18:13.752538] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-16T19:18:14.342799] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-16T19:18:14.498406] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-16T19:18:14.681625] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T19:18:15.142811] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-16T19:18:15.719683] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:18:15.806145] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:18:15.942824] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-16T19:18:16.530568] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-16T19:18:16.742853] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-16T19:18:17.542836] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-16T19:18:17.971435] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:18:18.342872] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-16T19:18:19.056771] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:18:19.076392] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:18:19.142782] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-16T19:18:19.942829] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-16T19:18:20.671241] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:18:20.742775] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-16T19:18:20.912922] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T19:18:21.542833] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-16T19:18:22.153968] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T19:18:22.345388] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-16T19:18:22.348673] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:18:23.142799] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-16T19:18:23.403681] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:18:23.942878] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-16T19:18:24.225856] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:18:24.742926] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-16T19:18:24.780181] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:18:25.542866] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-16T19:18:25.910028] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:18:26.342869] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-16T19:18:27.073621] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:18:27.120458] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:18:27.142784] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-16T19:18:27.942797] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-16T19:18:28.233957] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:18:28.742782] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-16T19:18:29.089165] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:18:29.542867] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-16T19:18:30.066034] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:18:30.071370] [INFO ] [REMOTE ] GWH: Full fetch complete (23511 records). [2025-10-16T19:18:30.071498] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-16T19:18:30.347956] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-16T19:18:30.452271] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-16T19:18:30.452368] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-16T19:18:30.452900] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-16T19:18:30.453030] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-16T19:18:30.458984] [DEBUG] [LOCAL ] GWH: Trimmed 23511 records to 19024 (keeping 200 days of data) [2025-10-16T19:18:30.468788] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:18:30.576399] [DEBUG] [LOCAL ] GWH: Primary data saved (19024 records). [2025-10-16T19:18:30.576529] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-16T19:18:30.576605] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 28.7s. Estimated remaining: 3h 15m 12s. Rate: 7.1 symbols/min [2025-10-16T19:18:30.746066] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:30.786700] [DEBUG] [LOCAL ] GXO: Loaded 46756 existing records from primary storage. [2025-10-16T19:18:30.786997] [INFO ] [MAIN ] GXO: Loaded 46756 existing records. [2025-10-16T19:18:30.964216] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:30.964406] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-16T19:18:30.964453] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-16T19:18:30.965525] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-16T19:18:30.965585] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-16T19:18:31.147676] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-16T19:18:31.329585] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:31.678760] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:18:31.942808] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-16T19:18:32.571073] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:18:32.742813] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-16T19:18:32.859399] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:18:33.542892] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-16T19:18:34.228507] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-16T19:18:34.347266] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-16T19:18:34.351108] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:18:34.354903] [INFO ] [REMOTE ] GWW: Full fetch complete (29149 records). [2025-10-16T19:18:34.355003] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-16T19:18:34.722052] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-16T19:18:34.722160] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-16T19:18:34.722852] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-16T19:18:34.722914] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-16T19:18:34.723677] [DEBUG] [LOCAL ] GWW: Trimmed 29149 records to 19681 (keeping 200 days of data) [2025-10-16T19:18:34.846760] [DEBUG] [LOCAL ] GWW: Primary data saved (19681 records). [2025-10-16T19:18:34.846904] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-16T19:18:34.846982] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GWW took 28.3s. Estimated remaining: 3h 14m 58s. Rate: 7.1 symbols/min [2025-10-16T19:18:35.012731] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:35.015825] [DEBUG] [LOCAL ] GYLD: Loaded 1544 existing records from primary storage. [2025-10-16T19:18:35.015967] [INFO ] [MAIN ] GYLD: Loaded 1544 existing records. [2025-10-16T19:18:35.148007] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-16T19:18:35.208741] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:35.208917] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-16T19:18:35.208965] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-16T19:18:35.209134] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-16T19:18:35.209190] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-16T19:18:35.554570] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:35.832541] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:18:35.942849] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-16T19:18:36.368429] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-16T19:18:36.742822] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-16T19:18:37.075519] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:18:37.542883] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-16T19:18:38.040955] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-16T19:18:38.342855] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-16T19:18:38.417675] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T19:18:39.142885] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-16T19:18:39.354289] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-16T19:18:39.942822] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-16T19:18:40.634457] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:18:40.639354] [INFO ] [REMOTE ] GWRE: Full fetch complete (60449 records). [2025-10-16T19:18:40.639461] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-16T19:18:40.752499] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-16T19:18:41.045825] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-16T19:18:41.045912] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-16T19:18:41.046817] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-16T19:18:41.046880] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-16T19:18:41.048068] [DEBUG] [LOCAL ] GWRE: Trimmed 60449 records to 40226 (keeping 200 days of data) [2025-10-16T19:18:41.320415] [DEBUG] [LOCAL ] GWRE: Primary data saved (40226 records). [2025-10-16T19:18:41.320608] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-16T19:18:41.321286] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 36.0s. Estimated remaining: 3h 14m 47s. Rate: 7.1 symbols/min [2025-10-16T19:18:41.490680] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:41.518825] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:18:41.548142] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-16T19:18:41.567960] [DEBUG] [LOCAL ] H: Loaded 44421 existing records from primary storage. [2025-10-16T19:18:41.568252] [INFO ] [MAIN ] H: Loaded 44421 existing records. [2025-10-16T19:18:41.744861] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:41.745066] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-16T19:18:41.745114] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-16T19:18:41.746056] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-16T19:18:41.746115] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-16T19:18:42.116775] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:42.130221] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:18:42.134843] [INFO ] [REMOTE ] GVA: Full fetch complete (48438 records). [2025-10-16T19:18:42.135007] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-16T19:18:42.351573] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-16T19:18:42.525575] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-16T19:18:42.525698] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-16T19:18:42.526508] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-16T19:18:42.526553] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-16T19:18:42.527823] [DEBUG] [LOCAL ] GVA: Trimmed 48438 records to 32925 (keeping 200 days of data) [2025-10-16T19:18:42.731557] [DEBUG] [LOCAL ] GVA: Primary data saved (32925 records). [2025-10-16T19:18:42.731709] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-16T19:18:42.731810] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GVA took 55.3s. Estimated remaining: 3h 14m 29s. Rate: 7.1 symbols/min [2025-10-16T19:18:42.797747] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:18:42.906342] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:18:42.942298] [DEBUG] [LOCAL ] HAE: Loaded 39371 existing records from primary storage. [2025-10-16T19:18:42.942739] [INFO ] [MAIN ] HAE: Loaded 39371 existing records. [2025-10-16T19:18:43.074035] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:18:43.165143] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-16T19:18:43.170004] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:18:43.171015] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-16T19:18:43.171069] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-16T19:18:43.171449] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-16T19:18:43.171507] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-16T19:18:43.528806] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:18:43.942813] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-16T19:18:44.352283] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:18:44.576966] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:18:44.742816] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-16T19:18:45.542816] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-16T19:18:46.036938] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-16T19:18:46.342808] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-16T19:18:47.142846] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-16T19:18:47.267093] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:18:47.472798] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:18:47.782062] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-16T19:18:47.942810] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-16T19:18:48.742811] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-16T19:18:49.388971] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:18:49.542805] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-16T19:18:50.077803] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:18:50.342806] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-16T19:18:50.709231] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T19:18:51.126516] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:18:51.142771] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-16T19:18:51.942824] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-16T19:18:52.742833] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-16T19:18:53.120815] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-16T19:18:53.406334] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-16T19:18:53.539996] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:18:53.547834] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-16T19:18:54.342839] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-16T19:18:54.786045] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:18:55.107610] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:18:55.142822] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-16T19:18:55.942793] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-16T19:18:56.628505] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:18:56.742770] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-16T19:18:57.488903] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:18:57.542786] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-16T19:18:58.047047] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:18:58.342829] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-16T19:18:58.985583] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:18:59.142778] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-16T19:18:59.829259] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:18:59.942782] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-16T19:19:00.742803] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-16T19:19:00.788973] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:19:01.542863] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-16T19:19:01.783847] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:19:01.959242] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-16T19:19:02.342850] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-16T19:19:02.741248] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:19:03.142829] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-16T19:19:03.569330] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-16T19:19:03.942863] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-16T19:19:04.383491] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-16T19:19:04.464470] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-16T19:19:04.742816] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-16T19:19:05.243237] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-16T19:19:05.244245] [INFO ] [REMOTE ] GYLD: Full fetch complete (2112 records). [2025-10-16T19:19:05.244316] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-16T19:19:05.547976] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-16T19:19:05.604323] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-16T19:19:05.604399] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-16T19:19:05.604491] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-16T19:19:05.604533] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-16T19:19:05.604888] [DEBUG] [LOCAL ] GYLD: Trimmed 2112 records to 1553 (keeping 200 days of data) [2025-10-16T19:19:05.614722] [DEBUG] [LOCAL ] GYLD: Primary data saved (1553 records). [2025-10-16T19:19:05.614814] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-16T19:19:05.615319] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 30.8s. Estimated remaining: 3h 14m 40s. Rate: 7.1 symbols/min [2025-10-16T19:19:05.782269] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:05.821300] [DEBUG] [LOCAL ] HAFN: Loaded 42943 existing records from primary storage. [2025-10-16T19:19:05.821617] [INFO ] [MAIN ] HAFN: Loaded 42943 existing records. [2025-10-16T19:19:05.998331] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:05.998524] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-16T19:19:05.998608] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-16T19:19:05.999239] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-16T19:19:05.999296] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-16T19:19:06.344699] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-16T19:19:06.349210] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:06.947593] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:19:07.142814] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-16T19:19:07.835352] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:19:07.942830] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-16T19:19:08.742853] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-16T19:19:08.955187] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:19:09.542823] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-16T19:19:09.896383] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-16T19:19:10.342826] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-16T19:19:10.754073] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:19:11.142788] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-16T19:19:11.589759] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-16T19:19:11.927915] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:19:11.942768] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-16T19:19:12.294411] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-16T19:19:12.742809] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-16T19:19:13.430677] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:19:13.437051] [INFO ] [REMOTE ] GXO: Full fetch complete (69596 records). [2025-10-16T19:19:13.437206] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-16T19:19:13.543766] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-16T19:19:13.696000] [DEBUG] [REMOTE ] H: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-16T19:19:13.736339] [WARN ] [REMOTE ] H: No data returned for month 2025-10 [2025-10-16T19:19:13.758001] [FATAL] [REMOTE ] H: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:19:13.779839] [FATAL] [MAIN ] H: Failed to fetch primary data. [2025-10-16T19:19:13.812003] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:19:13.822190] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-16T19:19:13.840513] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-16T19:19:13.842830] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-10-16T19:19:13.860510] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-16T19:19:13.860668] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-16T19:19:13.861919] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-16T19:19:13.862015] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-16T19:19:13.862091] [DEBUG] [LOCAL ] H: Deleted derivative data file. [2025-10-16T19:19:13.862908] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. H took 32.5s. Estimated remaining: 3h 14m 32s. Rate: 7.1 symbols/min [2025-10-16T19:19:13.966145] [DEBUG] [LOCAL ] GXO: Trimmed 69596 records to 47088 (keeping 200 days of data) [2025-10-16T19:19:14.142679] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:14.343741] [DEBUG] [LOCAL ] GXO: Primary data saved (47088 records). [2025-10-16T19:19:14.342892] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-16T19:19:14.358864] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-16T19:19:14.361080] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. GXO took 43.8s. Estimated remaining: 3h 14m 12s. Rate: 7.1 symbols/min [2025-10-16T19:19:14.360522] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-16T19:19:14.382835] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-16T19:19:14.685630] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:14.729751] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:14.730737] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-16T19:19:14.730860] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-16T19:19:14.745344] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-16T19:19:14.746608] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-16T19:19:14.746467] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:19:14.792560] [INFO ] [REMOTE ] HAE: Full fetch complete (59000 records). [2025-10-16T19:19:14.798026] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-16T19:19:15.021888] [DEBUG] [LOCAL ] HASI: Loaded 47673 existing records from primary storage. [2025-10-16T19:19:15.102111] [INFO ] [MAIN ] HASI: Loaded 47673 existing records. [2025-10-16T19:19:15.647181] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:15.716532] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:15.722261] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-16T19:19:15.727829] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-16T19:19:15.722189] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-16T19:19:15.759585] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-16T19:19:15.762505] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-16T19:19:15.854610] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-16T19:19:15.876750] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-16T19:19:15.888677] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-16T19:19:15.894831] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-16T19:19:15.989523] [DEBUG] [LOCAL ] HAE: Trimmed 59000 records to 39700 (keeping 200 days of data) [2025-10-16T19:19:16.267371] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:16.276333] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-16T19:19:16.406263] [DEBUG] [LOCAL ] HAE: Primary data saved (39700 records). [2025-10-16T19:19:16.407168] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-16T19:19:16.407345] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAE took 33.7s. Estimated remaining: 3h 13m 55s. Rate: 7.1 symbols/min [2025-10-16T19:19:16.587200] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:16.631264] [DEBUG] [LOCAL ] HAYW: Loaded 48908 existing records from primary storage. [2025-10-16T19:19:16.631586] [INFO ] [MAIN ] HAYW: Loaded 48908 existing records. [2025-10-16T19:19:16.810110] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:16.810436] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-16T19:19:16.810618] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-16T19:19:16.811426] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-16T19:19:16.811502] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-16T19:19:17.066137] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-16T19:19:17.134847] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-16T19:19:17.215950] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:17.552801] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-16T19:19:17.555322] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-16T19:19:17.763499] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-16T19:19:18.342844] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-16T19:19:18.744402] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:19:18.875731] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:19:19.142825] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-16T19:19:19.942816] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-16T19:19:20.515177] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-16T19:19:20.742867] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-16T19:19:21.221822] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:19:21.542837] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-16T19:19:21.585335] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-16T19:19:22.342841] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-16T19:19:22.956300] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-16T19:19:23.142807] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-16T19:19:23.295104] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:19:23.730420] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:19:23.942836] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-16T19:19:24.488610] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:19:24.742822] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-16T19:19:25.550425] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-16T19:19:25.570754] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T19:19:26.333326] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:19:26.342798] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-16T19:19:27.088403] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:19:27.142828] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-16T19:19:27.942850] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-16T19:19:28.160774] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T19:19:28.347229] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-16T19:19:28.742794] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-16T19:19:29.356288] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-16T19:19:29.542837] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-16T19:19:30.355456] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-16T19:19:30.386367] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T19:19:31.142849] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-16T19:19:31.310327] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:19:31.942873] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-16T19:19:32.211520] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:19:32.649184] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T19:19:32.742867] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-16T19:19:33.542868] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-16T19:19:34.161584] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-16T19:19:34.239840] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-16T19:19:34.342790] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-16T19:19:35.142863] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-16T19:19:35.194339] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:19:35.844818] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:19:35.942822] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-16T19:19:36.445744] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:19:36.742856] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-16T19:19:37.542782] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-16T19:19:37.997604] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-16T19:19:38.344676] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-16T19:19:38.347488] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:19:38.718440] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:19:38.725476] [INFO ] [REMOTE ] HAFN: Full fetch complete (64940 records). [2025-10-16T19:19:38.725661] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-16T19:19:39.126534] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-16T19:19:39.126626] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-16T19:19:39.127710] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-16T19:19:39.127794] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-16T19:19:39.129103] [DEBUG] [LOCAL ] HAFN: Trimmed 64940 records to 43242 (keeping 200 days of data) [2025-10-16T19:19:39.177688] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-16T19:19:39.378227] [DEBUG] [LOCAL ] HAFN: Primary data saved (43242 records). [2025-10-16T19:19:39.378359] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-16T19:19:39.378439] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 33.8s. Estimated remaining: 3h 14m 7s. Rate: 7.1 symbols/min [2025-10-16T19:19:39.545240] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:39.554454] [DEBUG] [LOCAL ] HBB: Loaded 6475 existing records from primary storage. [2025-10-16T19:19:39.554712] [INFO ] [MAIN ] HBB: Loaded 6475 existing records. [2025-10-16T19:19:39.726553] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:39.726778] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-16T19:19:39.726828] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-16T19:19:39.726965] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-16T19:19:39.727002] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-16T19:19:39.949422] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-16T19:19:40.093261] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:40.301055] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-16T19:19:40.709233] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-16T19:19:40.742767] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-16T19:19:41.286502] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-16T19:19:41.542813] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-16T19:19:41.916511] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-16T19:19:42.342808] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-16T19:19:43.142863] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-16T19:19:43.440770] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T19:19:43.942790] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-16T19:19:43.983288] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:19:44.578021] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:19:44.742850] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-16T19:19:45.542812] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-16T19:19:45.921554] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:19:46.070298] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:19:46.315035] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-16T19:19:46.342842] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-16T19:19:47.142823] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-16T19:19:47.942839] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-16T19:19:48.067372] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T19:19:48.074257] [INFO ] [REMOTE ] HAYW: Full fetch complete (70937 records). [2025-10-16T19:19:48.074435] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-16T19:19:48.490576] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-16T19:19:48.490758] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-16T19:19:48.492102] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-16T19:19:48.492169] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-16T19:19:48.493606] [DEBUG] [LOCAL ] HAYW: Trimmed 70937 records to 49275 (keeping 200 days of data) [2025-10-16T19:19:48.762341] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-16T19:19:48.804446] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:19:48.837511] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-16T19:19:48.851360] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-16T19:19:48.851051] [DEBUG] [LOCAL ] HAYW: Primary data saved (49275 records). [2025-10-16T19:19:48.851534] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-16T19:19:48.851708] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAYW took 32.4s. Estimated remaining: 3h 13m 59s. Rate: 7.1 symbols/min [2025-10-16T19:19:48.882011] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:19:49.230971] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:49.372083] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T19:19:49.493761] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-16T19:19:49.493887] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-16T19:19:49.495541] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-16T19:19:49.495628] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-16T19:19:49.513317] [DEBUG] [LOCAL ] HBI: Loaded 52974 existing records from primary storage. [2025-10-16T19:19:49.513942] [INFO ] [MAIN ] HBI: Loaded 52974 existing records. [2025-10-16T19:19:49.547139] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54108 (keeping 200 days of data) [2025-10-16T19:19:49.546700] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-16T19:19:49.843916] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:49.851313] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-16T19:19:49.851375] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-16T19:19:49.851774] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-16T19:19:49.851833] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-16T19:19:50.347966] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-16T19:19:50.348233] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-16T19:19:50.382479] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:19:50.382755] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-16T19:19:50.388447] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HAL took 36.5s. Estimated remaining: 3h 13m 41s. Rate: 7.1 symbols/min [2025-10-16T19:19:50.619821] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:50.670449] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:50.723398] [DEBUG] [LOCAL ] HBM: Loaded 52958 existing records from primary storage. [2025-10-16T19:19:50.723973] [INFO ] [MAIN ] HBM: Loaded 52958 existing records. [2025-10-16T19:19:50.909891] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:50.910131] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-16T19:19:50.910182] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-16T19:19:50.911259] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-16T19:19:50.911319] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-16T19:19:51.154953] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-16T19:19:51.269958] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:51.942844] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-16T19:19:51.953187] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T19:19:52.126512] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:19:52.132920] [INFO ] [REMOTE ] HASI: Full fetch complete (68406 records). [2025-10-16T19:19:52.133072] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-16T19:19:52.520544] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-16T19:19:52.520636] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-16T19:19:52.521627] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-16T19:19:52.521716] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-16T19:19:52.523163] [DEBUG] [LOCAL ] HASI: Trimmed 68406 records to 48039 (keeping 200 days of data) [2025-10-16T19:19:52.754834] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-16T19:19:52.820959] [DEBUG] [LOCAL ] HASI: Primary data saved (48039 records). [2025-10-16T19:19:52.821100] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-16T19:19:52.821211] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HASI took 38.5s. Estimated remaining: 3h 13m 25s. Rate: 7.1 symbols/min [2025-10-16T19:19:52.987903] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:19:53.029600] [DEBUG] [LOCAL ] HCA: Loaded 46992 existing records from primary storage. [2025-10-16T19:19:53.029929] [INFO ] [MAIN ] HCA: Loaded 46992 existing records. [2025-10-16T19:19:53.208367] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:19:53.208694] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-16T19:19:53.208752] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-16T19:19:53.208932] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-16T19:19:53.208968] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-16T19:19:53.546400] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-16T19:19:53.568172] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:19:53.605807] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:19:54.111442] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:19:54.131192] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-16T19:19:54.342875] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-16T19:19:55.055007] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:19:55.142817] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-16T19:19:55.687471] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:19:55.942789] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-16T19:19:56.742814] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-16T19:19:57.542815] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-16T19:19:57.621235] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:19:58.136001] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:19:58.166132] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:19:58.342807] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-16T19:19:59.128935] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:19:59.142783] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-16T19:19:59.709051] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-16T19:19:59.942822] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-16T19:20:00.742818] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-16T19:20:01.542817] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-16T19:20:01.630332] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T19:20:02.218105] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:20:02.219282] [INFO ] [REMOTE ] HBB: Full fetch complete (9371 records). [2025-10-16T19:20:02.219359] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-16T19:20:02.343398] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-16T19:20:02.645746] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:20:02.662667] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-16T19:20:02.663786] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-16T19:20:02.664115] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-16T19:20:02.664160] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-16T19:20:02.664631] [DEBUG] [LOCAL ] HBB: Trimmed 9371 records to 6511 (keeping 200 days of data) [2025-10-16T19:20:02.705291] [DEBUG] [LOCAL ] HBB: Primary data saved (6511 records). [2025-10-16T19:20:02.705444] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-16T19:20:02.705532] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HBB took 23.3s. Estimated remaining: 3h 13m 18s. Rate: 7.1 symbols/min [2025-10-16T19:20:02.882958] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:02.926293] [DEBUG] [LOCAL ] HCC: Loaded 45241 existing records from primary storage. [2025-10-16T19:20:02.926599] [INFO ] [MAIN ] HCC: Loaded 45241 existing records. [2025-10-16T19:20:03.124048] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:03.124266] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-16T19:20:03.124314] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-16T19:20:03.124719] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-16T19:20:03.124777] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-16T19:20:03.147907] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-16T19:20:03.479929] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:03.942813] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-16T19:20:04.103791] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:20:04.703623] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T19:20:04.742774] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-16T19:20:05.260993] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:20:05.542872] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-16T19:20:06.342806] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-16T19:20:06.588352] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:20:07.142837] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-16T19:20:07.282251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:20:07.545414] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T19:20:07.942823] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-16T19:20:08.668097] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:20:08.742857] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-16T19:20:09.542812] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-16T19:20:09.602247] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:20:10.342806] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-16T19:20:10.396777] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:20:11.019576] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:20:11.142820] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-16T19:20:11.942816] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-16T19:20:12.086703] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:20:12.742786] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-16T19:20:12.955619] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T19:20:13.315059] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:20:13.542840] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-16T19:20:14.342784] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-16T19:20:14.440625] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:20:15.142715] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:20:15.142787] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-16T19:20:15.627371] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:20:15.942861] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-16T19:20:16.742819] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-16T19:20:16.792281] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:20:17.488701] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:20:17.542780] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-16T19:20:18.342856] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-16T19:20:18.535089] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-16T19:20:19.061865] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:20:19.142767] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-16T19:20:19.942768] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-16T19:20:20.199766] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T19:20:20.742839] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-16T19:20:20.788147] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:20:21.532073] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:20:21.542800] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-16T19:20:22.342849] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-16T19:20:22.466956] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:20:23.011873] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:20:23.142813] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-16T19:20:23.804550] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T19:20:23.942779] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-16T19:20:24.719788] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:20:24.742770] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-16T19:20:25.542775] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-16T19:20:25.708969] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-16T19:20:25.715595] [INFO ] [REMOTE ] HBI: Full fetch complete (77034 records). [2025-10-16T19:20:25.715733] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-16T19:20:26.110392] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-16T19:20:26.110495] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-16T19:20:26.111548] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-16T19:20:26.111743] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-16T19:20:26.113314] [DEBUG] [LOCAL ] HBI: Trimmed 77034 records to 53362 (keeping 200 days of data) [2025-10-16T19:20:26.239610] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:20:26.343125] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-16T19:20:26.439597] [DEBUG] [LOCAL ] HBI: Primary data saved (53362 records). [2025-10-16T19:20:26.439743] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-16T19:20:26.439847] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBI took 37.6s. Estimated remaining: 3h 13m 31s. Rate: 7.1 symbols/min [2025-10-16T19:20:26.612228] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:26.628587] [DEBUG] [LOCAL ] HCI: Loaded 14115 existing records from primary storage. [2025-10-16T19:20:26.628903] [INFO ] [MAIN ] HCI: Loaded 14115 existing records. [2025-10-16T19:20:26.833349] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:26.835672] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:20:26.834159] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-16T19:20:26.844355] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-16T19:20:26.845268] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-16T19:20:26.845347] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-16T19:20:27.147980] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-16T19:20:27.208073] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:27.942842] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-16T19:20:28.126541] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:20:28.132482] [INFO ] [REMOTE ] HCA: Full fetch complete (68931 records). [2025-10-16T19:20:28.132596] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-16T19:20:28.513486] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-16T19:20:28.513619] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-16T19:20:28.514889] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-16T19:20:28.515065] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-16T19:20:28.526451] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T19:20:28.526752] [DEBUG] [LOCAL ] HCA: Trimmed 68931 records to 47337 (keeping 200 days of data) [2025-10-16T19:20:28.621610] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:20:28.746673] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-16T19:20:28.859981] [DEBUG] [LOCAL ] HCA: Primary data saved (47337 records). [2025-10-16T19:20:28.860120] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-16T19:20:28.860748] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCA took 36.0s. Estimated remaining: 3h 13m 14s. Rate: 7.1 symbols/min [2025-10-16T19:20:29.542816] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-16T19:20:29.655877] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:20:30.342824] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-16T19:20:31.062238] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-16T19:20:31.142785] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-16T19:20:31.349566] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-16T19:20:31.942856] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-16T19:20:32.047042] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T19:20:32.742829] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-16T19:20:33.305567] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:20:33.311734] [INFO ] [REMOTE ] HCC: Full fetch complete (64876 records). [2025-10-16T19:20:33.311955] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-16T19:20:33.567303] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-16T19:20:33.703915] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-16T19:20:33.704023] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-16T19:20:33.704961] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-16T19:20:33.705026] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-16T19:20:33.706472] [DEBUG] [LOCAL ] HCC: Trimmed 64876 records to 45525 (keeping 200 days of data) [2025-10-16T19:20:33.975952] [DEBUG] [LOCAL ] HCC: Primary data saved (45525 records). [2025-10-16T19:20:33.976101] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-16T19:20:33.976183] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCC took 31.3s. Estimated remaining: 3h 13m 1s. Rate: 7.1 symbols/min [2025-10-16T19:20:34.413479] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-16T19:20:34.417461] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-16T19:20:34.584077] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:20:35.037780] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:20:35.142862] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-16T19:20:35.942828] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-16T19:20:36.828259] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T19:20:36.840105] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-16T19:20:36.954496] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T19:20:37.542806] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-16T19:20:38.294112] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:20:38.317267] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T19:20:38.342781] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-16T19:20:39.142928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-16T19:20:39.248376] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-16T19:20:39.942821] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-16T19:20:40.864770] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:20:40.868473] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-16T19:20:40.960052] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:20:40.966964] [INFO ] [REMOTE ] HBM: Full fetch complete (76686 records). [2025-10-16T19:20:40.967094] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-16T19:20:41.358285] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-16T19:20:41.358370] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-16T19:20:41.359474] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-16T19:20:41.359539] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-16T19:20:41.360991] [DEBUG] [LOCAL ] HBM: Trimmed 76686 records to 53348 (keeping 200 days of data) [2025-10-16T19:20:41.675573] [DEBUG] [LOCAL ] HBM: Primary data saved (53348 records). [2025-10-16T19:20:41.675807] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-16T19:20:41.675925] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBM took 51.3s. Estimated remaining: 3h 12m 52s. Rate: 7.1 symbols/min [2025-10-16T19:20:41.825577] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:20:41.828205] [INFO ] [REMOTE ] HCI: Full fetch complete (19671 records). [2025-10-16T19:20:41.828282] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-16T19:20:42.197021] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-16T19:20:42.197096] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-16T19:20:42.197513] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-16T19:20:42.197551] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-16T19:20:42.198115] [DEBUG] [LOCAL ] HCI: Trimmed 19671 records to 14289 (keeping 200 days of data) [2025-10-16T19:20:42.283468] [DEBUG] [LOCAL ] HCI: Primary data saved (14289 records). [2025-10-16T19:20:42.283599] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-16T19:20:42.283699] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 15.8s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-16T19:20:42.984340] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.027879] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-16T19:20:43.046771] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.027774] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.058336] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-16T19:20:43.098043] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:43.098775] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-16T19:20:43.099436] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-16T19:20:43.099733] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-16T19:20:43.099868] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-16T19:20:43.440581] [DEBUG] [LOCAL ] HDB: Loaded 51932 existing records from primary storage. [2025-10-16T19:20:43.490790] [INFO ] [MAIN ] HDB: Loaded 51932 existing records. [2025-10-16T19:20:43.521019] [DEBUG] [LOCAL ] HE: Loaded 48936 existing records from primary storage. [2025-10-16T19:20:43.529041] [INFO ] [MAIN ] HE: Loaded 48936 existing records. [2025-10-16T19:20:43.578756] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-16T19:20:43.759203] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-16T19:20:43.832588] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:43.859298] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-16T19:20:44.174401] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.201152] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.226942] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.245152] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:20:44.245003] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.241159] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-16T19:20:44.276089] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:44.276451] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-16T19:20:44.276500] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-16T19:20:44.276557] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-16T19:20:44.276752] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-16T19:20:44.278720] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-16T19:20:44.276969] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-16T19:20:44.276852] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-16T19:20:44.290389] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-16T19:20:44.290519] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-16T19:20:44.284585] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-16T19:20:44.621273] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:20:44.649024] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-16T19:20:45.165867] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:20:45.292758] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-16T19:20:45.517034] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.511074] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.527739] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-16T19:20:45.546711] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-16T19:20:45.616913] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:45.686965] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-16T19:20:46.342808] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-16T19:20:46.548727] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-16T19:20:47.142845] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-16T19:20:47.369969] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-16T19:20:47.448956] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:20:47.630568] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T19:20:47.942805] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-16T19:20:48.219602] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T19:20:48.742819] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-16T19:20:49.542817] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-16T19:20:50.342790] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-16T19:20:50.507588] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-16T19:20:50.656136] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-16T19:20:51.142835] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-16T19:20:51.279583] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:20:51.942876] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-16T19:20:52.742887] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-16T19:20:53.053930] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-16T19:20:53.542835] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-16T19:20:53.616880] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-16T19:20:53.663409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T19:20:54.342831] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-16T19:20:54.574100] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-16T19:20:54.985681] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:20:55.142850] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-16T19:20:55.942861] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-16T19:20:56.742885] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-16T19:20:56.889441] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:20:57.542861] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-16T19:20:58.140756] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:20:58.190593] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T19:20:58.342847] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-16T19:20:58.652024] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-16T19:20:58.652674] [INFO ] [REMOTE ] HCXY: Full fetch complete (519 records). [2025-10-16T19:20:58.652742] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-16T19:20:58.837667] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-16T19:20:58.837957] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:20:58.838037] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:20:58.838118] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-16T19:20:58.838214] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-16T19:20:58.838267] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-16T19:20:58.838478] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-16T19:20:58.838743] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 16.6s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-16T19:20:59.024739] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:20:59.057018] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:20:59.096630] [DEBUG] [LOCAL ] HEI: Loaded 31248 existing records from primary storage. [2025-10-16T19:20:59.097081] [INFO ] [MAIN ] HEI: Loaded 31248 existing records. [2025-10-16T19:20:59.151879] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-16T19:20:59.283567] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:20:59.283784] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-16T19:20:59.283833] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-16T19:20:59.284451] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-16T19:20:59.284508] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-16T19:20:59.647408] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:20:59.942829] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-16T19:21:00.742866] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-16T19:21:00.814172] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:21:01.542830] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-16T19:21:01.771000] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:21:02.345921] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-16T19:21:02.351539] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T19:21:03.142834] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-16T19:21:03.826077] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T19:21:03.942794] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-16T19:21:04.035789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T19:21:04.733630] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:21:04.744092] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-16T19:21:05.542861] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-16T19:21:05.666432] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:21:06.342790] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-16T19:21:06.403935] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:21:07.016803] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-16T19:21:07.142827] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-16T19:21:07.942833] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-16T19:21:08.039693] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:21:08.621373] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:21:08.742823] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-16T19:21:09.542788] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-16T19:21:09.707058] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:21:10.260688] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:21:10.342831] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-16T19:21:11.017275] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:21:11.142850] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-16T19:21:11.884853] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:21:11.942780] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-16T19:21:12.588793] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:21:12.742832] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-16T19:21:13.436136] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:21:13.542832] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-16T19:21:14.342880] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-16T19:21:15.010358] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-16T19:21:15.061422] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:21:15.142829] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-16T19:21:15.867426] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:21:15.942804] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-16T19:21:16.602184] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:21:16.742820] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-16T19:21:17.459493] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:21:17.465736] [INFO ] [REMOTE ] HE: Full fetch complete (72227 records). [2025-10-16T19:21:17.465854] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-16T19:21:17.549008] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-16T19:21:17.872211] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-16T19:21:17.872355] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-16T19:21:17.873506] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-16T19:21:17.873622] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-16T19:21:17.875336] [DEBUG] [LOCAL ] HE: Trimmed 72227 records to 49287 (keeping 200 days of data) [2025-10-16T19:21:18.103469] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-16T19:21:18.191301] [DEBUG] [LOCAL ] HE: Primary data saved (49287 records). [2025-10-16T19:21:18.191433] [INFO ] [MAIN ] HE: Full history saved. [2025-10-16T19:21:18.191511] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 35.9s. Estimated remaining: 3h 12m 42s. Rate: 7.1 symbols/min [2025-10-16T19:21:18.343830] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-16T19:21:18.361305] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:18.370322] [DEBUG] [LOCAL ] HEQ: Loaded 6769 existing records from primary storage. [2025-10-16T19:21:18.370554] [INFO ] [MAIN ] HEQ: Loaded 6769 existing records. [2025-10-16T19:21:18.550526] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:18.550864] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-16T19:21:18.550931] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-16T19:21:18.551147] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-16T19:21:18.551186] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-16T19:21:18.907932] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:19.142815] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-16T19:21:19.393188] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T19:21:19.513062] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-16T19:21:19.694105] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:21:19.942819] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-16T19:21:20.629832] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:21:20.742835] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-16T19:21:21.542845] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-16T19:21:21.809582] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:21:22.342813] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-16T19:21:22.912756] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-16T19:21:23.141975] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:21:23.144020] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-16T19:21:23.942854] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-16T19:21:24.742834] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-16T19:21:25.144103] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T19:21:25.302943] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-16T19:21:25.542831] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-16T19:21:25.662852] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:21:26.342816] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-16T19:21:26.454361] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:21:26.457871] [INFO ] [REMOTE ] HEI: Full fetch complete (47712 records). [2025-10-16T19:21:26.457996] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-16T19:21:26.859433] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-16T19:21:26.859540] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-16T19:21:26.860471] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-16T19:21:26.860535] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-16T19:21:26.861791] [DEBUG] [LOCAL ] HEI: Trimmed 47712 records to 31397 (keeping 200 days of data) [2025-10-16T19:21:27.077963] [DEBUG] [LOCAL ] HEI: Primary data saved (31397 records). [2025-10-16T19:21:27.078080] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-16T19:21:27.078159] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HEI took 28.2s. Estimated remaining: 3h 12m 34s. Rate: 7.1 symbols/min [2025-10-16T19:21:27.150235] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-16T19:21:27.244294] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:27.286911] [DEBUG] [LOCAL ] HESM: Loaded 48517 existing records from primary storage. [2025-10-16T19:21:27.287209] [INFO ] [MAIN ] HESM: Loaded 48517 existing records. [2025-10-16T19:21:27.463205] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:27.463464] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-16T19:21:27.463531] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-16T19:21:27.463939] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-16T19:21:27.464000] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-16T19:21:27.822634] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:27.841839] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:21:27.849063] [INFO ] [REMOTE ] HD: Full fetch complete (77559 records). [2025-10-16T19:21:27.849275] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-16T19:21:27.945573] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-16T19:21:28.005047] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:21:28.100103] [INFO ] [REMOTE ] HDB: Full fetch complete (75611 records). [2025-10-16T19:21:28.131328] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-16T19:21:28.507050] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-16T19:21:28.538700] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-16T19:21:28.568583] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-16T19:21:28.576867] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:21:28.582041] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-16T19:21:28.644982] [DEBUG] [LOCAL ] HD: Trimmed 77559 records to 53874 (keeping 200 days of data) [2025-10-16T19:21:28.693174] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-16T19:21:28.693287] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-16T19:21:28.694336] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-16T19:21:28.748865] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-16T19:21:28.758173] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-16T19:21:28.809219] [DEBUG] [LOCAL ] HDB: Trimmed 75611 records to 52321 (keeping 200 days of data) [2025-10-16T19:21:29.387774] [DEBUG] [LOCAL ] HD: Primary data saved (53874 records). [2025-10-16T19:21:29.404304] [DEBUG] [LOCAL ] HDB: Primary data saved (52321 records). [2025-10-16T19:21:29.404800] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-16T19:21:29.405557] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HDB took 47.1s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-16T19:21:29.404478] [INFO ] [MAIN ] HD: Full history saved. [2025-10-16T19:21:29.449702] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HD took 47.2s. Estimated remaining: 3h 11m 57s. Rate: 7.1 symbols/min [2025-10-16T19:21:29.549679] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-16T19:21:29.710169] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:29.739079] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-16T19:21:29.750769] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-16T19:21:29.751226] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-16T19:21:29.751918] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-16T19:21:29.769965] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:29.768414] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-16T19:21:29.770132] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-16T19:21:29.770224] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-16T19:21:29.775439] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-16T19:21:29.812373] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-16T19:21:29.838348] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-16T19:21:29.896810] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-16T19:21:29.896984] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-16T19:21:30.255449] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:21:30.358357] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-16T19:21:30.427938] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:30.590895] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:30.621101] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:21:31.055335] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-16T19:21:31.142900] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-16T19:21:31.725413] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-16T19:21:31.942875] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-16T19:21:32.742870] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-16T19:21:33.201398] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-16T19:21:33.415492] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T19:21:33.542828] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-16T19:21:34.342822] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-16T19:21:35.045327] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:21:35.075084] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:21:35.142817] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-16T19:21:35.942871] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-16T19:21:36.723309] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:21:36.743591] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-16T19:21:36.744966] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:21:37.154569] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:21:37.542858] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-16T19:21:38.203449] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-16T19:21:38.342787] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-16T19:21:38.755308] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-16T19:21:39.142784] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-16T19:21:39.870968] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:21:39.942819] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-16T19:21:40.742808] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-16T19:21:40.833269] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:21:40.835194] [INFO ] [REMOTE ] HEQ: Full fetch complete (9632 records). [2025-10-16T19:21:40.835262] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-16T19:21:41.003682] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-16T19:21:41.228775] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-16T19:21:41.228865] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-16T19:21:41.229143] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-16T19:21:41.229187] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-16T19:21:41.229616] [DEBUG] [LOCAL ] HEQ: Trimmed 9632 records to 6834 (keeping 200 days of data) [2025-10-16T19:21:41.269344] [DEBUG] [LOCAL ] HEQ: Primary data saved (6834 records). [2025-10-16T19:21:41.269463] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-16T19:21:41.269548] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 23.1s. Estimated remaining: 3h 11m 53s. Rate: 7.1 symbols/min [2025-10-16T19:21:41.436460] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:21:41.452562] [DEBUG] [LOCAL ] HFRO: Loaded 16923 existing records from primary storage. [2025-10-16T19:21:41.452837] [INFO ] [MAIN ] HFRO: Loaded 16923 existing records. [2025-10-16T19:21:41.549283] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-16T19:21:41.630925] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:21:41.631119] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-16T19:21:41.631169] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-16T19:21:41.631555] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-16T19:21:41.631613] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-16T19:21:41.911970] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-16T19:21:41.988714] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:21:42.342884] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-16T19:21:42.666254] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-16T19:21:43.142884] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-16T19:21:43.359443] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-16T19:21:43.942813] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-16T19:21:44.402668] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:21:44.742793] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-16T19:21:44.992211] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-16T19:21:45.542805] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-16T19:21:45.755557] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-16T19:21:46.342805] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-16T19:21:47.142795] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-16T19:21:47.176464] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:21:47.405096] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-16T19:21:47.942825] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-16T19:21:48.742871] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-16T19:21:49.060919] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-16T19:21:49.498518] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:21:49.542803] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-16T19:21:50.342865] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-16T19:21:51.098204] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:21:51.142778] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-16T19:21:51.546174] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-16T19:21:51.942811] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-16T19:21:52.748528] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-16T19:21:52.755068] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:21:52.942057] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T19:21:53.043834] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-16T19:21:53.542816] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-16T19:21:54.342799] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-16T19:21:54.569947] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-16T19:21:54.657017] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:21:55.142825] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-16T19:21:55.942832] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-16T19:21:56.202790] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:21:56.742864] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-16T19:21:57.163482] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-16T19:21:57.542819] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-16T19:21:57.678072] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T19:21:58.303207] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:21:58.342831] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-16T19:21:59.142872] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-16T19:21:59.322800] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:21:59.575110] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-16T19:21:59.942817] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-16T19:22:00.175067] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T19:22:00.742815] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-16T19:22:01.422757] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-16T19:22:01.423493] [INFO ] [REMOTE ] HFND: Full fetch complete (1759 records). [2025-10-16T19:22:01.423562] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-16T19:22:01.547963] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-16T19:22:01.617213] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-16T19:22:01.617427] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:22:01.617495] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:22:01.617566] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-16T19:22:01.617631] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-16T19:22:01.617705] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-16T19:22:01.617757] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-16T19:22:01.617816] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HFND took 32.1s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-16T19:22:01.782627] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:01.799375] [DEBUG] [LOCAL ] HGER: Loaded 14918 existing records from primary storage. [2025-10-16T19:22:01.799614] [INFO ] [MAIN ] HGER: Loaded 14918 existing records. [2025-10-16T19:22:01.886328] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-16T19:22:02.001847] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:02.002086] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-16T19:22:02.002134] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-16T19:22:02.002329] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-16T19:22:02.002386] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-16T19:22:02.346891] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-16T19:22:02.349274] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:03.142841] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-16T19:22:03.378883] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T19:22:03.942881] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-16T19:22:04.003845] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:22:04.296881] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T19:22:04.297518] [INFO ] [REMOTE ] HF: Full fetch complete (440 records). [2025-10-16T19:22:04.297585] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-16T19:22:04.476189] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-16T19:22:04.476382] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:22:04.476430] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:22:04.476468] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-16T19:22:04.476523] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-16T19:22:04.476558] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-16T19:22:04.476597] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-16T19:22:04.476673] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HF took 35.1s. Estimated remaining: 3h 11m 45s. Rate: 7.1 symbols/min [2025-10-16T19:22:04.649330] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:04.660924] [DEBUG] [LOCAL ] HGLB: Loaded 9584 existing records from primary storage. [2025-10-16T19:22:04.661162] [INFO ] [MAIN ] HGLB: Loaded 9584 existing records. [2025-10-16T19:22:04.748059] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-16T19:22:04.844166] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:04.844387] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-16T19:22:04.844436] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-16T19:22:04.844582] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-16T19:22:04.844623] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-16T19:22:05.194231] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:05.435320] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:22:05.542817] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-16T19:22:06.306639] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:22:06.342795] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-16T19:22:07.142834] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-16T19:22:07.942781] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-16T19:22:08.033529] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:22:08.056167] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T19:22:08.703880] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-16T19:22:08.742845] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-16T19:22:09.544016] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-16T19:22:09.546684] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:22:10.237363] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:22:10.342858] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-16T19:22:11.104595] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:22:11.142823] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-16T19:22:11.942832] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-16T19:22:11.997180] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T19:22:12.742849] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-16T19:22:13.542857] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-16T19:22:13.815954] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:22:13.825188] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:22:13.830747] [INFO ] [REMOTE ] HESM: Full fetch complete (69685 records). [2025-10-16T19:22:13.831224] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-16T19:22:14.219451] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-16T19:22:14.219541] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-16T19:22:14.220621] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-16T19:22:14.220772] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-16T19:22:14.222257] [DEBUG] [LOCAL ] HESM: Trimmed 69685 records to 48904 (keeping 200 days of data) [2025-10-16T19:22:14.344921] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-16T19:22:14.456498] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T19:22:14.529470] [DEBUG] [LOCAL ] HESM: Primary data saved (48904 records). [2025-10-16T19:22:14.529619] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-16T19:22:14.530126] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HESM took 47.5s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-16T19:22:14.706347] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:14.725178] [DEBUG] [LOCAL ] HGTY: Loaded 13285 existing records from primary storage. [2025-10-16T19:22:14.725450] [INFO ] [MAIN ] HGTY: Loaded 13285 existing records. [2025-10-16T19:22:14.912756] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:14.912926] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-16T19:22:14.912973] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-16T19:22:14.913112] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-16T19:22:14.913150] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-16T19:22:15.150937] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-16T19:22:15.277916] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:15.274289] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-16T19:22:15.280446] [INFO ] [REMOTE ] HFRO: Full fetch complete (27794 records). [2025-10-16T19:22:15.280518] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-16T19:22:15.694882] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-16T19:22:15.694959] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-16T19:22:15.695613] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-16T19:22:15.695820] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-16T19:22:15.696519] [DEBUG] [LOCAL ] HFRO: Trimmed 27794 records to 16982 (keeping 200 days of data) [2025-10-16T19:22:15.791315] [DEBUG] [LOCAL ] HFRO: Primary data saved (16982 records). [2025-10-16T19:22:15.791437] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-16T19:22:15.791517] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HFRO took 34.5s. Estimated remaining: 3h 11m 20s. Rate: 7.1 symbols/min [2025-10-16T19:22:15.912446] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:22:15.947880] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-16T19:22:16.005457] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:16.044968] [DEBUG] [LOCAL ] HGV: Loaded 46390 existing records from primary storage. [2025-10-16T19:22:16.045254] [INFO ] [MAIN ] HGV: Loaded 46390 existing records. [2025-10-16T19:22:16.217291] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:16.217497] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-16T19:22:16.217543] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-16T19:22:16.218414] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-16T19:22:16.218472] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-16T19:22:16.566596] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:16.742777] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-16T19:22:16.819697] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T19:22:17.372285] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:22:17.542816] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-16T19:22:18.331792] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:22:18.342763] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-16T19:22:19.102257] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:22:19.142812] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-16T19:22:19.662353] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-16T19:22:19.942810] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-16T19:22:20.697460] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:22:20.742779] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-16T19:22:21.291929] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-16T19:22:21.542846] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-16T19:22:22.090794] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-16T19:22:22.342848] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-16T19:22:23.142832] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-16T19:22:23.793343] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:22:23.910726] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:22:23.942794] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-16T19:22:24.742922] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-16T19:22:25.229881] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:22:25.310025] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:22:25.542820] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-16T19:22:26.286908] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-16T19:22:26.342860] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-16T19:22:27.142850] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-16T19:22:27.153484] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:22:27.942921] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-16T19:22:27.983164] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T19:22:28.552382] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T19:22:28.742853] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-16T19:22:29.475986] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:22:29.542776] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-16T19:22:30.192730] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:22:30.342815] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-16T19:22:30.948594] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-16T19:22:31.142844] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-16T19:22:31.942824] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-16T19:22:32.256716] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-16T19:22:32.742838] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-16T19:22:33.319945] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:22:33.385713] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:22:33.542803] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-16T19:22:34.342869] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-16T19:22:35.089566] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:22:35.142840] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-16T19:22:35.261916] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:22:35.264271] [INFO ] [REMOTE ] HGTY: Full fetch complete (17530 records). [2025-10-16T19:22:35.264344] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-16T19:22:35.646276] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-16T19:22:35.646363] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-16T19:22:35.646827] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-16T19:22:35.646888] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-16T19:22:35.647404] [DEBUG] [LOCAL ] HGTY: Trimmed 17530 records to 13424 (keeping 200 days of data) [2025-10-16T19:22:35.722325] [DEBUG] [LOCAL ] HGTY: Primary data saved (13424 records). [2025-10-16T19:22:35.722457] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-16T19:22:35.722581] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGTY took 21.2s. Estimated remaining: 3h 11m 27s. Rate: 7.1 symbols/min [2025-10-16T19:22:35.888327] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:35.921489] [DEBUG] [LOCAL ] HHH: Loaded 33258 existing records from primary storage. [2025-10-16T19:22:35.921802] [INFO ] [MAIN ] HHH: Loaded 33258 existing records. [2025-10-16T19:22:35.953342] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-16T19:22:36.103905] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:36.104101] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-16T19:22:36.104149] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-16T19:22:36.104320] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-16T19:22:36.104358] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-16T19:22:36.471740] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:36.650276] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:22:36.742790] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-16T19:22:36.938721] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:22:37.372932] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T19:22:37.375240] [INFO ] [REMOTE ] HGLB: Full fetch complete (14758 records). [2025-10-16T19:22:37.375319] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-16T19:22:37.542849] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-16T19:22:37.757697] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-16T19:22:37.757791] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-16T19:22:37.758127] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-16T19:22:37.758168] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-16T19:22:37.758676] [DEBUG] [LOCAL ] HGLB: Trimmed 14758 records to 9718 (keeping 200 days of data) [2025-10-16T19:22:37.815697] [DEBUG] [LOCAL ] HGLB: Primary data saved (9718 records). [2025-10-16T19:22:37.815835] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-16T19:22:37.815914] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 33.3s. Estimated remaining: 3h 11m 10s. Rate: 7.1 symbols/min [2025-10-16T19:22:37.982848] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:38.017758] [DEBUG] [LOCAL ] HI: Loaded 35761 existing records from primary storage. [2025-10-16T19:22:38.018104] [INFO ] [MAIN ] HI: Loaded 35761 existing records. [2025-10-16T19:22:38.199302] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:38.199561] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-16T19:22:38.199613] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-16T19:22:38.199901] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-16T19:22:38.199970] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-16T19:22:38.347890] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-16T19:22:38.567530] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:38.576506] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:22:39.142778] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-16T19:22:39.734244] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-16T19:22:39.942801] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-16T19:22:40.159043] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:22:40.742798] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-16T19:22:41.005948] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:22:41.542848] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-16T19:22:41.831945] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-16T19:22:41.835578] [INFO ] [REMOTE ] HGER: Full fetch complete (18303 records). [2025-10-16T19:22:41.835675] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-16T19:22:42.218407] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-16T19:22:42.218504] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-16T19:22:42.218960] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-16T19:22:42.219020] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-16T19:22:42.219545] [DEBUG] [LOCAL ] HGER: Trimmed 18303 records to 15086 (keeping 200 days of data) [2025-10-16T19:22:42.305522] [DEBUG] [LOCAL ] HGER: Primary data saved (15086 records). [2025-10-16T19:22:42.305700] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-16T19:22:42.305820] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGER took 40.7s. Estimated remaining: 3h 10m 57s. Rate: 7.1 symbols/min [2025-10-16T19:22:42.351126] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-16T19:22:42.499791] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:22:42.552936] [DEBUG] [LOCAL ] HIG: Loaded 51192 existing records from primary storage. [2025-10-16T19:22:42.553287] [INFO ] [MAIN ] HIG: Loaded 51192 existing records. [2025-10-16T19:22:42.744211] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:22:42.744578] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-16T19:22:42.744675] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-16T19:22:42.745366] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-16T19:22:42.745424] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-16T19:22:43.037423] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:22:43.157043] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-16T19:22:43.162744] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:22:43.692379] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:22:43.942815] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-16T19:22:44.404393] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T19:22:44.742818] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-16T19:22:45.542934] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-16T19:22:45.614253] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:22:46.034798] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-16T19:22:46.342844] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-16T19:22:47.095566] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:22:47.142847] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-16T19:22:47.505493] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:22:47.942812] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-16T19:22:48.530959] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-16T19:22:48.742799] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-16T19:22:49.260794] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T19:22:49.542834] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-16T19:22:50.006919] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:22:50.342890] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-16T19:22:50.404022] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-16T19:22:51.142864] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-16T19:22:51.636840] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:22:51.942871] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-16T19:22:52.742877] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-16T19:22:53.542860] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-16T19:23:05.895972] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (12.35 seconds). [2025-10-16T19:23:05.902428] [INFO ] [REMOTE ] HGV: Full fetch complete (65995 records). [2025-10-16T19:23:05.902597] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-16T19:23:06.299132] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (13.56 seconds). [2025-10-16T19:23:06.366958] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-16T19:23:06.404803] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-16T19:23:06.405042] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-16T19:23:06.406111] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-16T19:23:06.406282] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-16T19:23:06.407793] [DEBUG] [LOCAL ] HGV: Trimmed 65995 records to 46673 (keeping 200 days of data) [2025-10-16T19:23:06.688258] [DEBUG] [LOCAL ] HGV: Primary data saved (46673 records). [2025-10-16T19:23:06.688405] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-16T19:23:06.688491] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 50.9s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-16T19:23:06.868372] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:06.898277] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (14.96 seconds). [2025-10-16T19:23:06.908569] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-16T19:23:06.935472] [DEBUG] [LOCAL ] HII: Loaded 33852 existing records from primary storage. [2025-10-16T19:23:06.935839] [INFO ] [MAIN ] HII: Loaded 33852 existing records. [2025-10-16T19:23:07.131208] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:07.131456] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-16T19:23:07.131506] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-16T19:23:07.132412] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-16T19:23:07.132473] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-16T19:23:07.546872] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:07.548564] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (16.41 seconds). [2025-10-16T19:23:07.549115] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-16T19:23:07.557910] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-16T19:23:08.702761] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-16T19:23:08.715892] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-16T19:23:08.818528] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T19:23:08.835778] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-16T19:23:09.014090] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-16T19:23:09.022051] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-16T19:23:09.476107] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:23:09.485175] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-16T19:23:09.733796] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:23:09.742870] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-16T19:23:10.497364] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:23:10.505349] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-16T19:23:10.653682] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-16T19:23:10.668203] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:23:10.682501] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-16T19:23:10.685047] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-16T19:23:10.729585] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:23:10.738730] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-16T19:23:11.738985] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:23:11.746836] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-16T19:23:11.841779] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-16T19:23:11.851033] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-16T19:23:11.962716] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:23:11.974245] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-16T19:23:12.096492] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:23:12.107446] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-16T19:23:12.698047] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T19:23:12.705902] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-16T19:23:13.324668] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:23:13.334612] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-16T19:23:13.371160] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:23:13.377949] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-16T19:23:13.418336] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:23:13.428832] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-16T19:23:13.846720] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-16T19:23:13.854702] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-16T19:23:14.429697] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:23:14.433815] [INFO ] [REMOTE ] HHH: Full fetch complete (45989 records). [2025-10-16T19:23:14.433912] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-16T19:23:14.806443] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-16T19:23:14.806525] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-16T19:23:14.807457] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-16T19:23:14.807520] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-16T19:23:14.808527] [DEBUG] [LOCAL ] HHH: Trimmed 45989 records to 33409 (keeping 200 days of data) [2025-10-16T19:23:15.004008] [DEBUG] [LOCAL ] HHH: Primary data saved (33409 records). [2025-10-16T19:23:15.004147] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-16T19:23:15.004228] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HHH took 39.3s. Estimated remaining: 3h 11m 1s. Rate: 7.1 symbols/min [2025-10-16T19:23:15.180030] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:15.235855] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:23:15.260875] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-16T19:23:15.263231] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-16T19:23:15.264490] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-16T19:23:15.397101] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:23:15.427434] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-16T19:23:15.486095] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:15.486933] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-16T19:23:15.487039] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-16T19:23:15.487261] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-16T19:23:15.487423] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-16T19:23:15.774722] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-16T19:23:15.812527] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-16T19:23:15.885731] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:15.885996] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-16T19:23:16.874740] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-16T19:23:16.882924] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-16T19:23:16.945697] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:23:16.954042] [INFO ] [REMOTE ] HI: Full fetch complete (50632 records). [2025-10-16T19:23:16.954285] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-16T19:23:17.532018] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-16T19:23:17.532144] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-16T19:23:17.533326] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-16T19:23:17.533398] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-16T19:23:17.534709] [DEBUG] [LOCAL ] HI: Trimmed 50632 records to 36147 (keeping 200 days of data) [2025-10-16T19:23:17.809565] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-16T19:23:17.852417] [DEBUG] [LOCAL ] HI: Primary data saved (36147 records). [2025-10-16T19:23:17.852790] [INFO ] [MAIN ] HI: Full history saved. [2025-10-16T19:23:17.849354] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-16T19:23:17.853526] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 40.0s. Estimated remaining: 3h 10m 45s. Rate: 7.1 symbols/min [2025-10-16T19:23:18.063547] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:18.109836] [DEBUG] [LOCAL ] HIO: Loaded 24351 existing records from primary storage. [2025-10-16T19:23:18.111794] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T19:23:18.120453] [INFO ] [MAIN ] HIO: Loaded 24351 existing records. [2025-10-16T19:23:18.152473] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-16T19:23:18.301355] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:18.301731] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-16T19:23:18.301858] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-16T19:23:18.302077] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-16T19:23:18.302221] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-16T19:23:18.525875] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-16T19:23:18.615135] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-16T19:23:18.738431] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:18.738893] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-16T19:23:19.559245] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:23:19.570720] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-16T19:23:19.591624] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:23:19.867531] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:23:19.942789] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-16T19:23:20.405230] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:23:20.413099] [INFO ] [REMOTE ] HIG: Full fetch complete (73527 records). [2025-10-16T19:23:20.413273] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-16T19:23:20.769221] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-16T19:23:20.807734] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-16T19:23:20.807870] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-16T19:23:20.809105] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-16T19:23:20.809472] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-16T19:23:20.811340] [DEBUG] [LOCAL ] HIG: Trimmed 73527 records to 51580 (keeping 200 days of data) [2025-10-16T19:23:20.953145] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-16T19:23:21.217618] [DEBUG] [LOCAL ] HIG: Primary data saved (51580 records). [2025-10-16T19:23:21.217888] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-16T19:23:21.218970] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HIG took 38.9s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-10-16T19:23:21.285104] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:23:21.399354] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:21.424616] [DEBUG] [LOCAL ] HIPO: Loaded 21869 existing records from primary storage. [2025-10-16T19:23:21.424949] [INFO ] [MAIN ] HIPO: Loaded 21869 existing records. [2025-10-16T19:23:21.547904] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-16T19:23:21.608409] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:21.608764] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-16T19:23:21.608820] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-16T19:23:21.609015] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-16T19:23:21.609061] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-16T19:23:21.919566] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:23:22.008251] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:22.342845] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-16T19:23:22.829233] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:23:23.083928] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:23:23.142818] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-16T19:23:23.943082] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-16T19:23:24.114203] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:23:24.742867] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-16T19:23:25.542811] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-16T19:23:25.565917] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-16T19:23:26.039744] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-16T19:23:26.343018] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-16T19:23:27.056245] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:23:27.062187] [INFO ] [REMOTE ] HII: Full fetch complete (52536 records). [2025-10-16T19:23:27.062424] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-16T19:23:27.148253] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-16T19:23:27.468390] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-16T19:23:27.468523] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-16T19:23:27.469863] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-16T19:23:27.469944] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-16T19:23:27.471668] [DEBUG] [LOCAL ] HII: Trimmed 52536 records to 34070 (keeping 200 days of data) [2025-10-16T19:23:27.717912] [DEBUG] [LOCAL ] HII: Primary data saved (34070 records). [2025-10-16T19:23:27.718061] [INFO ] [MAIN ] HII: Full history saved. [2025-10-16T19:23:27.718192] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HII took 21.0s. Estimated remaining: 3h 10m 19s. Rate: 7.1 symbols/min [2025-10-16T19:23:27.891399] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:27.932063] [DEBUG] [LOCAL ] HIW: Loaded 44595 existing records from primary storage. [2025-10-16T19:23:27.932363] [INFO ] [MAIN ] HIW: Loaded 44595 existing records. [2025-10-16T19:23:27.964359] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-16T19:23:28.121393] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:28.121621] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-16T19:23:28.121734] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-16T19:23:28.121942] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-16T19:23:28.121997] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-16T19:23:28.454622] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:23:28.519982] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:28.742823] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-16T19:23:28.864671] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-16T19:23:28.890761] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-16T19:23:29.542869] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-16T19:23:30.069384] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:23:30.342824] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-16T19:23:30.805156] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:23:31.079569] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:23:31.142830] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-16T19:23:31.942857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-16T19:23:32.215190] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-16T19:23:32.742860] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-16T19:23:32.835462] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-16T19:23:33.542831] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-16T19:23:33.822033] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:23:34.342841] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-16T19:23:35.142795] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-16T19:23:35.466325] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:23:35.942799] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-16T19:23:36.191602] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-16T19:23:36.632893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T19:23:36.742788] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-16T19:23:36.810115] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:23:37.542812] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-16T19:23:37.853608] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T19:23:38.342817] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-16T19:23:39.142826] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-16T19:23:39.910405] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:23:39.942771] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-16T19:23:40.229011] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-16T19:23:40.252529] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:23:40.742855] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-16T19:23:41.542806] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-16T19:23:41.587436] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:23:41.967919] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:23:42.342866] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-16T19:23:42.630105] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:23:43.142822] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-16T19:23:43.698068] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:23:43.942822] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-16T19:23:44.129165] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:23:44.742857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-16T19:23:45.492765] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:23:45.542828] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-16T19:23:45.813113] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:23:46.342813] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-16T19:23:47.142817] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-16T19:23:47.635819] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T19:23:47.640514] [INFO ] [REMOTE ] HIO: Full fetch complete (37932 records). [2025-10-16T19:23:47.640598] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-16T19:23:47.950541] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-16T19:23:48.017692] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-16T19:23:48.018210] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-16T19:23:48.019045] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-16T19:23:48.019182] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-16T19:23:48.020167] [DEBUG] [LOCAL ] HIO: Trimmed 37932 records to 24541 (keeping 200 days of data) [2025-10-16T19:23:48.147778] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-16T19:23:48.203748] [DEBUG] [LOCAL ] HIO: Primary data saved (24541 records). [2025-10-16T19:23:48.203954] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-16T19:23:48.204055] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 30.3s. Estimated remaining: 3h 10m 26s. Rate: 7.1 symbols/min [2025-10-16T19:23:48.380749] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:48.401394] [DEBUG] [LOCAL ] HIX: Loaded 20507 existing records from primary storage. [2025-10-16T19:23:48.401676] [INFO ] [MAIN ] HIX: Loaded 20507 existing records. [2025-10-16T19:23:48.632791] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:48.633108] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-16T19:23:48.633219] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-16T19:23:48.633472] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-16T19:23:48.633554] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-16T19:23:48.746612] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:23:48.745090] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-16T19:23:48.907245] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:23:48.966968] [INFO ] [REMOTE ] HIPO: Full fetch complete (31174 records). [2025-10-16T19:23:48.969289] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-16T19:23:49.183456] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:49.445747] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-16T19:23:49.445845] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-16T19:23:49.446553] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-16T19:23:49.446608] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-16T19:23:49.447735] [DEBUG] [LOCAL ] HIPO: Trimmed 31174 records to 21976 (keeping 200 days of data) [2025-10-16T19:23:49.559910] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-16T19:23:49.580028] [DEBUG] [LOCAL ] HIPO: Primary data saved (21976 records). [2025-10-16T19:23:49.580197] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-16T19:23:49.580309] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 28.4s. Estimated remaining: 3h 10m 8s. Rate: 7.1 symbols/min [2025-10-16T19:23:49.759948] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:23:49.780366] [DEBUG] [LOCAL ] HKD: Loaded 18657 existing records from primary storage. [2025-10-16T19:23:49.780729] [INFO ] [MAIN ] HKD: Loaded 18657 existing records. [2025-10-16T19:23:49.953733] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:23:49.953893] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-16T19:23:49.953940] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-16T19:23:49.954139] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-16T19:23:49.954208] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-16T19:23:50.298844] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:23:50.342770] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-16T19:23:50.485577] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:23:51.132113] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:23:51.143335] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-16T19:23:51.779529] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:23:51.901381] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:23:51.942789] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-16T19:23:52.742823] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-16T19:23:52.951514] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:23:53.542834] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-16T19:23:54.342785] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-16T19:23:54.564888] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-16T19:23:55.142799] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-16T19:23:55.423931] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-16T19:23:55.466699] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T19:23:55.868126] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-16T19:23:55.942775] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-16T19:23:56.742854] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-16T19:23:57.122421] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-16T19:23:57.542842] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-16T19:23:58.259781] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-16T19:23:58.342845] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-16T19:23:58.630579] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:23:59.142867] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-16T19:23:59.587822] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:23:59.942818] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-16T19:24:00.742789] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-16T19:24:01.079985] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:24:01.542801] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-16T19:24:01.897740] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-16T19:24:01.971079] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:24:02.342839] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-16T19:24:02.374277] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:24:03.142836] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-16T19:24:03.942780] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-16T19:24:04.219233] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:24:04.742791] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-16T19:24:04.980535] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-16T19:24:04.987536] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-16T19:24:04.987685] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-16T19:24:05.379881] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-16T19:24:05.380025] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-16T19:24:05.381096] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-16T19:24:05.381170] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-16T19:24:05.382594] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54207 (keeping 200 days of data) [2025-10-16T19:24:05.508798] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:24:05.518096] [INFO ] [REMOTE ] HIW: Full fetch complete (64892 records). [2025-10-16T19:24:05.520716] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-16T19:24:05.609987] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-16T19:24:05.815877] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-16T19:24:06.150419] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-16T19:24:06.151726] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-16T19:24:06.156824] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-16T19:24:06.157444] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-16T19:24:06.165432] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-16T19:24:06.165621] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-16T19:24:06.166180] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 51.2s. Estimated remaining: 3h 10m 10s. Rate: 7.1 symbols/min [2025-10-16T19:24:06.216836] [DEBUG] [LOCAL ] HIW: Trimmed 64892 records to 44926 (keeping 200 days of data) [2025-10-16T19:24:06.344934] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-16T19:24:06.551674] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:06.649869] [DEBUG] [LOCAL ] HIW: Primary data saved (44926 records). [2025-10-16T19:24:06.650222] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-16T19:24:06.650380] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 38.9s. Estimated remaining: 3h 9m 51s. Rate: 7.1 symbols/min [2025-10-16T19:24:06.763354] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-16T19:24:06.872590] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:06.874077] [DEBUG] [LOCAL ] HL: Loaded 53675 existing records from primary storage. [2025-10-16T19:24:06.874322] [INFO ] [MAIN ] HL: Loaded 53675 existing records. [2025-10-16T19:24:07.067744] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:07.068221] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-16T19:24:07.068268] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-16T19:24:07.068444] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-16T19:24:07.068481] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-16T19:24:07.148439] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-16T19:24:07.197156] [DEBUG] [LOCAL ] HLF: Loaded 48547 existing records from primary storage. [2025-10-16T19:24:07.238355] [INFO ] [MAIN ] HLF: Loaded 48547 existing records. [2025-10-16T19:24:07.586683] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:24:07.693474] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:07.688634] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:07.698407] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-16T19:24:07.698486] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-16T19:24:07.698930] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-16T19:24:07.698988] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-16T19:24:07.948791] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-16T19:24:08.051794] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:08.357437] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:24:08.742833] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-16T19:24:09.069734] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T19:24:09.542793] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-16T19:24:09.856263] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:24:10.342805] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-16T19:24:11.142835] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-16T19:24:11.407037] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:24:11.409861] [INFO ] [REMOTE ] HIX: Full fetch complete (30014 records). [2025-10-16T19:24:11.409945] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-16T19:24:11.551393] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-16T19:24:11.834339] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-16T19:24:11.834426] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-16T19:24:11.835038] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-16T19:24:11.835099] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-16T19:24:11.835951] [DEBUG] [LOCAL ] HIX: Trimmed 30014 records to 20590 (keeping 200 days of data) [2025-10-16T19:24:11.942992] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-16T19:24:11.956915] [DEBUG] [LOCAL ] HIX: Primary data saved (20590 records). [2025-10-16T19:24:11.957121] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-16T19:24:11.957214] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 23.8s. Estimated remaining: 3h 9m 39s. Rate: 7.1 symbols/min [2025-10-16T19:24:12.122357] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:12.151869] [DEBUG] [LOCAL ] HLI: Loaded 30847 existing records from primary storage. [2025-10-16T19:24:12.152131] [INFO ] [MAIN ] HLI: Loaded 30847 existing records. [2025-10-16T19:24:12.326274] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:12.326472] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-16T19:24:12.326519] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-16T19:24:12.327257] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-16T19:24:12.327314] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-16T19:24:12.681573] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:12.730027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:24:12.742770] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-16T19:24:13.542785] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-16T19:24:13.600452] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:24:14.348977] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-16T19:24:14.351564] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:24:14.358691] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:24:15.142814] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-16T19:24:15.523191] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:24:15.942817] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-16T19:24:16.166439] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-16T19:24:16.742814] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-16T19:24:17.539037] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-16T19:24:17.548053] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-16T19:24:17.953111] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:24:17.956323] [INFO ] [REMOTE ] HKD: Full fetch complete (28251 records). [2025-10-16T19:24:17.956409] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-16T19:24:18.329909] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-16T19:24:18.329985] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-16T19:24:18.330547] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-16T19:24:18.330586] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-16T19:24:18.331254] [DEBUG] [LOCAL ] HKD: Trimmed 28251 records to 18776 (keeping 200 days of data) [2025-10-16T19:24:18.373382] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-16T19:24:18.437956] [DEBUG] [LOCAL ] HKD: Primary data saved (18776 records). [2025-10-16T19:24:18.438077] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-16T19:24:18.438151] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 28.9s. Estimated remaining: 3h 9m 28s. Rate: 7.1 symbols/min [2025-10-16T19:24:18.608042] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:18.637230] [DEBUG] [LOCAL ] HLIO: Loaded 28238 existing records from primary storage. [2025-10-16T19:24:18.637511] [INFO ] [MAIN ] HLIO: Loaded 28238 existing records. [2025-10-16T19:24:18.815224] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:18.815712] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-16T19:24:18.815875] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-16T19:24:18.816159] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-16T19:24:18.816324] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-16T19:24:18.974395] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:24:19.147954] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-16T19:24:19.223083] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:19.707568] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:24:19.942807] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-16T19:24:20.080893] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:24:20.574948] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-16T19:24:20.742876] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-16T19:24:21.542825] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-16T19:24:22.342789] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-16T19:24:22.553557] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:24:22.757115] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-16T19:24:23.142913] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-16T19:24:23.942877] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-16T19:24:24.034862] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:24:24.742796] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-16T19:24:24.897336] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:24:25.087100] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T19:24:25.542884] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-16T19:24:25.866049] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:24:26.342909] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-16T19:24:27.113391] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T19:24:27.142822] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-16T19:24:27.706261] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T19:24:27.942845] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-16T19:24:28.683207] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T19:24:28.742833] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-16T19:24:29.542846] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-16T19:24:29.938125] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T19:24:30.342843] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-16T19:24:30.483467] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-16T19:24:30.538958] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-16T19:24:31.142834] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-16T19:24:31.942832] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-16T19:24:32.142280] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:24:32.399325] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-16T19:24:32.742883] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-16T19:24:33.542883] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-16T19:24:33.585199] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:24:33.753536] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-16T19:24:34.342836] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-16T19:24:35.142860] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-16T19:24:35.462635] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:24:35.662729] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-16T19:24:35.942823] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-16T19:24:36.414758] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T19:24:36.742815] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-16T19:24:37.542784] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-16T19:24:38.010259] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:24:38.061616] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:24:38.342809] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-16T19:24:38.590852] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:24:39.142844] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-16T19:24:39.743016] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:24:39.942816] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-16T19:24:40.474350] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T19:24:40.742810] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-16T19:24:41.093171] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:24:41.542869] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-16T19:24:42.342842] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-16T19:24:42.802610] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-16T19:24:42.854059] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-16T19:24:43.142851] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-16T19:24:43.596759] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T19:24:43.602769] [INFO ] [REMOTE ] HLF: Full fetch complete (70966 records). [2025-10-16T19:24:43.602883] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-16T19:24:43.951639] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-16T19:24:43.993691] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-16T19:24:43.993842] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-16T19:24:43.994910] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-16T19:24:43.994975] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-16T19:24:43.996360] [DEBUG] [LOCAL ] HLF: Trimmed 70966 records to 48878 (keeping 200 days of data) [2025-10-16T19:24:44.266017] [DEBUG] [LOCAL ] HLF: Primary data saved (48878 records). [2025-10-16T19:24:44.266147] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-16T19:24:44.266225] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLF took 37.6s. Estimated remaining: 3h 9m 42s. Rate: 7.1 symbols/min [2025-10-16T19:24:44.434271] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:44.464777] [DEBUG] [LOCAL ] HLLY: Loaded 33508 existing records from primary storage. [2025-10-16T19:24:44.465033] [INFO ] [MAIN ] HLLY: Loaded 33508 existing records. [2025-10-16T19:24:44.642149] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:44.642357] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-16T19:24:44.642414] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-16T19:24:44.643071] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-16T19:24:44.643137] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-16T19:24:44.743802] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-16T19:24:45.002344] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:45.116368] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T19:24:45.396118] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-16T19:24:45.542844] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-16T19:24:45.675511] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:24:46.342858] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-16T19:24:46.743910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:24:46.749121] [INFO ] [REMOTE ] HLIO: Full fetch complete (36926 records). [2025-10-16T19:24:46.749243] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-16T19:24:47.153214] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-16T19:24:47.169391] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-16T19:24:47.169482] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-16T19:24:47.170375] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-16T19:24:47.170569] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-16T19:24:47.171592] [DEBUG] [LOCAL ] HLIO: Trimmed 36926 records to 28465 (keeping 200 days of data) [2025-10-16T19:24:47.354510] [DEBUG] [LOCAL ] HLIO: Primary data saved (28465 records). [2025-10-16T19:24:47.354773] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-16T19:24:47.354882] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HLIO took 28.9s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-16T19:24:47.530538] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T19:24:47.557592] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:47.558766] [INFO ] [REMOTE ] HLI: Full fetch complete (45264 records). [2025-10-16T19:24:47.559066] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-16T19:24:47.958424] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-16T19:24:47.977620] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-16T19:24:47.977520] [DEBUG] [LOCAL ] HLN: Loaded 53123 existing records from primary storage. [2025-10-16T19:24:47.977884] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-16T19:24:47.978023] [INFO ] [MAIN ] HLN: Loaded 53123 existing records. [2025-10-16T19:24:47.989998] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-16T19:24:48.015109] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-16T19:24:48.096294] [DEBUG] [LOCAL ] HLI: Trimmed 45264 records to 31106 (keeping 200 days of data) [2025-10-16T19:24:48.259497] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:48.266804] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-16T19:24:48.278698] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-16T19:24:48.284871] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-16T19:24:48.286401] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-16T19:24:48.662923] [DEBUG] [LOCAL ] HLI: Primary data saved (31106 records). [2025-10-16T19:24:48.686960] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-16T19:24:48.687168] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLI took 36.7s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-16T19:24:48.914285] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:48.939938] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-16T19:24:48.959546] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:49.005399] [DEBUG] [LOCAL ] HLT: Loaded 50527 existing records from primary storage. [2025-10-16T19:24:49.005736] [INFO ] [MAIN ] HLT: Loaded 50527 existing records. [2025-10-16T19:24:49.182399] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:49.182874] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-16T19:24:49.183119] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-16T19:24:49.183436] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-16T19:24:49.183587] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-16T19:24:49.317988] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:24:49.545251] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-16T19:24:49.564938] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-16T19:24:49.605919] [INFO ] [REMOTE ] HL: Full fetch complete (77822 records). [2025-10-16T19:24:49.611052] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-16T19:24:49.716294] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:50.049229] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-16T19:24:50.049308] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-16T19:24:50.050441] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-16T19:24:50.050505] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-16T19:24:50.052170] [DEBUG] [LOCAL ] HL: Trimmed 77822 records to 54065 (keeping 200 days of data) [2025-10-16T19:24:50.350484] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-16T19:24:50.377736] [DEBUG] [LOCAL ] HL: Primary data saved (54065 records). [2025-10-16T19:24:50.378118] [INFO ] [MAIN ] HL: Full history saved. [2025-10-16T19:24:50.378245] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HL took 44.2s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-16T19:24:50.602265] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:24:50.607070] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:24:50.660999] [DEBUG] [LOCAL ] HLX: Loaded 47471 existing records from primary storage. [2025-10-16T19:24:50.661335] [INFO ] [MAIN ] HLX: Loaded 47471 existing records. [2025-10-16T19:24:50.864900] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:24:50.888874] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:24:50.896549] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-16T19:24:50.896627] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-16T19:24:50.897604] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-16T19:24:50.897704] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-16T19:24:51.148016] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-16T19:24:51.319133] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:24:51.942806] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-16T19:24:52.352759] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-16T19:24:52.742813] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-16T19:24:53.108688] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-16T19:24:53.139454] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:24:53.542839] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-16T19:24:54.342838] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-16T19:24:54.557220] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:24:54.875997] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:24:55.142836] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-16T19:24:55.942862] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-16T19:24:55.988878] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:24:56.528006] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:24:56.742894] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-16T19:24:57.109759] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:24:57.542901] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-16T19:24:58.342886] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-16T19:24:58.473002] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-16T19:24:58.730550] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:24:59.142827] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-16T19:24:59.297007] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T19:24:59.942813] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-16T19:25:00.742785] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-16T19:25:00.790233] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:25:01.265443] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-16T19:25:01.542899] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-16T19:25:02.342875] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-16T19:25:02.597718] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:25:02.785366] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T19:25:03.142829] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-16T19:25:03.942829] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-16T19:25:04.044476] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:25:04.623268] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T19:25:04.742795] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-16T19:25:05.430436] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:25:05.542797] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-16T19:25:05.849267] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T19:25:06.342947] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-16T19:25:07.142891] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-16T19:25:07.269319] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:25:07.823863] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:25:07.942803] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-16T19:25:08.695308] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:25:08.742830] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-16T19:25:09.295057] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:25:09.542837] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-16T19:25:10.342843] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-16T19:25:10.673772] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T19:25:10.985632] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:25:10.990367] [INFO ] [REMOTE ] HLLY: Full fetch complete (46085 records). [2025-10-16T19:25:10.990471] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-16T19:25:11.147374] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-16T19:25:11.386589] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-16T19:25:11.386698] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-16T19:25:11.387617] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-16T19:25:11.387698] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-16T19:25:11.388940] [DEBUG] [LOCAL ] HLLY: Trimmed 46085 records to 33658 (keeping 200 days of data) [2025-10-16T19:25:11.592548] [DEBUG] [LOCAL ] HLLY: Primary data saved (33658 records). [2025-10-16T19:25:11.592734] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-16T19:25:11.592844] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 27.3s. Estimated remaining: 3h 8m 60s. Rate: 7.1 symbols/min [2025-10-16T19:25:11.782401] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:11.824455] [DEBUG] [LOCAL ] HMC: Loaded 46489 existing records from primary storage. [2025-10-16T19:25:11.824784] [INFO ] [MAIN ] HMC: Loaded 46489 existing records. [2025-10-16T19:25:11.947953] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-16T19:25:12.009205] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:12.009405] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-16T19:25:12.009452] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-16T19:25:12.010338] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-16T19:25:12.010397] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-16T19:25:12.408486] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:12.413876] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:25:12.742819] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-16T19:25:12.850397] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:25:13.542780] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-16T19:25:13.650503] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:25:14.116794] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:25:14.342846] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-16T19:25:15.142909] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-16T19:25:15.341336] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:25:15.720247] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:25:15.942832] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-16T19:25:16.444505] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:25:16.742800] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-16T19:25:17.198901] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:25:17.542837] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-16T19:25:18.342881] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-16T19:25:18.423550] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T19:25:19.142837] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-16T19:25:19.265457] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-16T19:25:19.942836] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-16T19:25:20.061031] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:25:20.742811] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-16T19:25:20.833942] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:25:21.542846] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-16T19:25:21.766612] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-16T19:25:22.154856] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:25:22.279635] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:25:22.286781] [INFO ] [REMOTE ] HLT: Full fetch complete (73631 records). [2025-10-16T19:25:22.287020] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-16T19:25:22.353094] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-16T19:25:22.686218] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-16T19:25:22.686301] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-16T19:25:22.687342] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-16T19:25:22.687408] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-16T19:25:22.688911] [DEBUG] [LOCAL ] HLT: Trimmed 73631 records to 50910 (keeping 200 days of data) [2025-10-16T19:25:23.001179] [DEBUG] [LOCAL ] HLT: Primary data saved (50910 records). [2025-10-16T19:25:23.001327] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-16T19:25:23.001412] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLT took 34.3s. Estimated remaining: 3h 8m 55s. Rate: 7.1 symbols/min [2025-10-16T19:25:23.152265] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-16T19:25:23.168947] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:23.192162] [DEBUG] [LOCAL ] HMN: Loaded 23512 existing records from primary storage. [2025-10-16T19:25:23.192411] [INFO ] [MAIN ] HMN: Loaded 23512 existing records. [2025-10-16T19:25:23.364808] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:23.364991] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-16T19:25:23.365039] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-16T19:25:23.365251] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-16T19:25:23.365307] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-16T19:25:23.716605] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:23.942815] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-16T19:25:24.103093] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:25:24.721438] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T19:25:24.742789] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-16T19:25:24.833452] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T19:25:25.542816] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-16T19:25:26.204053] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:25:26.211125] [INFO ] [REMOTE ] HLX: Full fetch complete (69067 records). [2025-10-16T19:25:26.211289] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-16T19:25:26.343171] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-16T19:25:26.351488] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-16T19:25:26.643053] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-16T19:25:26.643195] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-16T19:25:26.644673] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-16T19:25:26.644773] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-16T19:25:26.647125] [DEBUG] [LOCAL ] HLX: Trimmed 69067 records to 47821 (keeping 200 days of data) [2025-10-16T19:25:26.931901] [DEBUG] [LOCAL ] HLX: Primary data saved (47821 records). [2025-10-16T19:25:26.932096] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-16T19:25:26.932696] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 36.6s. Estimated remaining: 3h 8m 41s. Rate: 7.1 symbols/min [2025-10-16T19:25:27.110790] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:27.144926] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-16T19:25:27.170810] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-16T19:25:27.171230] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-16T19:25:27.358638] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:27.358964] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-16T19:25:27.359017] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-16T19:25:27.360143] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-16T19:25:27.360204] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-16T19:25:27.722053] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:27.942823] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-16T19:25:28.120459] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T19:25:28.241734] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-16T19:25:28.251698] [INFO ] [REMOTE ] HLN: Full fetch complete (77006 records). [2025-10-16T19:25:28.251909] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-16T19:25:28.628391] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-16T19:25:28.628474] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-16T19:25:28.629471] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-16T19:25:28.629533] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-16T19:25:28.630957] [DEBUG] [LOCAL ] HLN: Trimmed 77006 records to 53512 (keeping 200 days of data) [2025-10-16T19:25:28.743953] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-16T19:25:28.939849] [DEBUG] [LOCAL ] HLN: Primary data saved (53512 records). [2025-10-16T19:25:28.939980] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-16T19:25:28.940608] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLN took 41.6s. Estimated remaining: 3h 8m 24s. Rate: 7.1 symbols/min [2025-10-16T19:25:29.108379] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:29.108586] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-16T19:25:29.108661] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-16T19:25:29.108794] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-16T19:25:29.108844] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-16T19:25:29.108887] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-16T19:25:29.108919] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-16T19:25:29.467140] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:29.542812] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-16T19:25:29.820107] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-16T19:25:30.342797] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-16T19:25:30.503553] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:25:30.504002] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-16T19:25:30.504260] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:25:30.504381] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-16T19:25:30.504487] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:25:30.504704] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-16T19:25:30.504884] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-16T19:25:30.505025] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-16T19:25:30.505165] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-16T19:25:30.505286] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HNGE took 1.6s. Estimated remaining: 3h 8m 7s. Rate: 7.1 symbols/min [2025-10-16T19:25:30.609961] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:25:30.711878] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:25:30.750322] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:30.780903] [DEBUG] [LOCAL ] HNI: Loaded 29627 existing records from primary storage. [2025-10-16T19:25:30.781187] [INFO ] [MAIN ] HNI: Loaded 29627 existing records. [2025-10-16T19:25:30.962775] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:30.963022] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-16T19:25:30.963081] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-16T19:25:30.963637] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-16T19:25:30.963729] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-16T19:25:31.152704] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-16T19:25:31.327780] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:31.942812] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-16T19:25:32.742813] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-16T19:25:33.133567] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:25:33.204773] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-16T19:25:33.542814] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-16T19:25:34.342825] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-16T19:25:34.614290] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-16T19:25:35.132984] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:25:35.143143] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-16T19:25:35.372509] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T19:25:35.942820] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-16T19:25:35.969321] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:25:36.742829] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-16T19:25:37.234234] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:25:37.542940] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-16T19:25:38.211519] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:25:38.292118] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:25:38.342791] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-16T19:25:39.142839] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-16T19:25:39.942863] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-16T19:25:40.279756] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-16T19:25:40.366867] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:25:40.742835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-16T19:25:41.154177] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:25:41.542875] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-16T19:25:42.342791] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-16T19:25:42.676144] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-16T19:25:43.089485] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:25:43.142818] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-16T19:25:43.408356] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-16T19:25:43.942804] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-16T19:25:44.742824] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-16T19:25:44.797668] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:25:45.411978] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-16T19:25:45.542783] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-16T19:25:45.801420] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:25:46.342872] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-16T19:25:46.826899] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-16T19:25:47.142853] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-16T19:25:47.904929] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:25:47.942785] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-16T19:25:48.367411] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:25:48.742845] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-16T19:25:48.916959] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:25:49.542810] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-16T19:25:50.342869] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-16T19:25:50.386075] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:25:50.752277] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:25:51.062680] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T19:25:51.142852] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-16T19:25:51.942832] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-16T19:25:52.742844] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-16T19:25:52.935934] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:25:52.939177] [INFO ] [REMOTE ] HMN: Full fetch complete (31581 records). [2025-10-16T19:25:52.939444] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-16T19:25:53.361724] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-16T19:25:53.361950] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-16T19:25:53.362840] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-16T19:25:53.362980] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-16T19:25:53.364417] [DEBUG] [LOCAL ] HMN: Trimmed 31581 records to 23613 (keeping 200 days of data) [2025-10-16T19:25:53.495360] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-16T19:25:53.550040] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-16T19:25:53.564545] [DEBUG] [LOCAL ] HMN: Primary data saved (23613 records). [2025-10-16T19:25:53.564736] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-16T19:25:53.564837] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMN took 30.6s. Estimated remaining: 3h 8m 17s. Rate: 7.1 symbols/min [2025-10-16T19:25:53.782891] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:53.834274] [DEBUG] [LOCAL ] HOG: Loaded 50849 existing records from primary storage. [2025-10-16T19:25:53.834710] [INFO ] [MAIN ] HOG: Loaded 50849 existing records. [2025-10-16T19:25:54.018323] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:54.018601] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-16T19:25:54.018686] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-16T19:25:54.018926] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-16T19:25:54.018983] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-16T19:25:54.344928] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-16T19:25:54.433481] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:54.464788] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:25:55.142823] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-16T19:25:55.212206] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:25:55.300906] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T19:25:55.307980] [INFO ] [REMOTE ] HMY: Full fetch complete (77027 records). [2025-10-16T19:25:55.308144] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-16T19:25:55.754185] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-16T19:25:55.754324] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-16T19:25:55.755427] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-16T19:25:55.755498] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-16T19:25:55.757021] [DEBUG] [LOCAL ] HMY: Trimmed 77027 records to 53556 (keeping 200 days of data) [2025-10-16T19:25:55.948603] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-16T19:25:56.097187] [DEBUG] [LOCAL ] HMY: Primary data saved (53556 records). [2025-10-16T19:25:56.097341] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-16T19:25:56.097849] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HMY took 29.2s. Estimated remaining: 3h 8m 1s. Rate: 7.1 symbols/min [2025-10-16T19:25:56.271421] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:25:56.314830] [DEBUG] [LOCAL ] HOMB: Loaded 43633 existing records from primary storage. [2025-10-16T19:25:56.315132] [INFO ] [MAIN ] HOMB: Loaded 43633 existing records. [2025-10-16T19:25:56.493128] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:25:56.493550] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-16T19:25:56.493743] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-16T19:25:56.494189] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-16T19:25:56.494322] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-16T19:25:56.765689] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:25:56.771041] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-16T19:25:56.922904] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:25:57.493997] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:25:57.542841] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-16T19:25:58.342840] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-16T19:25:58.414902] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-16T19:25:59.068635] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T19:25:59.142829] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-16T19:25:59.270195] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:25:59.942825] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-16T19:26:00.275806] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:26:00.742863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-16T19:26:01.542844] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-16T19:26:01.668281] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:26:01.674854] [INFO ] [REMOTE ] HMC: Full fetch complete (68923 records). [2025-10-16T19:26:01.675036] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-16T19:26:02.116408] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-16T19:26:02.116520] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-16T19:26:02.117635] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-16T19:26:02.117808] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-16T19:26:02.119348] [DEBUG] [LOCAL ] HMC: Trimmed 68923 records to 46822 (keeping 200 days of data) [2025-10-16T19:26:02.360174] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-16T19:26:02.406101] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:26:02.440387] [DEBUG] [LOCAL ] HMC: Primary data saved (46822 records). [2025-10-16T19:26:02.441178] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-16T19:26:02.441753] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMC took 50.8s. Estimated remaining: 3h 7m 50s. Rate: 7.1 symbols/min [2025-10-16T19:26:02.610255] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:02.649746] [DEBUG] [LOCAL ] HOUS: Loaded 45340 existing records from primary storage. [2025-10-16T19:26:02.650115] [INFO ] [MAIN ] HOUS: Loaded 45340 existing records. [2025-10-16T19:26:02.831580] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:02.831860] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-16T19:26:02.831977] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-16T19:26:02.832185] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-16T19:26:02.832243] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-16T19:26:02.983377] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:26:03.022348] [INFO ] [REMOTE ] HNI: Full fetch complete (42082 records). [2025-10-16T19:26:03.070463] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-16T19:26:03.145428] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-16T19:26:03.333459] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:03.589282] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-16T19:26:03.589361] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-16T19:26:03.590109] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-16T19:26:03.590172] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-16T19:26:03.591074] [DEBUG] [LOCAL ] HNI: Trimmed 42082 records to 29900 (keeping 200 days of data) [2025-10-16T19:26:03.768341] [DEBUG] [LOCAL ] HNI: Primary data saved (29900 records). [2025-10-16T19:26:03.768590] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-16T19:26:03.768721] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 33.3s. Estimated remaining: 3h 7m 32s. Rate: 7.1 symbols/min [2025-10-16T19:26:03.821477] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:26:03.942796] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-16T19:26:04.742887] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-16T19:26:04.884879] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-16T19:26:05.293271] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:26:05.542815] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-16T19:26:05.844574] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:26:06.342853] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-16T19:26:06.994436] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T19:26:07.142833] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-16T19:26:07.949551] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-16T19:26:07.953096] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:26:08.508357] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:26:08.742866] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-16T19:26:09.423407] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-16T19:26:09.542836] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-16T19:26:10.342988] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-16T19:26:10.485461] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:26:10.733099] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:26:11.142822] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-16T19:26:11.388342] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-16T19:26:11.942877] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-16T19:26:12.742888] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-16T19:26:12.965817] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:26:13.160706] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:26:13.542895] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-16T19:26:13.863932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:26:14.342810] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-16T19:26:14.978231] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:26:15.142842] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-16T19:26:15.668143] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T19:26:15.942830] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-16T19:26:16.742806] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-16T19:26:16.895430] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:26:17.542817] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-16T19:26:17.669970] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:26:18.055035] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-16T19:26:18.342815] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-16T19:26:19.005417] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:26:19.142816] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-16T19:26:19.836327] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-16T19:26:19.942802] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-16T19:26:20.173550] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:26:20.742869] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-16T19:26:21.445349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:26:21.542774] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-16T19:26:22.291008] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:26:22.342778] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-16T19:26:23.142863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-16T19:26:23.175069] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:26:23.181254] [INFO ] [REMOTE ] HOMB: Full fetch complete (64255 records). [2025-10-16T19:26:23.181398] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-16T19:26:23.595780] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-16T19:26:23.596013] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-16T19:26:23.596999] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-16T19:26:23.597080] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-16T19:26:23.598784] [DEBUG] [LOCAL ] HOMB: Trimmed 64255 records to 44016 (keeping 200 days of data) [2025-10-16T19:26:23.633407] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-16T19:26:23.904244] [DEBUG] [LOCAL ] HOMB: Primary data saved (44016 records). [2025-10-16T19:26:23.904372] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-16T19:26:23.904854] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOMB took 27.8s. Estimated remaining: 3h 7m 39s. Rate: 7.1 symbols/min [2025-10-16T19:26:23.942837] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-16T19:26:24.561117] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:26:24.567430] [INFO ] [REMOTE ] HOG: Full fetch complete (74332 records). [2025-10-16T19:26:24.567543] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-16T19:26:24.948580] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-16T19:26:24.948688] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-16T19:26:24.949695] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-16T19:26:24.949757] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-16T19:26:24.951079] [DEBUG] [LOCAL ] HOG: Trimmed 74332 records to 51193 (keeping 200 days of data) [2025-10-16T19:26:25.283022] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:26:25.285700] [DEBUG] [LOCAL ] HOG: Primary data saved (51193 records). [2025-10-16T19:26:25.295902] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-16T19:26:25.296579] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOG took 31.7s. Estimated remaining: 3h 7m 21s. Rate: 7.1 symbols/min [2025-10-16T19:26:25.297237] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-16T19:26:27.186094] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-16T19:26:27.192743] [INFO ] [REMOTE ] HOUS: Full fetch complete (64459 records). [2025-10-16T19:26:27.192869] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-16T19:26:27.570941] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-16T19:26:27.571021] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-16T19:26:27.572326] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-16T19:26:27.572388] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-16T19:26:27.573559] [DEBUG] [LOCAL ] HOUS: Trimmed 64459 records to 45728 (keeping 200 days of data) [2025-10-16T19:26:27.824266] [DEBUG] [LOCAL ] HOUS: Primary data saved (45728 records). [2025-10-16T19:26:27.824411] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-16T19:26:27.824511] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 25.4s. Estimated remaining: 3h 7m 5s. Rate: 7.1 symbols/min [2025-10-16T19:26:28.495230] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.477161] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.555923] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.551438] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:28.570884] [DEBUG] [LOCAL ] HOV: Loaded 14032 existing records from primary storage. [2025-10-16T19:26:28.571327] [INFO ] [MAIN ] HOV: Loaded 14032 existing records. [2025-10-16T19:26:28.609011] [DEBUG] [LOCAL ] HPF: Loaded 7499 existing records from primary storage. [2025-10-16T19:26:28.609245] [INFO ] [MAIN ] HPF: Loaded 7499 existing records. [2025-10-16T19:26:28.930340] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:28.960899] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-16T19:26:28.966301] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:28.967276] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-16T19:26:28.967684] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-16T19:26:28.967969] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-16T19:26:28.981446] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-16T19:26:28.981659] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-16T19:26:28.983133] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-16T19:26:29.012804] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-16T19:26:29.019518] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-16T19:26:29.052980] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-16T19:26:29.263948] [DEBUG] [LOCAL ] HP: Loaded 51543 existing records from primary storage. [2025-10-16T19:26:29.299264] [INFO ] [MAIN ] HP: Loaded 51543 existing records. [2025-10-16T19:26:29.701233] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:29.861603] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-16T19:26:29.943591] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-16T19:26:29.938209] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:29.965335] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-16T19:26:29.999040] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-16T19:26:30.028407] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-16T19:26:30.096782] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-16T19:26:30.112489] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.189944] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-16T19:26:30.211488] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.244568] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-16T19:26:30.234010] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-16T19:26:30.257054] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-16T19:26:30.826739] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.838776] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-16T19:26:30.948115] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:30.948814] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-16T19:26:31.034569] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:26:31.038140] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-16T19:26:31.108167] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:26:31.110865] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-16T19:26:31.610689] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-16T19:26:31.613572] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-16T19:26:31.825520] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:26:31.828058] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-16T19:26:32.104173] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-16T19:26:32.107050] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-16T19:26:32.204569] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-16T19:26:32.220352] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:26:32.749039] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-16T19:26:32.756401] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:26:32.999585] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T19:26:33.542805] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-16T19:26:34.168283] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T19:26:34.195278] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-16T19:26:34.342830] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-16T19:26:35.142795] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-16T19:26:35.218481] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:26:35.942870] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-16T19:26:36.747945] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-16T19:26:36.763252] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:26:36.810902] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:26:37.542837] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-16T19:26:38.186947] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T19:26:38.342824] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-16T19:26:38.513201] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T19:26:38.748560] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T19:26:39.142814] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-16T19:26:39.831204] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:26:39.942799] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-16T19:26:40.742851] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-16T19:26:40.928874] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:26:41.542835] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-16T19:26:42.169447] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-16T19:26:42.342829] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-16T19:26:42.447118] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:26:42.762280] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T19:26:43.142826] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-16T19:26:43.877613] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T19:26:43.942788] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-16T19:26:44.549361] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T19:26:44.742805] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-16T19:26:45.542857] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-16T19:26:45.716809] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:26:46.342813] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-16T19:26:47.098121] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-16T19:26:47.103040] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:26:47.142864] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-16T19:26:47.871933] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:26:47.873436] [INFO ] [REMOTE ] HPF: Full fetch complete (10656 records). [2025-10-16T19:26:47.873543] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-16T19:26:47.948063] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-16T19:26:48.231291] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-16T19:26:48.231364] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-16T19:26:48.231626] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-16T19:26:48.231707] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-16T19:26:48.232126] [DEBUG] [LOCAL ] HPF: Trimmed 10656 records to 7539 (keeping 200 days of data) [2025-10-16T19:26:48.276394] [DEBUG] [LOCAL ] HPF: Primary data saved (7539 records). [2025-10-16T19:26:48.276504] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-16T19:26:48.276580] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 20.4s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-16T19:26:48.441755] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:48.453580] [DEBUG] [LOCAL ] HPI: Loaded 10655 existing records from primary storage. [2025-10-16T19:26:48.453809] [INFO ] [MAIN ] HPI: Loaded 10655 existing records. [2025-10-16T19:26:48.635959] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:48.636532] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-16T19:26:48.636591] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-16T19:26:48.636920] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-16T19:26:48.636993] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-16T19:26:48.745341] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-16T19:26:48.773733] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:26:48.800924] [INFO ] [REMOTE ] HOV: Full fetch complete (19096 records). [2025-10-16T19:26:48.812720] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-16T19:26:49.293953] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:49.383292] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-16T19:26:49.383367] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-16T19:26:49.383796] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-16T19:26:49.383857] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-16T19:26:49.384377] [DEBUG] [LOCAL ] HOV: Trimmed 19096 records to 14093 (keeping 200 days of data) [2025-10-16T19:26:49.465353] [DEBUG] [LOCAL ] HOV: Primary data saved (14093 records). [2025-10-16T19:26:49.465493] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-16T19:26:49.465576] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 21.6s. Estimated remaining: 3h 6m 54s. Rate: 7.1 symbols/min [2025-10-16T19:26:49.552585] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-16T19:26:49.656399] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:26:49.702007] [DEBUG] [LOCAL ] HPP: Loaded 51192 existing records from primary storage. [2025-10-16T19:26:49.702304] [INFO ] [MAIN ] HPP: Loaded 51192 existing records. [2025-10-16T19:26:49.873907] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:26:49.874118] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-16T19:26:49.874164] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-16T19:26:49.875096] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-16T19:26:49.875154] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-16T19:26:50.224926] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:26:50.285440] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:26:50.342773] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-16T19:26:51.142816] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-16T19:26:51.613628] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T19:26:51.854147] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T19:26:51.942823] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-16T19:26:52.742842] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-16T19:26:52.919736] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:26:53.394222] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:26:53.542785] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-16T19:26:53.622550] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:26:54.244116] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:26:54.342818] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-16T19:26:54.718786] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-16T19:26:55.142832] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-16T19:26:55.942823] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-16T19:26:56.742789] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-16T19:26:57.282115] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-16T19:26:57.319264] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:26:57.539398] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-16T19:26:57.542756] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-16T19:26:58.280699] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:26:58.342775] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-16T19:26:59.047827] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-16T19:26:59.142794] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-16T19:26:59.849677] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-16T19:26:59.942811] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-16T19:27:00.742793] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-16T19:27:00.805340] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-16T19:27:01.542868] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-16T19:27:02.342792] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-16T19:27:02.506376] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:27:02.711883] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-16T19:27:03.142897] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-16T19:27:03.952024] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-16T19:27:03.971822] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:27:04.212819] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:27:04.742858] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-16T19:27:05.371874] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T19:27:05.542794] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-16T19:27:05.939252] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:27:05.941231] [INFO ] [REMOTE ] HPI: Full fetch complete (13942 records). [2025-10-16T19:27:05.941308] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-16T19:27:06.313970] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-16T19:27:06.314296] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-16T19:27:06.314664] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-16T19:27:06.314726] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-16T19:27:06.315291] [DEBUG] [LOCAL ] HPI: Trimmed 13942 records to 10730 (keeping 200 days of data) [2025-10-16T19:27:06.347968] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-16T19:27:06.384014] [DEBUG] [LOCAL ] HPI: Primary data saved (10730 records). [2025-10-16T19:27:06.384150] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-16T19:27:06.384229] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPI took 18.1s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-16T19:27:06.553629] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:06.601241] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-16T19:27:06.601661] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-16T19:27:06.781546] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:06.781806] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-16T19:27:06.781855] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-16T19:27:06.782948] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-16T19:27:06.783007] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-16T19:27:07.140827] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:07.142765] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-16T19:27:07.255457] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-16T19:27:07.942792] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-16T19:27:08.375558] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-16T19:27:08.742814] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-16T19:27:09.062312] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:27:09.316868] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:27:09.542816] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-16T19:27:10.342850] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-16T19:27:10.457974] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-16T19:27:11.142793] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-16T19:27:11.436560] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-16T19:27:11.942791] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-16T19:27:12.426176] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-16T19:27:12.494311] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:27:12.742857] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-16T19:27:13.542811] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-16T19:27:13.757239] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:27:14.344412] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-16T19:27:14.350125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:27:15.057529] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-16T19:27:15.063855] [INFO ] [REMOTE ] HP: Full fetch complete (74088 records). [2025-10-16T19:27:15.063966] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-16T19:27:15.148068] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-16T19:27:15.489074] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-16T19:27:15.489171] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-16T19:27:15.490182] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-16T19:27:15.490247] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-16T19:27:15.491720] [DEBUG] [LOCAL ] HP: Trimmed 74088 records to 51892 (keeping 200 days of data) [2025-10-16T19:27:15.809112] [DEBUG] [LOCAL ] HP: Primary data saved (51892 records). [2025-10-16T19:27:15.809290] [INFO ] [MAIN ] HP: Full history saved. [2025-10-16T19:27:15.809390] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HP took 48.0s. Estimated remaining: 3h 6m 49s. Rate: 7.1 symbols/min [2025-10-16T19:27:15.956911] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-16T19:27:15.987988] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:16.000938] [DEBUG] [LOCAL ] HPS: Loaded 10310 existing records from primary storage. [2025-10-16T19:27:16.001284] [INFO ] [MAIN ] HPS: Loaded 10310 existing records. [2025-10-16T19:27:16.191239] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:16.191574] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-16T19:27:16.191698] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-16T19:27:16.192185] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-16T19:27:16.192247] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-16T19:27:16.559949] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-16T19:27:16.597569] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:16.742810] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-16T19:27:17.186898] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-16T19:27:17.479831] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:27:17.542779] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-16T19:27:18.297035] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:27:18.342778] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-16T19:27:18.659636] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-16T19:27:19.142834] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-16T19:27:19.942791] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-16T19:27:20.324167] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:27:20.742789] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-16T19:27:20.989362] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:27:20.996235] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-16T19:27:20.996380] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-16T19:27:21.328636] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:27:21.409674] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-16T19:27:21.409784] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-16T19:27:21.410915] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-16T19:27:21.411028] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-16T19:27:21.412795] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 54087 (keeping 200 days of data) [2025-10-16T19:27:21.548833] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-16T19:27:21.569829] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T19:27:21.799135] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-16T19:27:21.799526] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-16T19:27:21.800248] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 54.0s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-16T19:27:21.979622] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:22.004707] [DEBUG] [LOCAL ] HQH: Loaded 25800 existing records from primary storage. [2025-10-16T19:27:22.005037] [INFO ] [MAIN ] HQH: Loaded 25800 existing records. [2025-10-16T19:27:22.180400] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:22.180599] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-16T19:27:22.180665] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-16T19:27:22.181368] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-16T19:27:22.181425] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-16T19:27:22.345426] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-16T19:27:22.555960] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:23.142844] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-16T19:27:23.425132] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:27:23.704539] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:27:23.942888] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-16T19:27:24.579388] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:27:24.742826] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-16T19:27:25.542826] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-16T19:27:25.885852] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:27:26.342806] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-16T19:27:26.432574] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:27:26.460046] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-16T19:27:27.142842] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-16T19:27:27.942812] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-16T19:27:28.078332] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:27:28.256580] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-16T19:27:28.448009] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-16T19:27:28.742810] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-16T19:27:29.542858] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-16T19:27:30.221496] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T19:27:30.342789] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-16T19:27:30.572269] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:27:31.142793] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-16T19:27:31.204873] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:27:31.211893] [INFO ] [REMOTE ] HPQ: Full fetch complete (77841 records). [2025-10-16T19:27:31.212021] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-16T19:27:31.602716] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-16T19:27:31.602801] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-16T19:27:31.603922] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-16T19:27:31.603986] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-16T19:27:31.605446] [DEBUG] [LOCAL ] HPQ: Trimmed 77841 records to 54059 (keeping 200 days of data) [2025-10-16T19:27:31.940565] [DEBUG] [LOCAL ] HPQ: Primary data saved (54059 records). [2025-10-16T19:27:31.940763] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-16T19:27:31.940882] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPQ took 25.6s. Estimated remaining: 3h 6m 31s. Rate: 7.1 symbols/min [2025-10-16T19:27:31.952719] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-16T19:27:32.114322] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:32.133121] [DEBUG] [LOCAL ] HQL: Loaded 16872 existing records from primary storage. [2025-10-16T19:27:32.133356] [INFO ] [MAIN ] HQL: Loaded 16872 existing records. [2025-10-16T19:27:32.312960] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:32.313167] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-16T19:27:32.313213] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-16T19:27:32.313445] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-16T19:27:32.313501] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-16T19:27:32.673220] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:32.691721] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T19:27:32.698810] [INFO ] [REMOTE ] HPP: Full fetch complete (73414 records). [2025-10-16T19:27:32.698949] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-16T19:27:32.747923] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-16T19:27:33.103993] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-16T19:27:33.104133] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-16T19:27:33.105254] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-16T19:27:33.110676] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-16T19:27:33.120913] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-16T19:27:33.126850] [DEBUG] [LOCAL ] HPP: Trimmed 73414 records to 51562 (keeping 200 days of data) [2025-10-16T19:27:33.358385] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T19:27:33.430860] [DEBUG] [LOCAL ] HPP: Primary data saved (51562 records). [2025-10-16T19:27:33.431014] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-16T19:27:33.431625] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPP took 44.0s. Estimated remaining: 3h 6m 14s. Rate: 7.1 symbols/min [2025-10-16T19:27:33.547876] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-16T19:27:33.606754] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:33.658262] [DEBUG] [LOCAL ] HR: Loaded 52106 existing records from primary storage. [2025-10-16T19:27:33.658783] [INFO ] [MAIN ] HR: Loaded 52106 existing records. [2025-10-16T19:27:33.832714] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:33.832950] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-16T19:27:33.832998] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-16T19:27:33.834051] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-16T19:27:33.834109] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-16T19:27:34.181887] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:34.342777] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-16T19:27:34.612206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:27:35.142822] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-16T19:27:35.831686] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:27:35.898693] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:27:35.942772] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-16T19:27:36.742793] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-16T19:27:36.922869] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T19:27:37.222471] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-16T19:27:37.542817] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-16T19:27:38.342871] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-16T19:27:39.153931] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-16T19:27:39.178263] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:27:39.218052] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:27:39.924139] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:27:39.942761] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-16T19:27:40.692401] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:27:40.742782] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-16T19:27:41.542794] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-16T19:27:41.554733] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:27:42.342798] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-16T19:27:42.489885] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:27:42.967481] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:27:43.142797] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-16T19:27:43.942821] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-16T19:27:44.530615] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:27:44.649465] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T19:27:44.742846] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-16T19:27:45.542824] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-16T19:27:46.169533] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:27:46.342792] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-16T19:27:46.564677] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:27:47.142819] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-16T19:27:47.942797] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-16T19:27:48.305231] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-16T19:27:48.306620] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:27:48.387892] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-16T19:27:48.742838] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-16T19:27:49.542842] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-16T19:27:50.342801] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-16T19:27:50.469992] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:27:50.498333] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-16T19:27:51.142843] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-16T19:27:51.286997] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:27:51.942877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-16T19:27:52.742838] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-16T19:27:52.821913] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:27:52.822756] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:27:53.542838] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-16T19:27:53.664204] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-16T19:27:54.124902] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-16T19:27:54.126667] [INFO ] [REMOTE ] HPS: Full fetch complete (15190 records). [2025-10-16T19:27:54.126738] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-16T19:27:54.348161] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-16T19:27:54.486450] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-16T19:27:54.486530] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-16T19:27:54.486951] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-16T19:27:54.487010] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-16T19:27:54.487476] [DEBUG] [LOCAL ] HPS: Trimmed 15190 records to 10382 (keeping 200 days of data) [2025-10-16T19:27:54.552670] [DEBUG] [LOCAL ] HPS: Primary data saved (10382 records). [2025-10-16T19:27:54.552833] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-16T19:27:54.552923] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPS took 38.7s. Estimated remaining: 3h 6m 22s. Rate: 7.1 symbols/min [2025-10-16T19:27:54.743109] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:27:54.784493] [DEBUG] [LOCAL ] HRB: Loaded 48404 existing records from primary storage. [2025-10-16T19:27:54.784824] [INFO ] [MAIN ] HRB: Loaded 48404 existing records. [2025-10-16T19:27:54.960409] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:27:54.960683] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-16T19:27:54.960743] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-16T19:27:54.961721] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-16T19:27:54.961778] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-16T19:27:55.152179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-16T19:27:55.314775] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:27:55.942852] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-16T19:27:56.190823] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:27:56.196975] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:27:56.742812] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-16T19:27:57.542792] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-16T19:27:57.572121] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:27:57.625341] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-16T19:27:58.342870] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-16T19:27:59.142788] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-16T19:27:59.227604] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-16T19:27:59.308312] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T19:27:59.942790] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-16T19:28:00.556445] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:28:00.563944] [INFO ] [REMOTE ] HQH: Full fetch complete (37298 records). [2025-10-16T19:28:00.564080] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-16T19:28:00.752761] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-16T19:28:00.943956] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-16T19:28:00.944031] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-16T19:28:00.944743] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-16T19:28:00.944805] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-16T19:28:00.945566] [DEBUG] [LOCAL ] HQH: Trimmed 37298 records to 26023 (keeping 200 days of data) [2025-10-16T19:28:01.098021] [DEBUG] [LOCAL ] HQH: Primary data saved (26023 records). [2025-10-16T19:28:01.098158] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-16T19:28:01.098237] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 39.3s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-16T19:28:01.277157] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:01.309455] [DEBUG] [LOCAL ] HRI: Loaded 32443 existing records from primary storage. [2025-10-16T19:28:01.309770] [INFO ] [MAIN ] HRI: Loaded 32443 existing records. [2025-10-16T19:28:01.495480] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:01.495730] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-16T19:28:01.495789] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-16T19:28:01.496430] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-16T19:28:01.496490] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-16T19:28:01.554961] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-16T19:28:01.935174] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:01.942504] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-16T19:28:01.944929] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-16T19:28:02.342844] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-16T19:28:03.141304] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:28:03.150273] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-16T19:28:03.581369] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:28:03.942850] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-16T19:28:04.063006] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:28:04.066803] [INFO ] [REMOTE ] HQL: Full fetch complete (25330 records). [2025-10-16T19:28:04.066961] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-16T19:28:04.449661] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-16T19:28:04.449751] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-16T19:28:04.450291] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-16T19:28:04.450331] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-16T19:28:04.451028] [DEBUG] [LOCAL ] HQL: Trimmed 25330 records to 17085 (keeping 200 days of data) [2025-10-16T19:28:04.550257] [DEBUG] [LOCAL ] HQL: Primary data saved (17085 records). [2025-10-16T19:28:04.550387] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-16T19:28:04.550462] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 32.6s. Estimated remaining: 3h 5m 56s. Rate: 7.1 symbols/min [2025-10-16T19:28:04.723263] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:04.749288] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-16T19:28:04.771158] [DEBUG] [LOCAL ] HRL: Loaded 53128 existing records from primary storage. [2025-10-16T19:28:04.771505] [INFO ] [MAIN ] HRL: Loaded 53128 existing records. [2025-10-16T19:28:04.945749] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:04.945974] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-16T19:28:04.946022] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-16T19:28:04.946953] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-16T19:28:04.947010] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-16T19:28:05.303213] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:05.322305] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:28:05.329350] [INFO ] [REMOTE ] HR: Full fetch complete (75056 records). [2025-10-16T19:28:05.329511] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-16T19:28:05.550830] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-16T19:28:05.735163] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-16T19:28:05.735259] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-16T19:28:05.736436] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-16T19:28:05.736506] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-16T19:28:05.738205] [DEBUG] [LOCAL ] HR: Trimmed 75056 records to 52488 (keeping 200 days of data) [2025-10-16T19:28:06.058378] [DEBUG] [LOCAL ] HR: Primary data saved (52488 records). [2025-10-16T19:28:06.058516] [INFO ] [MAIN ] HR: Full history saved. [2025-10-16T19:28:06.059238] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HR took 32.6s. Estimated remaining: 3h 5m 39s. Rate: 7.1 symbols/min [2025-10-16T19:28:06.226765] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:06.260249] [DEBUG] [LOCAL ] HRTG: Loaded 34367 existing records from primary storage. [2025-10-16T19:28:06.260525] [INFO ] [MAIN ] HRTG: Loaded 34367 existing records. [2025-10-16T19:28:06.349547] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-16T19:28:06.441244] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:06.441591] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-16T19:28:06.441731] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-16T19:28:06.442137] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-16T19:28:06.442271] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-16T19:28:06.571800] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-16T19:28:06.837287] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:06.853337] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-16T19:28:07.142828] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-16T19:28:07.842947] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:28:07.942774] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-16T19:28:08.084183] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:28:08.742796] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-16T19:28:09.542812] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-16T19:28:09.671487] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:28:10.271572] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-16T19:28:10.338715] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-16T19:28:10.347876] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-16T19:28:11.142881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-16T19:28:11.752627] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:28:11.942879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-16T19:28:12.219405] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:28:12.742851] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-16T19:28:13.542835] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-16T19:28:13.587533] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:28:13.797272] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-16T19:28:14.342817] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-16T19:28:14.986177] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-16T19:28:15.142812] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-16T19:28:15.682119] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:28:15.942866] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-16T19:28:16.742792] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-16T19:28:16.920018] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:28:16.970267] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T19:28:17.542855] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-16T19:28:18.005892] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:28:18.342820] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-16T19:28:18.905410] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-16T19:28:19.142837] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-16T19:28:19.761790] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:28:19.942826] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-16T19:28:20.294390] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-16T19:28:20.742800] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-16T19:28:21.487338] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-16T19:28:21.542828] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-16T19:28:22.342816] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-16T19:28:22.535989] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:28:23.142784] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-16T19:28:23.310388] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:28:23.811774] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:28:23.942999] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-16T19:28:24.441690] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:28:24.742802] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-16T19:28:25.542825] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-16T19:28:25.749972] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:28:25.921602] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T19:28:26.342825] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-16T19:28:27.142803] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-16T19:28:27.201233] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:28:27.942787] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-16T19:28:28.009704] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-16T19:28:28.015934] [INFO ] [REMOTE ] HRB: Full fetch complete (70133 records). [2025-10-16T19:28:28.016072] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-16T19:28:28.415022] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T19:28:28.443481] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-16T19:28:28.443763] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-16T19:28:28.444900] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-16T19:28:28.444982] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-16T19:28:28.446871] [DEBUG] [LOCAL ] HRB: Trimmed 70133 records to 48745 (keeping 200 days of data) [2025-10-16T19:28:28.751272] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-16T19:28:28.769859] [DEBUG] [LOCAL ] HRB: Primary data saved (48745 records). [2025-10-16T19:28:28.770027] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-16T19:28:28.770691] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 34.2s. Estimated remaining: 3h 5m 48s. Rate: 7.1 symbols/min [2025-10-16T19:28:28.974997] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:29.028700] [DEBUG] [LOCAL ] HSBC: Loaded 51004 existing records from primary storage. [2025-10-16T19:28:29.029174] [INFO ] [MAIN ] HSBC: Loaded 51004 existing records. [2025-10-16T19:28:29.232214] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:29.233272] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-16T19:28:29.234893] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-16T19:28:29.234787] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:28:29.242586] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-16T19:28:29.243344] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-16T19:28:29.556264] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-16T19:28:29.599830] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:29.676639] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:28:30.342820] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-16T19:28:31.142833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-16T19:28:31.312763] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:28:31.749985] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-16T19:28:31.942828] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-16T19:28:32.168288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:28:32.742808] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-16T19:28:33.353774] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:28:33.358720] [INFO ] [REMOTE ] HRTG: Full fetch complete (44160 records). [2025-10-16T19:28:33.358861] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-16T19:28:33.548095] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-16T19:28:33.740687] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-16T19:28:33.740851] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-16T19:28:33.741689] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-16T19:28:33.741753] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-16T19:28:33.742920] [DEBUG] [LOCAL ] HRTG: Trimmed 44160 records to 34673 (keeping 200 days of data) [2025-10-16T19:28:33.987079] [DEBUG] [LOCAL ] HRTG: Primary data saved (34673 records). [2025-10-16T19:28:33.988624] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-16T19:28:33.988509] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:28:33.988787] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRTG took 27.9s. Estimated remaining: 3h 5m 36s. Rate: 7.1 symbols/min [2025-10-16T19:28:34.165365] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:34.179490] [DEBUG] [LOCAL ] HSHP: Loaded 14871 existing records from primary storage. [2025-10-16T19:28:34.179740] [INFO ] [MAIN ] HSHP: Loaded 14871 existing records. [2025-10-16T19:28:34.348379] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-16T19:28:34.353118] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:34.354338] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-16T19:28:34.354404] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-16T19:28:34.354832] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-16T19:28:34.354891] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-16T19:28:34.700791] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:35.142853] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-16T19:28:35.298814] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-16T19:28:35.794638] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:28:35.798862] [INFO ] [REMOTE ] HRI: Full fetch complete (46528 records). [2025-10-16T19:28:35.799002] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-16T19:28:35.950459] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-16T19:28:36.176469] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-16T19:28:36.176542] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-16T19:28:36.177333] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-16T19:28:36.177397] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-16T19:28:36.178337] [DEBUG] [LOCAL ] HRI: Trimmed 46528 records to 32632 (keeping 200 days of data) [2025-10-16T19:28:36.382931] [DEBUG] [LOCAL ] HRI: Primary data saved (32632 records). [2025-10-16T19:28:36.383278] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-16T19:28:36.383467] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRI took 35.3s. Estimated remaining: 3h 5m 20s. Rate: 7.1 symbols/min [2025-10-16T19:28:36.557448] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:36.595989] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:28:36.650014] [DEBUG] [LOCAL ] HSY: Loaded 50437 existing records from primary storage. [2025-10-16T19:28:36.650361] [INFO ] [MAIN ] HSY: Loaded 50437 existing records. [2025-10-16T19:28:36.746385] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-16T19:28:36.835303] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:36.835591] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-16T19:28:36.835673] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-16T19:28:36.836401] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-16T19:28:36.836462] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-16T19:28:37.154623] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:28:37.247194] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:37.542834] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-16T19:28:38.243141] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-16T19:28:38.342937] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-16T19:28:38.347391] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:28:39.142841] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-16T19:28:39.942824] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-16T19:28:40.044288] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T19:28:40.198334] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-16T19:28:40.742863] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-16T19:28:41.542807] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-16T19:28:41.784831] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-16T19:28:42.342874] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-16T19:28:42.660616] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-16T19:28:43.142823] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-16T19:28:43.342294] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:28:43.370949] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-16T19:28:43.942962] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-16T19:28:44.742873] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-16T19:28:44.898141] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-16T19:28:45.542890] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-16T19:28:45.659076] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:28:46.342890] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-16T19:28:46.636023] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-16T19:28:47.142816] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-16T19:28:47.463346] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:28:47.470478] [INFO ] [REMOTE ] HRL: Full fetch complete (76963 records). [2025-10-16T19:28:47.470626] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-16T19:28:47.860605] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-16T19:28:47.860706] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-16T19:28:47.861711] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-16T19:28:47.861773] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-16T19:28:47.863163] [DEBUG] [LOCAL ] HRL: Trimmed 76963 records to 53516 (keeping 200 days of data) [2025-10-16T19:28:47.951361] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-16T19:28:48.191561] [DEBUG] [LOCAL ] HRL: Primary data saved (53516 records). [2025-10-16T19:28:48.191981] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-16T19:28:48.192117] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRL took 43.6s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-16T19:28:48.363005] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:48.363195] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-16T19:28:48.363281] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-16T19:28:48.363512] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-16T19:28:48.363557] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-16T19:28:48.363598] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-16T19:28:48.363668] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-16T19:28:48.572733] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T19:28:48.762443] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-16T19:28:48.767989] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:48.804265] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:28:49.085904] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T19:28:49.542816] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-16T19:28:49.770790] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:28:49.771053] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-16T19:28:49.771140] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:28:49.771186] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-16T19:28:49.771219] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:28:49.771255] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-16T19:28:49.771309] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-16T19:28:49.771363] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-16T19:28:49.771428] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-16T19:28:49.771476] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HTB took 1.6s. Estimated remaining: 3h 4m 58s. Rate: 7.1 symbols/min [2025-10-16T19:28:49.940363] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:28:49.954152] [DEBUG] [LOCAL ] HTD: Loaded 14172 existing records from primary storage. [2025-10-16T19:28:49.954371] [INFO ] [MAIN ] HTD: Loaded 14172 existing records. [2025-10-16T19:28:50.129952] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:28:50.130346] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-16T19:28:50.130395] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-16T19:28:50.130875] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-16T19:28:50.130932] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-16T19:28:50.347168] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-16T19:28:50.487173] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:28:50.515492] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:28:51.082041] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:28:51.142826] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-16T19:28:51.942829] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-16T19:28:52.154172] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:28:52.742835] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-16T19:28:53.542802] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-16T19:28:53.563659] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:28:53.918174] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-16T19:28:54.342797] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-16T19:28:54.599837] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:28:55.142888] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-16T19:28:55.942877] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-16T19:28:56.096763] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-16T19:28:56.209795] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:28:56.742863] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-16T19:28:57.304448] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:28:57.542856] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-16T19:28:57.844853] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T19:28:58.342883] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-16T19:28:59.142843] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-16T19:28:59.246899] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:28:59.271940] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:28:59.874607] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:28:59.942806] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-16T19:29:00.742842] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-16T19:29:00.773442] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T19:29:01.542904] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-16T19:29:02.342820] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-16T19:29:02.600810] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:29:02.602976] [INFO ] [REMOTE ] HSHP: Full fetch complete (23288 records). [2025-10-16T19:29:02.603045] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-16T19:29:02.968399] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-16T19:29:03.027457] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-16T19:29:03.098052] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-16T19:29:03.098135] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-16T19:29:03.098887] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-16T19:29:03.098950] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-16T19:29:03.099563] [DEBUG] [LOCAL ] HSHP: Trimmed 23288 records to 14969 (keeping 200 days of data) [2025-10-16T19:29:03.160988] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-16T19:29:03.187895] [DEBUG] [LOCAL ] HSHP: Primary data saved (14969 records). [2025-10-16T19:29:03.188395] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-16T19:29:03.188685] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSHP took 29.2s. Estimated remaining: 3h 4m 56s. Rate: 7.1 symbols/min [2025-10-16T19:29:03.368801] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:03.368984] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-16T19:29:03.369022] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-16T19:29:03.369138] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-16T19:29:03.369181] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-16T19:29:03.369224] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-16T19:29:03.369258] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-16T19:29:03.848512] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:03.942905] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-16T19:29:04.054345] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-16T19:29:04.742822] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-16T19:29:05.128739] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-16T19:29:05.542835] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-16T19:29:05.715592] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-16T19:29:06.342861] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-16T19:29:06.669844] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-16T19:29:07.142817] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-16T19:29:07.469478] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:29:07.471304] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:29:07.942836] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-16T19:29:08.742837] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-16T19:29:09.542828] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-16T19:29:09.676853] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:29:09.780160] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-16T19:29:10.342824] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-16T19:29:10.595329] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T19:29:11.142824] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-16T19:29:11.942849] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-16T19:29:12.080924] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:29:12.433297] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-16T19:29:12.742848] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-16T19:29:13.107446] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T19:29:13.138429] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:29:13.145472] [INFO ] [REMOTE ] HSBC: Full fetch complete (74116 records). [2025-10-16T19:29:13.145606] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-16T19:29:13.535123] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-16T19:29:13.535197] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-16T19:29:13.536193] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-16T19:29:13.536255] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-16T19:29:13.537593] [DEBUG] [LOCAL ] HSBC: Trimmed 74116 records to 51390 (keeping 200 days of data) [2025-10-16T19:29:13.589826] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-16T19:29:13.842888] [DEBUG] [LOCAL ] HSBC: Primary data saved (51390 records). [2025-10-16T19:29:13.843054] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-16T19:29:13.843728] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 45.1s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-16T19:29:14.010437] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:14.055707] [DEBUG] [LOCAL ] HTGC: Loaded 47734 existing records from primary storage. [2025-10-16T19:29:14.055997] [INFO ] [MAIN ] HTGC: Loaded 47734 existing records. [2025-10-16T19:29:14.231303] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:14.231477] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-16T19:29:14.231523] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-16T19:29:14.231885] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-16T19:29:14.231941] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-16T19:29:14.347965] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-16T19:29:14.588891] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:14.633599] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:29:14.712626] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-16T19:29:15.142878] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-16T19:29:15.942810] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-16T19:29:16.742821] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-16T19:29:16.772763] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:29:16.802194] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-16T19:29:16.809798] [INFO ] [REMOTE ] HSY: Full fetch complete (73667 records). [2025-10-16T19:29:16.810066] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-16T19:29:17.144254] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:29:17.212691] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-16T19:29:17.212787] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-16T19:29:17.213918] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-16T19:29:17.213984] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-16T19:29:17.215414] [DEBUG] [LOCAL ] HSY: Trimmed 73667 records to 50818 (keeping 200 days of data) [2025-10-16T19:29:17.531791] [DEBUG] [LOCAL ] HSY: Primary data saved (50818 records). [2025-10-16T19:29:17.531923] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-16T19:29:17.532001] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 41.1s. Estimated remaining: 3h 4m 36s. Rate: 7.1 symbols/min [2025-10-16T19:29:17.548978] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-16T19:29:17.703201] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:17.734566] [DEBUG] [LOCAL ] HTH: Loaded 32576 existing records from primary storage. [2025-10-16T19:29:17.734859] [INFO ] [MAIN ] HTH: Loaded 32576 existing records. [2025-10-16T19:29:17.916813] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:17.917029] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-16T19:29:17.917087] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-16T19:29:17.917339] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-16T19:29:17.917377] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-16T19:29:18.276939] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:18.342780] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-16T19:29:18.572106] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-16T19:29:19.142846] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-16T19:29:19.232010] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:29:19.641770] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:29:19.942839] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-16T19:29:20.158504] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-16T19:29:20.742861] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-16T19:29:21.542782] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-16T19:29:21.837611] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:29:22.342806] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-16T19:29:22.822776] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:29:23.142820] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-16T19:29:23.163209] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:29:23.942823] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-16T19:29:24.742818] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-16T19:29:24.788723] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:29:25.374210] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:29:25.542769] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-16T19:29:25.702587] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:29:25.865310] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-16T19:29:26.342831] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-16T19:29:27.142799] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-16T19:29:27.493064] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-16T19:29:27.493793] [INFO ] [REMOTE ] HTFC: Full fetch complete (839 records). [2025-10-16T19:29:27.493863] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-16T19:29:27.684658] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-16T19:29:27.684843] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:29:27.684927] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:29:27.685021] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-16T19:29:27.685103] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-16T19:29:27.685143] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-16T19:29:27.685185] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-16T19:29:27.685239] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 24.5s. Estimated remaining: 3h 4m 30s. Rate: 7.1 symbols/min [2025-10-16T19:29:27.863249] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:27.898965] [DEBUG] [LOCAL ] HUBB: Loaded 36510 existing records from primary storage. [2025-10-16T19:29:27.899266] [INFO ] [MAIN ] HUBB: Loaded 36510 existing records. [2025-10-16T19:29:27.943718] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-16T19:29:28.083056] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:29:28.150884] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:28.151091] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-16T19:29:28.151165] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-16T19:29:28.152107] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-16T19:29:28.152167] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-16T19:29:28.497181] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:28.742776] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-16T19:29:29.013524] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:29:29.016472] [INFO ] [REMOTE ] HTD: Full fetch complete (19507 records). [2025-10-16T19:29:29.016545] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-16T19:29:29.374942] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-16T19:29:29.375030] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-16T19:29:29.375472] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-16T19:29:29.375515] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-16T19:29:29.376123] [DEBUG] [LOCAL ] HTD: Trimmed 19507 records to 14244 (keeping 200 days of data) [2025-10-16T19:29:29.460209] [DEBUG] [LOCAL ] HTD: Primary data saved (14244 records). [2025-10-16T19:29:29.460334] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-16T19:29:29.460410] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTD took 39.7s. Estimated remaining: 3h 4m 13s. Rate: 7.1 symbols/min [2025-10-16T19:29:29.550979] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-16T19:29:29.630806] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:29.666936] [DEBUG] [LOCAL ] HUBS: Loaded 40051 existing records from primary storage. [2025-10-16T19:29:29.667205] [INFO ] [MAIN ] HUBS: Loaded 40051 existing records. [2025-10-16T19:29:29.845532] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:29.845794] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-16T19:29:29.845865] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-16T19:29:29.846585] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-16T19:29:29.846687] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-16T19:29:30.041136] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:29:30.235006] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:30.342764] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-16T19:29:30.637472] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:29:31.142865] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-16T19:29:31.478487] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T19:29:31.942822] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-16T19:29:32.696315] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:29:32.742775] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-16T19:29:32.883627] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:29:33.542813] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-16T19:29:34.342799] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-16T19:29:34.395487] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-16T19:29:34.943141] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:29:35.142819] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-16T19:29:35.478122] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-16T19:29:35.942804] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-16T19:29:36.362449] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:29:36.742857] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-16T19:29:37.277011] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-16T19:29:37.542838] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-16T19:29:38.342802] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-16T19:29:38.398512] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:29:39.097513] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:29:39.142768] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-16T19:29:39.673230] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:29:39.942808] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-16T19:29:40.527335] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T19:29:40.742807] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-16T19:29:41.084071] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:29:41.542864] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-16T19:29:42.342794] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-16T19:29:42.547260] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T19:29:42.553967] [INFO ] [REMOTE ] HTGC: Full fetch complete (68841 records). [2025-10-16T19:29:42.554106] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-16T19:29:42.956830] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-16T19:29:42.956939] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-16T19:29:42.957936] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-16T19:29:42.957998] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-16T19:29:42.959342] [DEBUG] [LOCAL ] HTGC: Trimmed 68841 records to 48100 (keeping 200 days of data) [2025-10-16T19:29:43.143036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-16T19:29:43.257976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:29:43.298411] [DEBUG] [LOCAL ] HTGC: Primary data saved (48100 records). [2025-10-16T19:29:43.298559] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-16T19:29:43.299062] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 29.5s. Estimated remaining: 3h 4m 11s. Rate: 7.1 symbols/min [2025-10-16T19:29:43.472855] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:43.518998] [DEBUG] [LOCAL ] HUM: Loaded 49309 existing records from primary storage. [2025-10-16T19:29:43.519287] [INFO ] [MAIN ] HUM: Loaded 49309 existing records. [2025-10-16T19:29:43.716510] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:43.718042] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-16T19:29:43.724291] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-16T19:29:43.724667] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-16T19:29:43.725139] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-16T19:29:43.725200] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-16T19:29:43.948037] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-16T19:29:44.087138] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:44.753198] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-16T19:29:44.755632] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:29:45.182096] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:29:45.542863] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-16T19:29:46.342806] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-16T19:29:46.488074] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-16T19:29:46.567186] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T19:29:47.142857] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-16T19:29:47.678041] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:29:47.942792] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-16T19:29:48.557179] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-16T19:29:48.742789] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-16T19:29:49.542783] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-16T19:29:49.595471] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:29:50.004429] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:29:50.342903] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-16T19:29:51.106431] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:29:51.142848] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-16T19:29:51.742523] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:29:51.748550] [INFO ] [REMOTE ] HTH: Full fetch complete (46824 records). [2025-10-16T19:29:51.748804] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-16T19:29:51.950489] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-16T19:29:52.125090] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-16T19:29:52.125161] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-16T19:29:52.125946] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-16T19:29:52.126008] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-16T19:29:52.126926] [DEBUG] [LOCAL ] HTH: Trimmed 46824 records to 32799 (keeping 200 days of data) [2025-10-16T19:29:52.317070] [DEBUG] [LOCAL ] HTH: Primary data saved (32799 records). [2025-10-16T19:29:52.317214] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-16T19:29:52.317295] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTH took 34.8s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-16T19:29:52.503273] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:29:52.554412] [DEBUG] [LOCAL ] HUN: Loaded 53214 existing records from primary storage. [2025-10-16T19:29:52.554889] [INFO ] [MAIN ] HUN: Loaded 53214 existing records. [2025-10-16T19:29:52.737342] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:29:52.737678] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-16T19:29:52.737763] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-16T19:29:52.747104] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-16T19:29:52.747183] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-16T19:29:52.762045] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-16T19:29:52.845781] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-16T19:29:53.127770] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:29:53.525545] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:29:53.542766] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-16T19:29:54.342807] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-16T19:29:54.405934] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:29:54.876505] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:29:55.142822] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-16T19:29:55.697774] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:29:55.942880] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-16T19:29:56.259694] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-16T19:29:56.742877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-16T19:29:57.542784] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-16T19:29:57.695762] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-16T19:29:57.999976] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:29:58.342834] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-16T19:29:59.142854] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-16T19:29:59.321259] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-16T19:29:59.942854] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-16T19:29:59.982725] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-16T19:29:59.988515] [INFO ] [REMOTE ] HUBS: Full fetch complete (56696 records). [2025-10-16T19:29:59.988680] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-16T19:30:00.377290] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-16T19:30:00.377394] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-16T19:30:00.378361] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-16T19:30:00.378452] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-16T19:30:00.379926] [DEBUG] [LOCAL ] HUBS: Trimmed 56696 records to 40357 (keeping 200 days of data) [2025-10-16T19:30:00.527891] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:30:00.659026] [DEBUG] [LOCAL ] HUBS: Primary data saved (40357 records). [2025-10-16T19:30:00.659147] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-16T19:30:00.659220] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBS took 31.2s. Estimated remaining: 3h 3m 55s. Rate: 7.1 symbols/min [2025-10-16T19:30:00.747970] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-16T19:30:00.828917] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:00.866092] [DEBUG] [LOCAL ] HUYA: Loaded 43809 existing records from primary storage. [2025-10-16T19:30:00.866371] [INFO ] [MAIN ] HUYA: Loaded 43809 existing records. [2025-10-16T19:30:01.043208] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:01.043492] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-16T19:30:01.043563] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-16T19:30:01.044343] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-16T19:30:01.044426] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-16T19:30:01.347877] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:30:01.434950] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:01.542825] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-16T19:30:02.342794] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-16T19:30:02.756089] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-16T19:30:02.955968] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:30:03.142838] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-16T19:30:03.866003] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:30:03.942784] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-16T19:30:04.725043] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:30:04.742770] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-16T19:30:05.248272] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-16T19:30:05.253029] [INFO ] [REMOTE ] HUBB: Full fetch complete (54300 records). [2025-10-16T19:30:05.253121] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-16T19:30:05.548832] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-16T19:30:05.684416] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-16T19:30:05.684495] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-16T19:30:05.685443] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-16T19:30:05.685508] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-16T19:30:05.686883] [DEBUG] [LOCAL ] HUBB: Trimmed 54300 records to 36713 (keeping 200 days of data) [2025-10-16T19:30:05.940785] [DEBUG] [LOCAL ] HUBB: Primary data saved (36713 records). [2025-10-16T19:30:05.940964] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-16T19:30:05.941056] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBB took 38.3s. Estimated remaining: 3h 3m 42s. Rate: 7.1 symbols/min [2025-10-16T19:30:06.135481] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:06.151275] [DEBUG] [LOCAL ] HVT: Loaded 15120 existing records from primary storage. [2025-10-16T19:30:06.151712] [INFO ] [MAIN ] HVT: Loaded 15120 existing records. [2025-10-16T19:30:06.344078] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-16T19:30:06.338852] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:06.357534] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-16T19:30:06.357672] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-16T19:30:06.358259] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-16T19:30:06.359886] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:30:06.360182] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-16T19:30:06.786596] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:07.046869] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:30:07.142814] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-16T19:30:07.942820] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-16T19:30:08.024054] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:30:08.742828] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-16T19:30:09.156735] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T19:30:09.542786] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-16T19:30:09.624281] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:30:10.342820] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-16T19:30:11.142792] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-16T19:30:11.145225] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-16T19:30:11.343786] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:30:11.758767] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:30:11.942828] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-16T19:30:12.233868] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-16T19:30:12.742857] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-16T19:30:13.156610] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:30:13.542812] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-16T19:30:13.733920] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T19:30:14.342832] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-16T19:30:15.051686] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:30:15.142793] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-16T19:30:15.331695] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T19:30:15.942822] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-16T19:30:16.742858] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-16T19:30:17.208205] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-16T19:30:17.263512] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-16T19:30:17.542833] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-16T19:30:18.339224] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:30:18.348874] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-16T19:30:19.127871] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-16T19:30:19.142781] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-16T19:30:19.942827] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-16T19:30:19.996501] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:30:20.047579] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T19:30:20.742822] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-16T19:30:21.542791] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-16T19:30:21.722201] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:30:22.342787] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-16T19:30:22.622215] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T19:30:23.142787] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-16T19:30:23.358330] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-16T19:30:23.734179] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-16T19:30:23.942823] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-16T19:30:24.742788] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-16T19:30:25.146455] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-16T19:30:25.152856] [INFO ] [REMOTE ] HUM: Full fetch complete (71091 records). [2025-10-16T19:30:25.152981] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-16T19:30:25.540253] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-16T19:30:25.540329] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-16T19:30:25.541308] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-16T19:30:25.541370] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-16T19:30:25.542691] [DEBUG] [LOCAL ] HUM: Trimmed 71091 records to 49651 (keeping 200 days of data) [2025-10-16T19:30:25.543182] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-16T19:30:25.824906] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:30:25.887135] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-16T19:30:25.917077] [DEBUG] [LOCAL ] HUM: Primary data saved (49651 records). [2025-10-16T19:30:25.917381] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-16T19:30:25.918005] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUM took 42.6s. Estimated remaining: 3h 3m 48s. Rate: 7.1 symbols/min [2025-10-16T19:30:26.085540] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:26.141059] [DEBUG] [LOCAL ] HWM: Loaded 52813 existing records from primary storage. [2025-10-16T19:30:26.141379] [INFO ] [MAIN ] HWM: Loaded 52813 existing records. [2025-10-16T19:30:26.314841] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:26.315034] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-16T19:30:26.315081] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-16T19:30:26.315952] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-16T19:30:26.316009] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-16T19:30:26.347935] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-16T19:30:26.666107] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:26.945463] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:30:27.142822] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-16T19:30:27.909500] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:30:27.942780] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-16T19:30:28.742810] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-16T19:30:29.008048] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:30:29.416045] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T19:30:29.422906] [INFO ] [REMOTE ] HUN: Full fetch complete (76974 records). [2025-10-16T19:30:29.423026] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-16T19:30:29.547996] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-16T19:30:29.803339] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-16T19:30:29.830393] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-16T19:30:29.830465] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-16T19:30:29.831490] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-16T19:30:29.831553] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-16T19:30:29.832870] [DEBUG] [LOCAL ] HUN: Trimmed 76974 records to 53604 (keeping 200 days of data) [2025-10-16T19:30:30.154739] [DEBUG] [LOCAL ] HUN: Primary data saved (53604 records). [2025-10-16T19:30:30.154890] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-16T19:30:30.155326] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUN took 37.8s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-16T19:30:30.322705] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:30.345794] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-16T19:30:30.365567] [DEBUG] [LOCAL ] HXL: Loaded 45841 existing records from primary storage. [2025-10-16T19:30:30.365935] [INFO ] [MAIN ] HXL: Loaded 45841 existing records. [2025-10-16T19:30:30.546556] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:30.546794] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-16T19:30:30.546843] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-16T19:30:30.547578] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-16T19:30:30.547636] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-16T19:30:30.889042] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:31.142787] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-16T19:30:31.562856] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T19:30:31.631901] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-16T19:30:31.638078] [INFO ] [REMOTE ] HUYA: Full fetch complete (64184 records). [2025-10-16T19:30:31.638209] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-16T19:30:31.947906] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-16T19:30:32.022683] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-16T19:30:32.022883] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-16T19:30:32.023993] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-16T19:30:32.024091] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-16T19:30:32.025369] [DEBUG] [LOCAL ] HUYA: Trimmed 64184 records to 44168 (keeping 200 days of data) [2025-10-16T19:30:32.205005] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:30:32.288272] [DEBUG] [LOCAL ] HUYA: Primary data saved (44168 records). [2025-10-16T19:30:32.288438] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-16T19:30:32.288603] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUYA took 31.6s. Estimated remaining: 3h 3m 18s. Rate: 7.1 symbols/min [2025-10-16T19:30:32.452516] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:32.462715] [DEBUG] [LOCAL ] HY: Loaded 10057 existing records from primary storage. [2025-10-16T19:30:32.462933] [INFO ] [MAIN ] HY: Loaded 10057 existing records. [2025-10-16T19:30:32.635004] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:30:32.635215] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-16T19:30:32.635265] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-16T19:30:32.635553] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-16T19:30:32.635666] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-16T19:30:32.747936] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-16T19:30:32.992880] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:33.497979] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-16T19:30:33.542776] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-16T19:30:33.763979] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-16T19:30:34.342787] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-16T19:30:34.417107] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-16T19:30:34.975261] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T19:30:35.142829] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-16T19:30:35.942820] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-16T19:30:36.748595] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-16T19:30:36.753811] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:30:36.854951] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:30:36.857245] [INFO ] [REMOTE ] HVT: Full fetch complete (23184 records). [2025-10-16T19:30:36.857321] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-16T19:30:37.226858] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-16T19:30:37.226983] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-16T19:30:37.227547] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-16T19:30:37.227594] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-16T19:30:37.228239] [DEBUG] [LOCAL ] HVT: Trimmed 23184 records to 15241 (keeping 200 days of data) [2025-10-16T19:30:37.321089] [DEBUG] [LOCAL ] HVT: Primary data saved (15241 records). [2025-10-16T19:30:37.321228] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-16T19:30:37.321307] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HVT took 31.4s. Estimated remaining: 3h 3m 6s. Rate: 7.1 symbols/min [2025-10-16T19:30:37.484786] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:37.484975] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-16T19:30:37.485032] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-16T19:30:37.485162] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-16T19:30:37.485202] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-16T19:30:37.485242] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-16T19:30:37.485273] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-16T19:30:37.548074] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-16T19:30:37.830249] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:38.342795] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-16T19:30:38.424707] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:30:38.541710] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-16T19:30:39.142830] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-16T19:30:39.615717] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-16T19:30:39.942843] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-16T19:30:40.269279] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T19:30:40.742805] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-16T19:30:41.052633] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-16T19:30:41.082563] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-16T19:30:41.542831] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-16T19:30:42.342830] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-16T19:30:43.149627] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-16T19:30:43.151679] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:30:43.419123] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-16T19:30:43.942851] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-16T19:30:44.714102] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:30:44.742797] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-16T19:30:44.760137] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T19:30:45.542824] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-16T19:30:45.867940] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-16T19:30:46.342782] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-16T19:30:46.616215] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-16T19:30:46.667579] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-16T19:30:47.142812] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-16T19:30:47.942814] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-16T19:30:48.742774] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-16T19:30:48.936532] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-16T19:30:49.542843] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-16T19:30:49.589877] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:30:49.626815] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T19:30:49.774148] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-16T19:30:50.342831] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-16T19:30:51.142830] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-16T19:30:51.942887] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-16T19:30:51.977857] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-16T19:30:52.079055] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:30:52.742811] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-16T19:30:53.492194] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:30:53.542773] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-16T19:30:54.038711] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:30:54.335580] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:30:54.342762] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-16T19:30:54.832836] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-16T19:30:55.142825] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-16T19:30:55.942796] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-16T19:30:55.980195] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:30:56.742803] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-16T19:30:57.055699] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T19:30:57.538606] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:30:57.547814] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-16T19:30:58.342790] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-16T19:30:58.360882] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:30:58.362619] [INFO ] [REMOTE ] HY: Full fetch complete (15005 records). [2025-10-16T19:30:58.362728] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-16T19:30:58.719364] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-16T19:30:58.719436] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-16T19:30:58.719791] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-16T19:30:58.719852] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-16T19:30:58.720317] [DEBUG] [LOCAL ] HY: Trimmed 15005 records to 10116 (keeping 200 days of data) [2025-10-16T19:30:58.782174] [DEBUG] [LOCAL ] HY: Primary data saved (10116 records). [2025-10-16T19:30:58.782311] [INFO ] [MAIN ] HY: Full history saved. [2025-10-16T19:30:58.782391] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HY took 26.5s. Estimated remaining: 3h 3m 13s. Rate: 7.1 symbols/min [2025-10-16T19:30:58.952084] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:30:58.952271] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-16T19:30:58.952308] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-16T19:30:58.952419] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-16T19:30:58.952459] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-16T19:30:58.952498] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-16T19:30:58.952530] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-16T19:30:59.151688] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-16T19:30:59.310204] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:30:59.535513] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-16T19:30:59.942827] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-16T19:31:00.200593] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T19:31:00.742798] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-16T19:31:01.542779] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-16T19:31:01.726673] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:31:01.821927] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-16T19:31:02.342877] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-16T19:31:02.636566] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-16T19:31:02.684831] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:31:03.142839] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-16T19:31:03.942844] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-16T19:31:04.188600] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-16T19:31:04.742792] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-16T19:31:04.895749] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-16T19:31:04.902369] [INFO ] [REMOTE ] HWM: Full fetch complete (76684 records). [2025-10-16T19:31:04.902508] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-16T19:31:05.006699] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-16T19:31:05.291100] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-16T19:31:05.291177] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-16T19:31:05.292199] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-16T19:31:05.292261] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-16T19:31:05.293628] [DEBUG] [LOCAL ] HWM: Trimmed 76684 records to 53180 (keeping 200 days of data) [2025-10-16T19:31:05.567990] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-16T19:31:05.615864] [DEBUG] [LOCAL ] HWM: Primary data saved (53180 records). [2025-10-16T19:31:05.615980] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-16T19:31:05.616596] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HWM took 39.7s. Estimated remaining: 3h 3m 3s. Rate: 7.1 symbols/min [2025-10-16T19:31:05.788294] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:05.800054] [DEBUG] [LOCAL ] HYI: Loaded 9824 existing records from primary storage. [2025-10-16T19:31:05.800289] [INFO ] [MAIN ] HYI: Loaded 9824 existing records. [2025-10-16T19:31:05.939990] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-16T19:31:05.983058] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:05.983319] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-16T19:31:05.983375] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-16T19:31:05.983965] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-16T19:31:05.984028] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-16T19:31:06.348023] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-16T19:31:06.355680] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:06.778277] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-16T19:31:07.142809] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-16T19:31:07.874092] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-16T19:31:07.942825] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-16T19:31:08.251247] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-16T19:31:08.742811] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-16T19:31:08.956747] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-16T19:31:09.542806] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-16T19:31:09.885239] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-16T19:31:10.342820] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-16T19:31:11.142813] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-16T19:31:11.889205] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:31:11.923389] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:31:11.942771] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-16T19:31:12.742777] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-16T19:31:12.754369] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:31:13.065209] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-16T19:31:13.542858] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-16T19:31:13.793634] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-16T19:31:14.342808] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-16T19:31:14.580966] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-16T19:31:15.142815] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-16T19:31:15.499961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T19:31:15.500616] [INFO ] [REMOTE ] HYBX: Full fetch complete (707 records). [2025-10-16T19:31:15.500727] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-16T19:31:15.679284] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-16T19:31:15.679489] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:31:15.679558] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:31:15.679609] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-16T19:31:15.679702] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-16T19:31:15.679768] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-16T19:31:15.679819] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-16T19:31:15.679875] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HYBX took 16.9s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-16T19:31:15.856039] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:15.887168] [DEBUG] [LOCAL ] HYT: Loaded 33599 existing records from primary storage. [2025-10-16T19:31:15.887464] [INFO ] [MAIN ] HYT: Loaded 33599 existing records. [2025-10-16T19:31:15.948017] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-16T19:31:16.065779] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:16.065990] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-16T19:31:16.066038] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-16T19:31:16.066235] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-16T19:31:16.066295] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-16T19:31:16.243004] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-16T19:31:16.428967] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:16.742816] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-16T19:31:17.542855] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-16T19:31:18.022704] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-16T19:31:18.028573] [INFO ] [REMOTE ] HYAC: Full fetch complete (923 records). [2025-10-16T19:31:18.030350] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-16T19:31:18.104791] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:31:18.219612] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-16T19:31:18.219807] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:31:18.219875] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:31:18.220123] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-16T19:31:18.220185] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-16T19:31:18.220223] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-16T19:31:18.220263] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-16T19:31:18.220318] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYAC took 40.9s. Estimated remaining: 3h 2m 40s. Rate: 7.1 symbols/min [2025-10-16T19:31:18.347910] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-16T19:31:18.391407] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:18.396520] [DEBUG] [LOCAL ] HYTR: Loaded 3132 existing records from primary storage. [2025-10-16T19:31:18.396696] [INFO ] [MAIN ] HYTR: Loaded 3132 existing records. [2025-10-16T19:31:18.581087] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:18.581368] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-16T19:31:18.581429] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-16T19:31:18.581567] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-16T19:31:18.581605] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-16T19:31:18.936116] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:19.142812] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-16T19:31:19.564629] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-16T19:31:19.729804] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-16T19:31:19.942813] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-16T19:31:20.742808] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-16T19:31:21.145184] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:31:21.487322] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:31:21.542773] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-16T19:31:22.336549] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:31:22.342765] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-16T19:31:23.015415] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-16T19:31:23.142811] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-16T19:31:23.615947] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:31:23.942819] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-16T19:31:24.333636] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:31:24.742807] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-16T19:31:25.318272] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:31:25.542803] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-16T19:31:26.076969] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T19:31:26.342810] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-16T19:31:27.028073] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:31:27.142839] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-16T19:31:27.942798] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-16T19:31:28.441751] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:31:28.742761] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-16T19:31:29.296478] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:31:29.542776] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-16T19:31:29.569537] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:31:30.342824] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-16T19:31:30.824833] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-16T19:31:31.045147] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:31:31.142769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-16T19:31:31.942829] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-16T19:31:32.557974] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:31:32.742831] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-16T19:31:33.022535] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-16T19:31:33.028749] [INFO ] [REMOTE ] HXL: Full fetch complete (66467 records). [2025-10-16T19:31:33.028908] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-16T19:31:33.380719] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-16T19:31:33.465631] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-16T19:31:33.465745] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-16T19:31:33.466703] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-16T19:31:33.466769] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-16T19:31:33.468115] [DEBUG] [LOCAL ] HXL: Trimmed 66467 records to 46186 (keeping 200 days of data) [2025-10-16T19:31:33.558333] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-16T19:31:33.748448] [DEBUG] [LOCAL ] HXL: Primary data saved (46186 records). [2025-10-16T19:31:33.748631] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-16T19:31:33.749087] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HXL took 1m 4s. Estimated remaining: 3h 2m 41s. Rate: 7.1 symbols/min [2025-10-16T19:31:33.915145] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:33.942538] [DEBUG] [LOCAL ] HZO: Loaded 29081 existing records from primary storage. [2025-10-16T19:31:33.942831] [INFO ] [MAIN ] HZO: Loaded 29081 existing records. [2025-10-16T19:31:34.100249] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-16T19:31:34.132177] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:34.132403] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-16T19:31:34.132474] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-16T19:31:34.132759] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-16T19:31:34.132815] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-16T19:31:34.348116] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-16T19:31:34.498001] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:34.712100] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T19:31:35.142819] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-16T19:31:35.942813] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-16T19:31:36.365292] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-16T19:31:36.450021] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T19:31:36.742855] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-16T19:31:37.469076] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:31:37.542808] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-16T19:31:38.342818] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-16T19:31:38.889016] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:31:39.033967] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:31:39.035036] [INFO ] [REMOTE ] HYTR: Full fetch complete (4673 records). [2025-10-16T19:31:39.035109] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-16T19:31:39.150891] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-16T19:31:39.462176] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-16T19:31:39.462276] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-16T19:31:39.462476] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-16T19:31:39.462522] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-16T19:31:39.462952] [DEBUG] [LOCAL ] HYTR: Trimmed 4673 records to 3165 (keeping 200 days of data) [2025-10-16T19:31:39.483784] [DEBUG] [LOCAL ] HYTR: Primary data saved (3165 records). [2025-10-16T19:31:39.483898] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-16T19:31:39.483978] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYTR took 21.3s. Estimated remaining: 3h 2m 29s. Rate: 7.1 symbols/min [2025-10-16T19:31:39.675748] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:39.684488] [DEBUG] [LOCAL ] IAE: Loaded 6256 existing records from primary storage. [2025-10-16T19:31:39.684743] [INFO ] [MAIN ] IAE: Loaded 6256 existing records. [2025-10-16T19:31:39.862979] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:39.863214] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-16T19:31:39.863271] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-16T19:31:39.863448] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-16T19:31:39.863504] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-16T19:31:39.952556] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-16T19:31:40.231148] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:40.562022] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:31:40.742764] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-16T19:31:40.998307] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-16T19:31:41.445064] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:31:41.542793] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-16T19:31:42.342787] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-16T19:31:42.501746] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-16T19:31:42.941530] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-16T19:31:43.142795] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-16T19:31:43.942777] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-16T19:31:44.335377] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:31:44.742823] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-16T19:31:45.080612] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-16T19:31:45.325114] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:31:45.329844] [INFO ] [REMOTE ] HYT: Full fetch complete (47958 records). [2025-10-16T19:31:45.329964] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-16T19:31:45.549112] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-16T19:31:45.710027] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-16T19:31:45.710115] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-16T19:31:45.710932] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-16T19:31:45.710993] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-16T19:31:45.712119] [DEBUG] [LOCAL ] HYT: Trimmed 47958 records to 33837 (keeping 200 days of data) [2025-10-16T19:31:45.915262] [DEBUG] [LOCAL ] HYT: Primary data saved (33837 records). [2025-10-16T19:31:45.915399] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-16T19:31:45.915477] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYT took 30.2s. Estimated remaining: 3h 2m 18s. Rate: 7.1 symbols/min [2025-10-16T19:31:46.083282] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:31:46.132232] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-16T19:31:46.132562] [INFO ] [MAIN ] IAG: Loaded 53488 existing records. [2025-10-16T19:31:46.314260] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:31:46.314511] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-16T19:31:46.314562] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-16T19:31:46.314756] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-16T19:31:46.314813] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-16T19:31:46.348062] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-16T19:31:46.676167] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:31:46.692253] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:31:47.142820] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-16T19:31:47.318339] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:31:47.320745] [INFO ] [REMOTE ] HYI: Full fetch complete (13984 records). [2025-10-16T19:31:47.320815] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-16T19:31:47.682198] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-16T19:31:47.682288] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-16T19:31:47.682683] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-16T19:31:47.682777] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-16T19:31:47.683275] [DEBUG] [LOCAL ] HYI: Trimmed 13984 records to 9891 (keeping 200 days of data) [2025-10-16T19:31:47.746847] [DEBUG] [LOCAL ] HYI: Primary data saved (9891 records). [2025-10-16T19:31:47.751589] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-16T19:31:47.752229] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYI took 42.1s. Estimated remaining: 3h 2m 1s. Rate: 7.1 symbols/min [2025-10-16T19:31:47.752444] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-16T19:31:47.942846] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-16T19:31:48.742830] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-16T19:31:49.362280] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:31:49.542844] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-16T19:31:49.731306] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-16T19:31:49.887282] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-16T19:31:50.342820] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-16T19:31:51.142873] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-16T19:31:51.818879] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-16T19:31:51.942786] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-16T19:31:52.143576] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-16T19:31:52.562314] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-16T19:31:52.742845] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-16T19:31:53.433813] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-16T19:31:53.542828] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-16T19:31:54.130368] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-16T19:31:54.342830] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-16T19:31:55.071142] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-16T19:31:55.142874] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-16T19:31:55.942829] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-16T19:31:56.669921] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:31:56.742775] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-16T19:31:56.792191] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-16T19:31:57.542856] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-16T19:31:58.342840] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-16T19:31:58.401669] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-16T19:31:59.075756] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:31:59.092639] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-16T19:31:59.094768] [INFO ] [REMOTE ] IAE: Full fetch complete (9053 records). [2025-10-16T19:31:59.094885] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-16T19:31:59.151262] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-16T19:31:59.467121] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-16T19:31:59.467195] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-16T19:31:59.467412] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-16T19:31:59.467451] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-16T19:31:59.467892] [DEBUG] [LOCAL ] IAE: Trimmed 9053 records to 6326 (keeping 200 days of data) [2025-10-16T19:31:59.504084] [DEBUG] [LOCAL ] IAE: Primary data saved (6326 records). [2025-10-16T19:31:59.504224] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-16T19:31:59.504306] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. IAE took 20.0s. Estimated remaining: 3h 1m 57s. Rate: 7.1 symbols/min [2025-10-16T19:31:59.942822] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-16T19:32:01.274408] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:32:01.281747] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-16T19:32:01.393540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T19:32:01.542916] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-16T19:32:02.440529] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:32:02.447594] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-16T19:32:03.273901] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:32:03.285985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-16T19:32:03.629767] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T19:32:03.942924] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-16T19:32:05.203304] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:32:05.216420] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-16T19:32:05.222960] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-16T19:32:05.542861] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-16T19:32:06.517571] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:32:06.525083] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-16T19:32:07.152249] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:32:07.164633] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-16T19:32:07.738836] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:32:07.742748] [INFO ] [REMOTE ] HZO: Full fetch complete (41409 records). [2025-10-16T19:32:07.742848] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-16T19:32:08.107329] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-16T19:32:08.107408] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-16T19:32:08.108159] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-16T19:32:08.108221] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-16T19:32:08.109138] [DEBUG] [LOCAL ] HZO: Trimmed 41409 records to 29275 (keeping 200 days of data) [2025-10-16T19:32:08.275456] [DEBUG] [LOCAL ] HZO: Primary data saved (29275 records). [2025-10-16T19:32:08.275605] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-16T19:32:08.275710] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. HZO took 34.5s. Estimated remaining: 3h 1m 49s. Rate: 7.1 symbols/min [2025-10-16T19:32:09.070505] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T19:32:09.083160] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-16T19:32:11.160934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-16T19:32:11.172531] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-16T19:32:13.275628] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:32:13.282616] [INFO ] [REMOTE ] IAG: Full fetch complete (77488 records). [2025-10-16T19:32:13.282804] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-16T19:32:13.665963] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-16T19:32:13.666095] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-16T19:32:13.667182] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-16T19:32:13.667455] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-16T19:32:13.669512] [DEBUG] [LOCAL ] IAG: Trimmed 77488 records to 53878 (keeping 200 days of data) [2025-10-16T19:32:13.969364] [DEBUG] [LOCAL ] IAG: Primary data saved (53878 records). [2025-10-16T19:32:13.969505] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-16T19:32:13.969586] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 28.1s. Estimated remaining: 3h 1m 37s. Rate: 7.1 symbols/min [2025-10-16T19:32:14.482383] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.626029] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.664066] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.684587] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:14.726536] [DEBUG] [LOCAL ] IBTA: Loaded 36655 existing records from primary storage. [2025-10-16T19:32:14.727006] [INFO ] [MAIN ] IBTA: Loaded 36655 existing records. [2025-10-16T19:32:14.842142] [DEBUG] [LOCAL ] IBP: Loaded 28891 existing records from primary storage. [2025-10-16T19:32:14.871717] [INFO ] [MAIN ] IBP: Loaded 28891 existing records. [2025-10-16T19:32:15.037028] [DEBUG] [LOCAL ] IBM: Loaded 53633 existing records from primary storage. [2025-10-16T19:32:15.076473] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.086631] [INFO ] [MAIN ] IBM: Loaded 53633 existing records. [2025-10-16T19:32:15.092692] [DEBUG] [LOCAL ] IBN: Loaded 52819 existing records from primary storage. [2025-10-16T19:32:15.086327] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.136240] [INFO ] [MAIN ] IBN: Loaded 52819 existing records. [2025-10-16T19:32:15.141441] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-16T19:32:15.259112] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-16T19:32:15.293048] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-16T19:32:15.405272] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.441471] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.446749] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-16T19:32:15.535144] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-16T19:32:15.550728] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-16T19:32:15.678610] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.766174] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.802907] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:15.800056] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-16T19:32:15.837425] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-16T19:32:15.827046] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-16T19:32:15.848034] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-16T19:32:15.861754] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-16T19:32:15.934696] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-16T19:32:15.939961] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-16T19:32:16.345696] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:16.381485] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-16T19:32:16.954929] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.013965] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-16T19:32:17.003159] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.043575] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-16T19:32:17.075401] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:17.075786] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-16T19:32:17.876106] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:32:17.885560] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-16T19:32:18.289037] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T19:32:18.294438] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-16T19:32:18.780276] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-16T19:32:18.800395] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T19:32:18.810605] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-16T19:32:18.811515] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-16T19:32:18.885418] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:32:18.896313] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-16T19:32:19.484899] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:32:19.490288] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-16T19:32:19.986571] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T19:32:19.991723] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-16T19:32:20.130598] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-16T19:32:20.141452] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-16T19:32:20.806420] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-16T19:32:20.812356] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-16T19:32:21.084270] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-16T19:32:21.097676] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-16T19:32:21.377235] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:32:21.387025] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-16T19:32:21.679860] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-16T19:32:21.686255] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-16T19:32:21.828988] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-16T19:32:22.342809] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-16T19:32:22.611130] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T19:32:22.773523] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:32:22.858156] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:32:23.142817] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-16T19:32:23.735360] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:32:23.942832] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-16T19:32:24.742816] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-16T19:32:25.261228] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:32:25.542821] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-16T19:32:25.842933] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:32:26.080021] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:32:26.342824] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-16T19:32:26.516701] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-16T19:32:27.142806] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-16T19:32:27.942800] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-16T19:32:28.106030] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:32:28.180006] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-16T19:32:28.742893] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-16T19:32:29.542815] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-16T19:32:29.980037] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-16T19:32:30.222684] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-16T19:32:30.342773] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-16T19:32:30.801100] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:32:31.142843] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-16T19:32:31.698103] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-16T19:32:31.942818] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-16T19:32:32.430962] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:32:32.742781] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-16T19:32:33.122462] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-16T19:32:33.542808] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-16T19:32:34.321744] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:32:34.342963] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-16T19:32:35.142829] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-16T19:32:35.224774] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:32:35.329580] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-16T19:32:35.942835] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-16T19:32:36.446058] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:32:36.449869] [INFO ] [REMOTE ] IBP: Full fetch complete (41129 records). [2025-10-16T19:32:36.449961] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-16T19:32:36.747944] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-16T19:32:36.829226] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-16T19:32:36.829310] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-16T19:32:36.830111] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-16T19:32:36.830175] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-16T19:32:36.831216] [DEBUG] [LOCAL ] IBP: Trimmed 41129 records to 29018 (keeping 200 days of data) [2025-10-16T19:32:37.007042] [DEBUG] [LOCAL ] IBP: Primary data saved (29018 records). [2025-10-16T19:32:37.007173] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-16T19:32:37.007249] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 23.0s. Estimated remaining: 3h 1m 46s. Rate: 7.1 symbols/min [2025-10-16T19:32:37.174663] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:37.225237] [DEBUG] [LOCAL ] ICE: Loaded 53018 existing records from primary storage. [2025-10-16T19:32:37.225587] [INFO ] [MAIN ] ICE: Loaded 53018 existing records. [2025-10-16T19:32:37.403564] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:37.403772] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-16T19:32:37.403843] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-16T19:32:37.404179] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-16T19:32:37.404238] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-16T19:32:37.547978] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-16T19:32:37.775666] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:37.847272] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T19:32:37.892412] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-16T19:32:37.897073] [INFO ] [REMOTE ] IBTA: Full fetch complete (51182 records). [2025-10-16T19:32:37.897165] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-16T19:32:38.288200] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-16T19:32:38.288279] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-16T19:32:38.289175] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-16T19:32:38.289237] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-16T19:32:38.290307] [DEBUG] [LOCAL ] IBTA: Trimmed 51182 records to 36892 (keeping 200 days of data) [2025-10-16T19:32:38.345039] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-16T19:32:38.501055] [DEBUG] [LOCAL ] IBTA: Primary data saved (36892 records). [2025-10-16T19:32:38.501232] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-16T19:32:38.501352] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBTA took 24.5s. Estimated remaining: 3h 1m 29s. Rate: 7.1 symbols/min [2025-10-16T19:32:38.671782] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:38.708132] [DEBUG] [LOCAL ] ICL: Loaded 38552 existing records from primary storage. [2025-10-16T19:32:38.708411] [INFO ] [MAIN ] ICL: Loaded 38552 existing records. [2025-10-16T19:32:38.885188] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:38.885376] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-16T19:32:38.885422] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-16T19:32:38.885618] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-16T19:32:38.885706] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-16T19:32:39.149299] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-16T19:32:39.246343] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:39.342519] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-16T19:32:39.942816] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-16T19:32:40.145168] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-16T19:32:40.556608] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-16T19:32:40.742807] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-16T19:32:41.456450] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-16T19:32:41.542816] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-16T19:32:42.342827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-16T19:32:42.422956] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-16T19:32:43.142791] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-16T19:32:43.232556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-16T19:32:43.773330] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:32:43.942841] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-16T19:32:44.533232] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:32:44.742814] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-16T19:32:45.542851] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-16T19:32:45.634750] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:32:46.132217] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:32:46.342815] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-16T19:32:47.142869] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-16T19:32:47.426275] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-16T19:32:47.835365] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:32:47.942854] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-16T19:32:48.742849] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-16T19:32:49.554287] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-16T19:32:49.561515] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-16T19:32:49.621690] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:32:50.342814] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-16T19:32:50.562379] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-16T19:32:50.569295] [INFO ] [REMOTE ] IBN: Full fetch complete (76548 records). [2025-10-16T19:32:50.569448] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-16T19:32:50.970009] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-16T19:32:50.970383] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-16T19:32:50.971768] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-16T19:32:50.971878] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-16T19:32:50.973820] [DEBUG] [LOCAL ] IBN: Trimmed 76548 records to 53205 (keeping 200 days of data) [2025-10-16T19:32:51.094166] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:32:51.181383] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-16T19:32:51.331002] [DEBUG] [LOCAL ] IBN: Primary data saved (53205 records). [2025-10-16T19:32:51.331149] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-16T19:32:51.331997] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 37.4s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-16T19:32:51.501807] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:51.542670] [DEBUG] [LOCAL ] IDA: Loaded 32824 existing records from primary storage. [2025-10-16T19:32:51.542969] [INFO ] [MAIN ] IDA: Loaded 32824 existing records. [2025-10-16T19:32:51.742121] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:51.742377] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-16T19:32:51.742435] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-16T19:32:51.742629] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-16T19:32:51.742735] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-16T19:32:51.948556] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-16T19:32:52.108068] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:52.241832] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-16T19:32:52.637812] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-16T19:32:52.742836] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-16T19:32:53.542922] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-16T19:32:54.015501] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-16T19:32:54.342800] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-16T19:32:54.382210] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-16T19:32:55.142850] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-16T19:32:55.214287] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:32:55.770865] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:32:55.942825] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-16T19:32:56.742822] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-16T19:32:57.095460] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-16T19:32:57.472834] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-16T19:32:57.542860] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-16T19:32:58.082042] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:32:58.342833] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-16T19:32:58.362281] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-16T19:32:58.369239] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-16T19:32:58.369371] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-16T19:32:58.752941] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-16T19:32:58.753043] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-16T19:32:58.754120] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-16T19:32:58.754182] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-16T19:32:58.755675] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 54023 (keeping 200 days of data) [2025-10-16T19:32:59.084225] [DEBUG] [LOCAL ] IBM: Primary data saved (54023 records). [2025-10-16T19:32:59.084336] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-16T19:32:59.085095] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 45.1s. Estimated remaining: 3h 1m 17s. Rate: 7.1 symbols/min [2025-10-16T19:32:59.148064] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-16T19:32:59.254293] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:32:59.267153] [DEBUG] [LOCAL ] IDE: Loaded 9108 existing records from primary storage. [2025-10-16T19:32:59.267385] [INFO ] [MAIN ] IDE: Loaded 9108 existing records. [2025-10-16T19:32:59.443887] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:32:59.444160] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-16T19:32:59.444216] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-16T19:32:59.444358] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-16T19:32:59.444396] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-16T19:32:59.825453] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-16T19:32:59.829151] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:32:59.942829] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-16T19:33:00.546549] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-16T19:33:00.742818] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-16T19:33:01.444517] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:33:01.453003] [INFO ] [REMOTE ] ICL: Full fetch complete (56207 records). [2025-10-16T19:33:01.453166] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-16T19:33:01.548748] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-16T19:33:01.852821] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-16T19:33:01.852899] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-16T19:33:01.853794] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-16T19:33:01.853880] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-16T19:33:01.855057] [DEBUG] [LOCAL ] ICL: Trimmed 56207 records to 38831 (keeping 200 days of data) [2025-10-16T19:33:02.077918] [DEBUG] [LOCAL ] ICL: Primary data saved (38831 records). [2025-10-16T19:33:02.078058] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-16T19:33:02.078138] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 23.6s. Estimated remaining: 3h 1m 2s. Rate: 7.1 symbols/min [2025-10-16T19:33:02.219584] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-16T19:33:02.277304] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:02.295777] [DEBUG] [LOCAL ] IDT: Loaded 18488 existing records from primary storage. [2025-10-16T19:33:02.296037] [INFO ] [MAIN ] IDT: Loaded 18488 existing records. [2025-10-16T19:33:02.348467] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-16T19:33:02.480075] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:02.480424] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-16T19:33:02.480507] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-16T19:33:02.480790] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-16T19:33:02.480864] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-16T19:33:02.860022] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:02.891295] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-16T19:33:03.142897] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-16T19:33:03.626160] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:33:03.942848] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-16T19:33:04.613125] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-16T19:33:04.744060] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-16T19:33:04.746507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:33:05.542793] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-16T19:33:05.882863] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:33:06.271047] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-16T19:33:06.342857] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-16T19:33:06.958400] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-16T19:33:07.142819] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-16T19:33:07.942819] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-16T19:33:08.742820] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-16T19:33:08.801362] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-16T19:33:08.989890] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-16T19:33:09.500285] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:33:09.542837] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-16T19:33:10.291379] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-16T19:33:10.342783] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-16T19:33:11.066693] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-16T19:33:11.142781] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-16T19:33:11.942788] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-16T19:33:11.978163] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:33:12.742814] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-16T19:33:13.399618] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:33:13.542810] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-16T19:33:14.342791] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-16T19:33:14.667757] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:33:14.675091] [INFO ] [REMOTE ] ICE: Full fetch complete (76977 records). [2025-10-16T19:33:14.675244] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-16T19:33:14.946238] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:33:15.115786] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-16T19:33:15.116037] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-16T19:33:15.116213] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-16T19:33:15.120219] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-16T19:33:15.120290] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-16T19:33:15.121604] [DEBUG] [LOCAL ] ICE: Trimmed 76977 records to 53408 (keeping 200 days of data) [2025-10-16T19:33:15.177373] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-16T19:33:15.466043] [DEBUG] [LOCAL ] ICE: Primary data saved (53408 records). [2025-10-16T19:33:15.466189] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-16T19:33:15.466713] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. ICE took 38.5s. Estimated remaining: 3h 0m 59s. Rate: 7.1 symbols/min [2025-10-16T19:33:15.632699] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:15.670614] [DEBUG] [LOCAL ] IEX: Loaded 38458 existing records from primary storage. [2025-10-16T19:33:15.670927] [INFO ] [MAIN ] IEX: Loaded 38458 existing records. [2025-10-16T19:33:15.846591] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:15.846912] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-16T19:33:15.847000] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-16T19:33:15.847284] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-16T19:33:15.847374] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-16T19:33:15.944933] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-16T19:33:16.152159] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:33:16.219049] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:16.709835] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-16T19:33:16.742781] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-16T19:33:17.542881] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-16T19:33:18.244823] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T19:33:18.342822] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-16T19:33:18.917117] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T19:33:19.119080] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:33:19.142777] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-16T19:33:19.913014] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T19:33:19.915128] [INFO ] [REMOTE ] IDE: Full fetch complete (12802 records). [2025-10-16T19:33:19.915202] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-16T19:33:19.947891] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-16T19:33:20.268225] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-16T19:33:20.268298] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-16T19:33:20.268605] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-16T19:33:20.268697] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-16T19:33:20.269159] [DEBUG] [LOCAL ] IDE: Trimmed 12802 records to 9225 (keeping 200 days of data) [2025-10-16T19:33:20.322906] [DEBUG] [LOCAL ] IDE: Primary data saved (9225 records). [2025-10-16T19:33:20.323012] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-16T19:33:20.323087] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDE took 21.2s. Estimated remaining: 3h 0m 46s. Rate: 7.1 symbols/min [2025-10-16T19:33:20.487003] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:20.535069] [DEBUG] [LOCAL ] IFF: Loaded 51147 existing records from primary storage. [2025-10-16T19:33:20.535387] [INFO ] [MAIN ] IFF: Loaded 51147 existing records. [2025-10-16T19:33:20.711080] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:20.711328] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-16T19:33:20.711381] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-16T19:33:20.711614] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-16T19:33:20.711726] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-16T19:33:20.747991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-16T19:33:21.074949] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:33:21.078934] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:21.542830] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-16T19:33:22.233691] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-16T19:33:22.342809] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-16T19:33:22.654125] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:33:23.142812] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-16T19:33:23.696297] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:33:23.942812] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-16T19:33:23.965663] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-16T19:33:24.742820] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-16T19:33:25.457673] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-16T19:33:25.542811] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-16T19:33:25.689706] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:33:26.342799] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-16T19:33:27.069886] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-16T19:33:27.142776] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-16T19:33:27.681456] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:33:27.685672] [INFO ] [REMOTE ] IDA: Full fetch complete (45282 records). [2025-10-16T19:33:27.685775] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-16T19:33:27.948011] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-16T19:33:28.094517] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-16T19:33:28.094592] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-16T19:33:28.095391] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-16T19:33:28.095452] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-16T19:33:28.096372] [DEBUG] [LOCAL ] IDA: Trimmed 45282 records to 32985 (keeping 200 days of data) [2025-10-16T19:33:28.301281] [DEBUG] [LOCAL ] IDA: Primary data saved (32985 records). [2025-10-16T19:33:28.301417] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-16T19:33:28.301494] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDA took 37.0s. Estimated remaining: 3h 0m 37s. Rate: 7.1 symbols/min [2025-10-16T19:33:28.470588] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:28.490246] [DEBUG] [LOCAL ] IFN: Loaded 18517 existing records from primary storage. [2025-10-16T19:33:28.490485] [INFO ] [MAIN ] IFN: Loaded 18517 existing records. [2025-10-16T19:33:28.666100] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:28.666397] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-16T19:33:28.666451] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-16T19:33:28.666605] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-16T19:33:28.666671] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-16T19:33:28.744975] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-16T19:33:29.037444] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:29.067614] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-16T19:33:29.434842] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:33:29.478762] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T19:33:29.542776] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-16T19:33:30.342831] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-16T19:33:30.995204] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:33:31.142788] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-16T19:33:31.457774] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T19:33:31.942824] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-16T19:33:32.645955] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-16T19:33:32.725036] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:33:32.742772] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-16T19:33:33.542830] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-16T19:33:34.317778] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:33:34.342768] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-16T19:33:34.379664] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:33:35.142862] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-16T19:33:35.843312] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:33:35.942800] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-16T19:33:36.335337] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:33:36.742815] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-16T19:33:37.437827] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:33:37.442496] [INFO ] [REMOTE ] IEX: Full fetch complete (53745 records). [2025-10-16T19:33:37.442603] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-16T19:33:37.547884] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-16T19:33:37.830138] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-16T19:33:37.830252] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-16T19:33:37.831426] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-16T19:33:37.831532] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-16T19:33:37.833225] [DEBUG] [LOCAL ] IEX: Trimmed 53745 records to 38731 (keeping 200 days of data) [2025-10-16T19:33:37.973738] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-16T19:33:38.128157] [DEBUG] [LOCAL ] IEX: Primary data saved (38731 records). [2025-10-16T19:33:38.128296] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-16T19:33:38.128988] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IEX took 22.7s. Estimated remaining: 3h 0m 31s. Rate: 7.1 symbols/min [2025-10-16T19:33:38.293159] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:38.316543] [DEBUG] [LOCAL ] IFS: Loaded 22636 existing records from primary storage. [2025-10-16T19:33:38.316816] [INFO ] [MAIN ] IFS: Loaded 22636 existing records. [2025-10-16T19:33:38.347896] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-16T19:33:38.505208] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:38.505428] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-16T19:33:38.505482] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-16T19:33:38.505789] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-16T19:33:38.505847] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-16T19:33:38.833220] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:33:38.875783] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:39.142799] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-16T19:33:39.499505] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:33:39.886613] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:33:39.942835] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-16T19:33:40.742829] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-16T19:33:40.962021] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T19:33:41.542792] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-16T19:33:41.664481] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:33:42.342849] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-16T19:33:42.523909] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:33:43.142827] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-16T19:33:43.380956] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-16T19:33:43.942796] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-16T19:33:44.393547] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:33:44.742794] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-16T19:33:45.542835] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-16T19:33:45.623888] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T19:33:45.937365] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:33:46.342872] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-16T19:33:47.131253] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:33:47.134671] [INFO ] [REMOTE ] IDT: Full fetch complete (23825 records). [2025-10-16T19:33:47.134745] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-16T19:33:47.148070] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-16T19:33:47.505403] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-16T19:33:47.505488] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-16T19:33:47.506120] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-16T19:33:47.506181] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-16T19:33:47.506986] [DEBUG] [LOCAL ] IDT: Trimmed 23825 records to 18660 (keeping 200 days of data) [2025-10-16T19:33:47.621129] [DEBUG] [LOCAL ] IDT: Primary data saved (18660 records). [2025-10-16T19:33:47.621287] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-16T19:33:47.621371] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IDT took 45.5s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-16T19:33:47.797202] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:47.809086] [DEBUG] [LOCAL ] IGA: Loaded 10170 existing records from primary storage. [2025-10-16T19:33:47.809315] [INFO ] [MAIN ] IGA: Loaded 10170 existing records. [2025-10-16T19:33:47.945715] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-16T19:33:47.987421] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:47.987947] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-16T19:33:47.988089] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-16T19:33:47.988394] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-16T19:33:47.988450] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-16T19:33:48.177871] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:33:48.320129] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-16T19:33:48.406013] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:48.683282] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-16T19:33:48.742771] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-16T19:33:49.542848] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-16T19:33:49.742120] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:33:50.342804] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-16T19:33:51.142771] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-16T19:33:51.257999] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:33:51.342884] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:33:51.942802] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-16T19:33:52.068373] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:33:52.742784] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-16T19:33:52.893863] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-16T19:33:53.502683] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-16T19:33:53.542805] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-16T19:33:54.342850] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-16T19:33:54.532318] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:33:54.536603] [INFO ] [REMOTE ] IFN: Full fetch complete (28561 records). [2025-10-16T19:33:54.536736] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-16T19:33:54.904204] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-16T19:33:54.904297] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-16T19:33:54.904944] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-16T19:33:54.905003] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-16T19:33:54.905638] [DEBUG] [LOCAL ] IFN: Trimmed 28561 records to 18627 (keeping 200 days of data) [2025-10-16T19:33:55.014737] [DEBUG] [LOCAL ] IFN: Primary data saved (18627 records). [2025-10-16T19:33:55.014917] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-16T19:33:55.015110] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 26.7s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-16T19:33:55.129556] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T19:33:55.147889] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-16T19:33:55.189793] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:33:55.208631] [DEBUG] [LOCAL ] IGD: Loaded 19405 existing records from primary storage. [2025-10-16T19:33:55.208894] [INFO ] [MAIN ] IGD: Loaded 19405 existing records. [2025-10-16T19:33:55.380949] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:33:55.381113] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-16T19:33:55.381159] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-16T19:33:55.381336] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-16T19:33:55.381391] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-16T19:33:55.724043] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:33:55.942797] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-16T19:33:56.396225] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-16T19:33:56.680759] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:33:56.742840] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-16T19:33:57.542854] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-16T19:33:58.342796] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-16T19:33:58.539676] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-16T19:33:58.735876] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-16T19:33:58.874736] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-16T19:33:59.142803] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-16T19:33:59.942855] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-16T19:34:00.284116] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-16T19:34:00.742877] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-16T19:34:01.542788] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-16T19:34:01.987036] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T19:34:02.011933] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-16T19:34:02.342857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-16T19:34:02.406484] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:34:03.142820] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-16T19:34:03.942852] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-16T19:34:03.980096] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:34:04.394418] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-16T19:34:04.742828] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-16T19:34:05.082556] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:34:05.542790] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-16T19:34:06.342888] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-16T19:34:06.481168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:34:06.590777] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-16T19:34:07.142871] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-16T19:34:07.350384] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:34:07.837768] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:34:07.942825] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-16T19:34:08.742811] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-16T19:34:09.542803] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-16T19:34:09.612567] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-16T19:34:09.695838] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:34:10.342796] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-16T19:34:10.536437] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-16T19:34:11.089974] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-16T19:34:11.142793] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-16T19:34:11.942878] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-16T19:34:12.674822] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:34:12.742798] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-16T19:34:12.822828] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-16T19:34:12.829751] [INFO ] [REMOTE ] IFF: Full fetch complete (73610 records). [2025-10-16T19:34:12.829877] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-16T19:34:13.231038] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-16T19:34:13.231131] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-16T19:34:13.232163] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-16T19:34:13.232224] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-16T19:34:13.233578] [DEBUG] [LOCAL ] IFF: Trimmed 73610 records to 51530 (keeping 200 days of data) [2025-10-16T19:34:13.542882] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-16T19:34:13.552440] [DEBUG] [LOCAL ] IFF: Primary data saved (51530 records). [2025-10-16T19:34:13.552740] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-16T19:34:13.553403] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 53.2s. Estimated remaining: 3h 0m 17s. Rate: 7.1 symbols/min [2025-10-16T19:34:13.722770] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:13.730980] [DEBUG] [LOCAL ] IGI: Loaded 3999 existing records from primary storage. [2025-10-16T19:34:13.731202] [INFO ] [MAIN ] IGI: Loaded 3999 existing records. [2025-10-16T19:34:13.911948] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:13.912247] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-16T19:34:13.912305] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-16T19:34:13.912444] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-16T19:34:13.912499] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-16T19:34:14.166109] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:34:14.311575] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:14.342780] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-16T19:34:14.456851] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-16T19:34:15.142786] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-16T19:34:15.380298] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-16T19:34:15.942877] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-16T19:34:16.038288] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-16T19:34:16.742846] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-16T19:34:16.754148] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-16T19:34:16.757067] [INFO ] [REMOTE ] IFS: Full fetch complete (32075 records). [2025-10-16T19:34:16.757137] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-16T19:34:17.144861] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-16T19:34:17.144948] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-16T19:34:17.145731] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-16T19:34:17.145794] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-16T19:34:17.146711] [DEBUG] [LOCAL ] IFS: Trimmed 32075 records to 22745 (keeping 200 days of data) [2025-10-16T19:34:17.284159] [DEBUG] [LOCAL ] IFS: Primary data saved (22745 records). [2025-10-16T19:34:17.284289] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-16T19:34:17.284395] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFS took 39.2s. Estimated remaining: 3h 0m 3s. Rate: 7.1 symbols/min [2025-10-16T19:34:17.321151] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T19:34:17.462771] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:17.492205] [DEBUG] [LOCAL ] IGR: Loaded 30438 existing records from primary storage. [2025-10-16T19:34:17.492461] [INFO ] [MAIN ] IGR: Loaded 30438 existing records. [2025-10-16T19:34:17.548078] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-16T19:34:17.677309] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:17.677513] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-16T19:34:17.677561] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-16T19:34:17.677779] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-16T19:34:17.677836] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-16T19:34:18.038167] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:18.342817] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-16T19:34:18.442871] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:34:18.444933] [INFO ] [REMOTE ] IGA: Full fetch complete (14220 records). [2025-10-16T19:34:18.445001] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-16T19:34:18.805213] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-16T19:34:18.805311] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-16T19:34:18.805701] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-16T19:34:18.805764] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-16T19:34:18.806327] [DEBUG] [LOCAL ] IGA: Trimmed 14220 records to 10286 (keeping 200 days of data) [2025-10-16T19:34:18.866911] [DEBUG] [LOCAL ] IGA: Primary data saved (10286 records). [2025-10-16T19:34:18.867072] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-16T19:34:18.867163] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGA took 31.2s. Estimated remaining: 2h 59m 46s. Rate: 7.1 symbols/min [2025-10-16T19:34:19.036914] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:19.042066] [DEBUG] [LOCAL ] IH: Loaded 2799 existing records from primary storage. [2025-10-16T19:34:19.042238] [INFO ] [MAIN ] IH: Loaded 2799 existing records. [2025-10-16T19:34:19.143187] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-16T19:34:19.223685] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:19.223909] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-16T19:34:19.223958] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-16T19:34:19.224111] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-16T19:34:19.224168] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-16T19:34:19.593992] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:19.606391] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-16T19:34:19.945823] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-16T19:34:19.948437] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-16T19:34:20.513764] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-16T19:34:20.742858] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-16T19:34:21.199874] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:34:21.542832] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-16T19:34:22.075154] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-16T19:34:22.342844] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-16T19:34:23.142832] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-16T19:34:23.608852] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:34:23.709472] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:34:23.942833] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-16T19:34:24.509229] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-16T19:34:24.742815] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-16T19:34:25.542807] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-16T19:34:26.091448] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:34:26.342826] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-16T19:34:26.528229] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:34:27.142815] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-16T19:34:27.365550] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:34:27.580693] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T19:34:27.942821] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-16T19:34:28.388040] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:34:28.742823] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-16T19:34:29.542829] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-16T19:34:29.976259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:34:30.087232] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:34:30.342817] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-16T19:34:31.142785] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-16T19:34:31.564736] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:34:31.777938] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-16T19:34:31.942802] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-16T19:34:32.538966] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-16T19:34:32.742801] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-16T19:34:33.542835] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-16T19:34:33.736146] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:34:34.148050] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-16T19:34:34.342844] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-16T19:34:35.142881] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-16T19:34:35.370283] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-16T19:34:35.575242] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:34:35.942835] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-16T19:34:36.497507] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-16T19:34:36.742841] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-16T19:34:37.184195] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-16T19:34:37.542862] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-16T19:34:38.342892] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-16T19:34:38.583637] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:34:39.043425] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:34:39.142793] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-16T19:34:39.942873] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-16T19:34:40.113050] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:34:40.742836] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-16T19:34:41.364131] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:34:41.384971] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-16T19:34:41.542815] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-16T19:34:42.342828] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-16T19:34:42.887863] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:34:42.955011] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:34:43.142812] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-16T19:34:43.942815] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-16T19:34:44.446771] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:34:44.675504] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:34:44.677046] [INFO ] [REMOTE ] IGI: Full fetch complete (5488 records). [2025-10-16T19:34:44.677116] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-16T19:34:44.747999] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-16T19:34:45.039154] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-16T19:34:45.039231] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-16T19:34:45.039406] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-16T19:34:45.039444] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-16T19:34:45.039838] [DEBUG] [LOCAL ] IGI: Trimmed 5488 records to 4035 (keeping 200 days of data) [2025-10-16T19:34:45.064396] [DEBUG] [LOCAL ] IGI: Primary data saved (4035 records). [2025-10-16T19:34:45.064511] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-16T19:34:45.064589] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 31.5s. Estimated remaining: 2h 59m 59s. Rate: 7.1 symbols/min [2025-10-16T19:34:45.227733] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:45.236578] [DEBUG] [LOCAL ] IHD: Loaded 7329 existing records from primary storage. [2025-10-16T19:34:45.236786] [INFO ] [MAIN ] IHD: Loaded 7329 existing records. [2025-10-16T19:34:45.406767] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:45.406960] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-16T19:34:45.407007] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-16T19:34:45.407151] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-16T19:34:45.407188] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-16T19:34:45.551781] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-16T19:34:45.766537] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:46.029178] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:34:46.035359] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-16T19:34:46.037683] [INFO ] [REMOTE ] IGD: Full fetch complete (30079 records). [2025-10-16T19:34:46.037771] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-16T19:34:46.356400] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-16T19:34:46.403911] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-16T19:34:46.404005] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-16T19:34:46.404688] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-16T19:34:46.404749] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-16T19:34:46.405491] [DEBUG] [LOCAL ] IGD: Trimmed 30079 records to 19512 (keeping 200 days of data) [2025-10-16T19:34:46.514932] [DEBUG] [LOCAL ] IGD: Primary data saved (19512 records). [2025-10-16T19:34:46.515069] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-16T19:34:46.515146] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 51.5s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-16T19:34:46.692364] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:46.718294] [DEBUG] [LOCAL ] IHG: Loaded 24302 existing records from primary storage. [2025-10-16T19:34:46.718589] [INFO ] [MAIN ] IHG: Loaded 24302 existing records. [2025-10-16T19:34:46.894018] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:46.894255] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-16T19:34:46.894309] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-16T19:34:46.894591] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-16T19:34:46.894703] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-16T19:34:46.998044] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:34:47.015016] [INFO ] [REMOTE ] IH: Full fetch complete (5025 records). [2025-10-16T19:34:47.044916] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-16T19:34:47.146558] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-16T19:34:47.540172] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:47.628465] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-16T19:34:47.628568] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-16T19:34:47.628740] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-16T19:34:47.628801] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-16T19:34:47.629174] [DEBUG] [LOCAL ] IH: Trimmed 5025 records to 2814 (keeping 200 days of data) [2025-10-16T19:34:47.644722] [DEBUG] [LOCAL ] IH: Primary data saved (2814 records). [2025-10-16T19:34:47.644786] [INFO ] [MAIN ] IH: Full history saved. [2025-10-16T19:34:47.644856] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IH took 28.8s. Estimated remaining: 2h 59m 25s. Rate: 7.1 symbols/min [2025-10-16T19:34:47.812589] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:47.848627] [DEBUG] [LOCAL ] IHS: Loaded 37622 existing records from primary storage. [2025-10-16T19:34:47.848970] [INFO ] [MAIN ] IHS: Loaded 37622 existing records. [2025-10-16T19:34:47.948395] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-16T19:34:48.032161] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:48.032362] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-16T19:34:48.032427] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-16T19:34:48.032618] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-16T19:34:48.032715] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-16T19:34:48.155005] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:34:48.407114] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:48.742830] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-16T19:34:49.198067] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-16T19:34:49.542860] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-16T19:34:49.900982] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T19:34:50.342785] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-16T19:34:50.414962] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T19:34:50.418919] [INFO ] [REMOTE ] IGR: Full fetch complete (44935 records). [2025-10-16T19:34:50.419013] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-16T19:34:50.800560] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-16T19:34:50.800674] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-16T19:34:50.801471] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-16T19:34:50.801514] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-16T19:34:50.802468] [DEBUG] [LOCAL ] IGR: Trimmed 44935 records to 30626 (keeping 200 days of data) [2025-10-16T19:34:50.974405] [DEBUG] [LOCAL ] IGR: Primary data saved (30626 records). [2025-10-16T19:34:50.974546] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-16T19:34:50.974625] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGR took 33.7s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-16T19:34:51.138308] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:34:51.142859] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-16T19:34:51.147036] [DEBUG] [LOCAL ] IIF: Loaded 5591 existing records from primary storage. [2025-10-16T19:34:51.147317] [INFO ] [MAIN ] IIF: Loaded 5591 existing records. [2025-10-16T19:34:51.320832] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:34:51.321040] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-16T19:34:51.321087] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-16T19:34:51.321231] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-16T19:34:51.321269] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-16T19:34:51.603279] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T19:34:51.694452] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:34:51.942842] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-16T19:34:52.120399] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T19:34:52.742842] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-16T19:34:52.944632] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-16T19:34:53.526743] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:34:53.542819] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-16T19:34:54.323266] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-16T19:34:54.342787] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-16T19:34:55.142791] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-16T19:34:55.444090] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:34:55.603463] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-16T19:34:55.942856] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-16T19:34:56.742849] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-16T19:34:57.151481] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:34:57.542913] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-16T19:34:58.342839] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-16T19:34:58.388114] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:34:58.920956] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:34:59.142821] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-16T19:34:59.755397] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-16T19:34:59.836225] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:34:59.942790] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-16T19:35:00.742811] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-16T19:35:01.272884] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-16T19:35:01.544122] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:35:01.543337] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-16T19:35:02.338909] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-16T19:35:02.342757] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-16T19:35:02.886811] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-16T19:35:03.142808] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-16T19:35:03.608383] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:35:03.942804] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-16T19:35:04.342881] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-16T19:35:04.742816] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-16T19:35:05.542848] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-16T19:35:05.619161] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-16T19:35:06.342836] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-16T19:35:06.915230] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-16T19:35:07.001381] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-16T19:35:07.142848] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-16T19:35:07.942861] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-16T19:35:08.548356] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T19:35:08.719604] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:35:08.742772] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-16T19:35:09.542814] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-16T19:35:10.351180] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-16T19:35:10.369007] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T19:35:10.821167] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:35:10.834108] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T19:35:11.142836] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-16T19:35:11.842617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:35:11.942794] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-16T19:35:12.742841] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-16T19:35:13.363555] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:35:13.476866] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-16T19:35:13.542778] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-16T19:35:14.342783] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-16T19:35:14.740938] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:35:15.086816] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:35:15.088632] [INFO ] [REMOTE ] IHD: Full fetch complete (11875 records). [2025-10-16T19:35:15.088726] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-16T19:35:15.149332] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-16T19:35:15.456058] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-16T19:35:15.456139] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-16T19:35:15.456448] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-16T19:35:15.456490] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-16T19:35:15.456988] [DEBUG] [LOCAL ] IHD: Trimmed 11875 records to 7367 (keeping 200 days of data) [2025-10-16T19:35:15.499324] [DEBUG] [LOCAL ] IHD: Primary data saved (7367 records). [2025-10-16T19:35:15.499467] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-16T19:35:15.499550] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IHD took 30.4s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-16T19:35:15.669211] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:15.685586] [DEBUG] [LOCAL ] IIIN: Loaded 15979 existing records from primary storage. [2025-10-16T19:35:15.685838] [INFO ] [MAIN ] IIIN: Loaded 15979 existing records. [2025-10-16T19:35:15.860589] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:15.860809] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-16T19:35:15.860858] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-16T19:35:15.861018] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-16T19:35:15.861058] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-16T19:35:15.949771] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-16T19:35:16.225311] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:16.438424] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:35:16.742813] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-16T19:35:17.296155] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-16T19:35:17.542869] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-16T19:35:17.826705] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:35:18.138422] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-16T19:35:18.342829] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-16T19:35:18.816070] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T19:35:19.142835] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-16T19:35:19.942858] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-16T19:35:20.273378] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:35:20.742810] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-16T19:35:21.118387] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-16T19:35:21.122473] [INFO ] [REMOTE ] IHS: Full fetch complete (51598 records). [2025-10-16T19:35:21.122601] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-16T19:35:21.236806] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-16T19:35:21.277366] [INFO ] [REMOTE ] IIF: Full fetch complete (9012 records). [2025-10-16T19:35:21.286397] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-16T19:35:21.552737] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-16T19:35:21.884493] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-16T19:35:21.894541] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-16T19:35:21.904353] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-16T19:35:21.920783] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-16T19:35:21.927471] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-16T19:35:21.927557] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-16T19:35:21.928010] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-16T19:35:21.928186] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-16T19:35:21.929244] [DEBUG] [LOCAL ] IIF: Trimmed 9012 records to 5612 (keeping 200 days of data) [2025-10-16T19:35:21.929417] [DEBUG] [LOCAL ] IHS: Trimmed 51598 records to 37894 (keeping 200 days of data) [2025-10-16T19:35:22.046491] [DEBUG] [LOCAL ] IIF: Primary data saved (5612 records). [2025-10-16T19:35:22.049945] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-16T19:35:22.050638] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IIF took 31.1s. Estimated remaining: 2h 59m 10s. Rate: 7.1 symbols/min [2025-10-16T19:35:22.245909] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:22.346970] [DEBUG] [LOCAL ] IIM: Loaded 15661 existing records from primary storage. [2025-10-16T19:35:22.348056] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-16T19:35:22.348300] [INFO ] [MAIN ] IIM: Loaded 15661 existing records. [2025-10-16T19:35:22.530468] [DEBUG] [LOCAL ] IHS: Primary data saved (37894 records). [2025-10-16T19:35:22.550057] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-16T19:35:22.550219] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 34.9s. Estimated remaining: 2h 58m 52s. Rate: 7.1 symbols/min [2025-10-16T19:35:22.549958] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:22.572585] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-16T19:35:22.582818] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-16T19:35:22.595064] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-16T19:35:22.616678] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-16T19:35:22.828689] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:23.040972] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:35:23.127911] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:23.143476] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-16T19:35:23.145228] [DEBUG] [LOCAL ] IIPR: Loaded 29450 existing records from primary storage. [2025-10-16T19:35:23.146082] [INFO ] [MAIN ] IIPR: Loaded 29450 existing records. [2025-10-16T19:35:23.338446] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:23.338876] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-16T19:35:23.339012] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-16T19:35:23.339330] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-16T19:35:23.339385] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-16T19:35:23.607830] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-16T19:35:23.722523] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:23.942838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-16T19:35:24.490448] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:35:24.742816] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-16T19:35:25.362144] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:35:25.542812] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-16T19:35:25.964823] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-16T19:35:26.342797] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-16T19:35:27.022486] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:35:27.142789] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-16T19:35:27.244697] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-16T19:35:27.942851] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-16T19:35:28.749458] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-16T19:35:28.763189] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:35:29.075849] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-16T19:35:29.542828] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-16T19:35:29.786334] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-16T19:35:29.789461] [INFO ] [REMOTE ] IHG: Full fetch complete (34101 records). [2025-10-16T19:35:29.789534] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-16T19:35:30.150065] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-16T19:35:30.150148] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-16T19:35:30.150860] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-16T19:35:30.150937] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-16T19:35:30.151879] [DEBUG] [LOCAL ] IHG: Trimmed 34101 records to 24519 (keeping 200 days of data) [2025-10-16T19:35:30.304868] [DEBUG] [LOCAL ] IHG: Primary data saved (24519 records). [2025-10-16T19:35:30.305027] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-16T19:35:30.305161] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IHG took 43.8s. Estimated remaining: 2h 58m 43s. Rate: 7.1 symbols/min [2025-10-16T19:35:30.348187] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-16T19:35:30.478209] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:30.478360] [DEBUG] [LOCAL ] IMAX: No existing data file found in primary storage. [2025-10-16T19:35:30.478397] [WARN ] [MAIN ] IMAX: No existing data found, performing full refresh instead. [2025-10-16T19:35:30.478501] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-16T19:35:30.478581] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-16T19:35:30.478678] [DEBUG] [LOCAL ] IMAX: No primary data file found to delete. [2025-10-16T19:35:30.478731] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-16T19:35:30.767183] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:35:30.846303] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:31.142795] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-16T19:35:31.630829] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:35:31.942822] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-16T19:35:32.225921] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:35:32.639145] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:35:32.742799] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-16T19:35:33.542791] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-16T19:35:33.679552] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-16T19:35:34.342878] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-16T19:35:35.008083] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:35:35.142873] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-16T19:35:35.319360] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-16T19:35:35.942842] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-16T19:35:36.572023] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:35:36.590327] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-16T19:35:36.742825] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-16T19:35:37.542856] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-16T19:35:38.102308] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-16T19:35:38.342831] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-16T19:35:39.109476] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:35:39.142819] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-16T19:35:39.239933] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-16T19:35:39.942789] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-16T19:35:40.015267] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:35:40.742814] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-16T19:35:41.474976] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:35:41.493274] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:35:41.542776] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-16T19:35:42.342811] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-16T19:35:42.508544] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:35:43.142815] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-16T19:35:43.772933] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:35:43.808297] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-16T19:35:43.942813] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-16T19:35:44.476281] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-16T19:35:44.742878] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-16T19:35:45.542788] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-16T19:35:45.608016] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:35:46.342879] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-16T19:35:46.432040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:35:47.142809] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-16T19:35:47.334922] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:35:47.337286] [INFO ] [REMOTE ] IIIN: Full fetch complete (24709 records). [2025-10-16T19:35:47.337355] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-16T19:35:47.692976] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-16T19:35:47.693046] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-16T19:35:47.693806] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-16T19:35:47.693869] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-16T19:35:47.694848] [DEBUG] [LOCAL ] IIIN: Trimmed 24709 records to 16246 (keeping 200 days of data) [2025-10-16T19:35:47.795632] [DEBUG] [LOCAL ] IIIN: Primary data saved (16246 records). [2025-10-16T19:35:47.795862] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-16T19:35:47.795967] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIIN took 32.3s. Estimated remaining: 2h 58m 45s. Rate: 7.1 symbols/min [2025-10-16T19:35:47.942787] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-16T19:35:47.962738] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:48.008363] [DEBUG] [LOCAL ] INFA: Loaded 49000 existing records from primary storage. [2025-10-16T19:35:48.008737] [INFO ] [MAIN ] INFA: Loaded 49000 existing records. [2025-10-16T19:35:48.182157] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:48.188715] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-16T19:35:48.189275] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-16T19:35:48.189548] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-16T19:35:48.192044] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-16T19:35:48.192418] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-16T19:35:48.223164] [INFO ] [REMOTE ] IIM: Full fetch complete (25126 records). [2025-10-16T19:35:48.234825] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-16T19:35:48.753082] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-16T19:35:48.933593] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:48.940965] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-16T19:35:48.941185] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-16T19:35:48.941786] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-16T19:35:48.941865] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-16T19:35:48.942909] [DEBUG] [LOCAL ] IIM: Trimmed 25126 records to 15782 (keeping 200 days of data) [2025-10-16T19:35:49.036238] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:35:49.065716] [DEBUG] [LOCAL ] IIM: Primary data saved (15782 records). [2025-10-16T19:35:49.065865] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-16T19:35:49.065947] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 27.0s. Estimated remaining: 2h 58m 28s. Rate: 7.1 symbols/min [2025-10-16T19:35:49.232073] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:35:49.281959] [DEBUG] [LOCAL ] INFY: Loaded 53597 existing records from primary storage. [2025-10-16T19:35:49.282255] [INFO ] [MAIN ] INFY: Loaded 53597 existing records. [2025-10-16T19:35:49.455091] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:35:49.455292] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-16T19:35:49.455339] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-16T19:35:49.455560] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-16T19:35:49.455621] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-16T19:35:49.551320] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-16T19:35:49.801637] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:35:50.342805] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-16T19:35:50.396825] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-16T19:35:51.142818] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-16T19:35:51.301610] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:35:51.850198] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-16T19:35:51.942823] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-16T19:35:52.707112] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:35:52.742821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-16T19:35:53.094792] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:35:53.542896] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-16T19:35:53.923095] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-16T19:35:54.342824] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-16T19:35:55.142840] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-16T19:35:55.243857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-16T19:35:55.402313] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:35:55.942837] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-16T19:35:56.742783] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-16T19:35:56.745050] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:35:57.542794] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-16T19:35:57.935916] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-16T19:35:58.143539] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T19:35:58.342816] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-16T19:35:59.119428] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:35:59.142768] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-16T19:35:59.790442] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:35:59.942773] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-16T19:36:00.742790] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-16T19:36:00.875033] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:36:01.295802] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-16T19:36:01.300001] [INFO ] [REMOTE ] IIPR: Full fetch complete (44204 records). [2025-10-16T19:36:01.300106] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-16T19:36:01.548042] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-16T19:36:01.670843] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-16T19:36:01.670917] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-16T19:36:01.671703] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-16T19:36:01.671764] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-16T19:36:01.672633] [DEBUG] [LOCAL ] IIPR: Trimmed 44204 records to 29694 (keeping 200 days of data) [2025-10-16T19:36:01.861141] [DEBUG] [LOCAL ] IIPR: Primary data saved (29694 records). [2025-10-16T19:36:01.861288] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-16T19:36:01.861379] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 39.3s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-16T19:36:02.066107] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:02.068212] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:36:02.121791] [DEBUG] [LOCAL ] ING: Loaded 50732 existing records from primary storage. [2025-10-16T19:36:02.122097] [INFO ] [MAIN ] ING: Loaded 50732 existing records. [2025-10-16T19:36:02.301419] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:02.301671] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-16T19:36:02.301733] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-16T19:36:02.302005] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-16T19:36:02.302081] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-16T19:36:02.348072] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-16T19:36:02.686006] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:03.142834] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-16T19:36:03.379745] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:36:03.942805] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-16T19:36:04.200370] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:36:04.742790] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-16T19:36:05.269764] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-16T19:36:05.451258] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-16T19:36:05.542842] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-16T19:36:06.311974] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:36:06.342782] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-16T19:36:06.912360] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T19:36:06.918588] [INFO ] [REMOTE ] IMAX: Full fetch complete (60787 records). [2025-10-16T19:36:06.918742] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-16T19:36:07.153067] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-16T19:36:07.306451] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-16T19:36:07.306532] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-16T19:36:07.307478] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-16T19:36:07.307546] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-16T19:36:07.308768] [DEBUG] [LOCAL ] IMAX: Trimmed 60787 records to 43543 (keeping 200 days of data) [2025-10-16T19:36:07.551399] [DEBUG] [LOCAL ] IMAX: Primary data saved (43543 records). [2025-10-16T19:36:07.551539] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-16T19:36:07.551612] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 37.2s. Estimated remaining: 2h 58m 13s. Rate: 7.1 symbols/min [2025-10-16T19:36:07.719503] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:07.748438] [DEBUG] [LOCAL ] INGM: Loaded 28330 existing records from primary storage. [2025-10-16T19:36:07.748792] [INFO ] [MAIN ] INGM: Loaded 28330 existing records. [2025-10-16T19:36:07.929330] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:07.929694] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-16T19:36:07.929769] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-16T19:36:07.930081] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-16T19:36:07.930272] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-16T19:36:07.950780] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-16T19:36:08.028536] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-16T19:36:08.321937] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:08.742896] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-16T19:36:09.036499] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:36:09.542907] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-16T19:36:09.649343] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-16T19:36:10.342806] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-16T19:36:10.688361] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T19:36:10.907556] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:36:11.142868] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-16T19:36:11.947943] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-16T19:36:11.959685] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:36:12.742854] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-16T19:36:12.796230] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:36:13.542772] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-16T19:36:13.666880] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-16T19:36:13.874458] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:36:14.342824] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-16T19:36:15.142855] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-16T19:36:15.302663] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:36:15.356315] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-16T19:36:15.942809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-16T19:36:16.742802] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-16T19:36:16.866370] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-16T19:36:17.308111] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:36:17.542809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-16T19:36:18.342875] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-16T19:36:18.384151] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:36:18.534715] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:36:19.142872] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-16T19:36:19.942866] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-16T19:36:20.038665] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:36:20.542172] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-16T19:36:20.742855] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-16T19:36:21.197329] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-16T19:36:21.542796] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-16T19:36:22.184394] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:36:22.189958] [INFO ] [REMOTE ] INFA: Full fetch complete (70952 records). [2025-10-16T19:36:22.190102] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-16T19:36:22.369365] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-16T19:36:22.586008] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-16T19:36:22.586082] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-16T19:36:22.587072] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-16T19:36:22.587133] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-16T19:36:22.588411] [DEBUG] [LOCAL ] INFA: Trimmed 70952 records to 49327 (keeping 200 days of data) [2025-10-16T19:36:22.871783] [DEBUG] [LOCAL ] INFA: Primary data saved (49327 records). [2025-10-16T19:36:22.871913] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-16T19:36:22.872560] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFA took 35.1s. Estimated remaining: 2h 58m 12s. Rate: 7.1 symbols/min [2025-10-16T19:36:23.045188] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:23.078809] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-16T19:36:23.122237] [DEBUG] [LOCAL ] INGR: Loaded 33816 existing records from primary storage. [2025-10-16T19:36:23.122544] [INFO ] [MAIN ] INGR: Loaded 33816 existing records. [2025-10-16T19:36:23.154477] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-16T19:36:23.322694] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:23.322929] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-16T19:36:23.322975] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-16T19:36:23.323161] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-16T19:36:23.323217] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-16T19:36:23.676128] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:23.914223] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:36:23.943679] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-16T19:36:23.947725] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-16T19:36:24.742839] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-16T19:36:25.183159] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:36:25.542801] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-16T19:36:26.141203] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-16T19:36:26.342811] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-16T19:36:27.142791] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-16T19:36:27.227616] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:36:27.825617] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:36:27.942790] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-16T19:36:28.317602] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-16T19:36:28.742787] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-16T19:36:29.496335] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:36:29.542791] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-16T19:36:29.559798] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:36:30.342817] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-16T19:36:31.142844] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-16T19:36:31.185315] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:36:31.942905] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-16T19:36:32.028248] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:36:32.442686] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:36:32.446537] [INFO ] [REMOTE ] INGM: Full fetch complete (41919 records). [2025-10-16T19:36:32.446615] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-16T19:36:32.747986] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-16T19:36:32.818115] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-16T19:36:32.818192] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-16T19:36:32.818967] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-16T19:36:32.819033] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-16T19:36:32.819929] [DEBUG] [LOCAL ] INGM: Trimmed 41919 records to 28536 (keeping 200 days of data) [2025-10-16T19:36:32.991491] [DEBUG] [LOCAL ] INGM: Primary data saved (28536 records). [2025-10-16T19:36:32.991618] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-16T19:36:32.991744] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INGM took 25.4s. Estimated remaining: 2h 58m 6s. Rate: 7.1 symbols/min [2025-10-16T19:36:33.168630] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:33.205986] [DEBUG] [LOCAL ] INN: Loaded 41819 existing records from primary storage. [2025-10-16T19:36:33.206257] [INFO ] [MAIN ] INN: Loaded 41819 existing records. [2025-10-16T19:36:33.384638] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:33.384888] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-16T19:36:33.384938] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-16T19:36:33.385224] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-16T19:36:33.385323] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-16T19:36:33.507125] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-16T19:36:33.552963] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-16T19:36:33.774997] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:34.342854] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-16T19:36:34.615616] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:36:34.623432] [INFO ] [REMOTE ] INFY: Full fetch complete (77734 records). [2025-10-16T19:36:34.623620] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-16T19:36:34.936692] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:36:35.046773] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-16T19:36:35.046847] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-16T19:36:35.047884] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-16T19:36:35.047947] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-16T19:36:35.049393] [DEBUG] [LOCAL ] INFY: Trimmed 77734 records to 53987 (keeping 200 days of data) [2025-10-16T19:36:35.142865] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-16T19:36:35.372532] [DEBUG] [LOCAL ] INFY: Primary data saved (53987 records). [2025-10-16T19:36:35.372760] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-16T19:36:35.373347] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INFY took 46.3s. Estimated remaining: 2h 57m 50s. Rate: 7.1 symbols/min [2025-10-16T19:36:35.540370] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:35.540506] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-16T19:36:35.540542] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-16T19:36:35.540666] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-16T19:36:35.540725] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-16T19:36:35.540769] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-16T19:36:35.540802] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-16T19:36:35.886945] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:35.942765] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-16T19:36:35.977760] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-16T19:36:36.126924] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:36:36.127184] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-16T19:36:36.127281] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:36:36.127354] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-16T19:36:36.127418] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:36:36.127490] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-16T19:36:36.127551] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-16T19:36:36.127587] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-16T19:36:36.127627] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-16T19:36:36.127711] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INR took 0.8s. Estimated remaining: 2h 57m 33s. Rate: 7.1 symbols/min [2025-10-16T19:36:36.295256] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:36.337973] [DEBUG] [LOCAL ] INSP: Loaded 38333 existing records from primary storage. [2025-10-16T19:36:36.338248] [INFO ] [MAIN ] INSP: Loaded 38333 existing records. [2025-10-16T19:36:36.515196] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:36.515553] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-16T19:36:36.515693] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-16T19:36:36.516005] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-16T19:36:36.516073] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-16T19:36:36.747979] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-16T19:36:36.884203] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:36:36.903705] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:37.542871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-16T19:36:38.164210] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:36:38.342780] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-16T19:36:38.369762] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-16T19:36:39.142836] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-16T19:36:39.338172] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:36:39.942816] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-16T19:36:40.389019] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:36:40.742793] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-16T19:36:40.942333] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-16T19:36:41.542863] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-16T19:36:41.976484] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:36:42.342820] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-16T19:36:42.555584] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:36:43.142816] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-16T19:36:43.942829] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-16T19:36:44.250364] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:36:44.647213] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:36:44.742805] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-16T19:36:45.454833] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-16T19:36:45.542779] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-16T19:36:45.970698] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T19:36:46.342840] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-16T19:36:46.998163] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-16T19:36:47.142812] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-16T19:36:47.553628] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-16T19:36:47.942868] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-16T19:36:48.563443] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T19:36:48.742873] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-16T19:36:49.281527] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-16T19:36:49.288126] [INFO ] [REMOTE ] ING: Full fetch complete (73822 records). [2025-10-16T19:36:49.288294] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-16T19:36:49.553834] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-16T19:36:49.691209] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-16T19:36:49.691353] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-16T19:36:49.692782] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-16T19:36:49.692928] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-16T19:36:49.694715] [DEBUG] [LOCAL ] ING: Trimmed 73822 records to 51112 (keeping 200 days of data) [2025-10-16T19:36:49.800831] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-16T19:36:49.817535] [INFO ] [REMOTE ] INGR: Full fetch complete (50681 records). [2025-10-16T19:36:49.838541] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-16T19:36:50.251025] [DEBUG] [LOCAL ] ING: Primary data saved (51112 records). [2025-10-16T19:36:50.282414] [INFO ] [MAIN ] ING: Full history saved. [2025-10-16T19:36:50.282551] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. ING took 48.4s. Estimated remaining: 2h 57m 31s. Rate: 7.1 symbols/min [2025-10-16T19:36:50.358939] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-16T19:36:50.555245] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:50.588501] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-16T19:36:50.588607] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-16T19:36:50.589576] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-16T19:36:50.589679] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-16T19:36:50.590859] [DEBUG] [LOCAL ] INGR: Trimmed 50681 records to 34043 (keeping 200 days of data) [2025-10-16T19:36:50.733313] [DEBUG] [LOCAL ] INSW: Loaded 39595 existing records from primary storage. [2025-10-16T19:36:50.741454] [INFO ] [MAIN ] INSW: Loaded 39595 existing records. [2025-10-16T19:36:50.996227] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:50.997821] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-16T19:36:50.997954] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-16T19:36:51.005203] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-16T19:36:51.005693] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-16T19:36:51.061141] [DEBUG] [LOCAL ] INGR: Primary data saved (34043 records). [2025-10-16T19:36:51.107850] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-16T19:36:51.113725] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INGR took 28.2s. Estimated remaining: 2h 57m 14s. Rate: 7.1 symbols/min [2025-10-16T19:36:51.182631] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:36:51.288999] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-16T19:36:51.487863] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:36:51.615290] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:51.660289] [DEBUG] [LOCAL ] INVH: Loaded 53197 existing records from primary storage. [2025-10-16T19:36:51.676959] [INFO ] [MAIN ] INVH: Loaded 53197 existing records. [2025-10-16T19:36:51.708535] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T19:36:51.923040] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:36:51.923254] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-16T19:36:51.923300] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-16T19:36:51.923612] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-16T19:36:51.923690] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-16T19:36:51.953758] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-16T19:36:52.275978] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:36:52.742841] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-16T19:36:52.871051] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:36:53.294276] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-16T19:36:53.542849] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-16T19:36:54.177712] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:36:54.342842] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-16T19:36:54.771447] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:36:55.142873] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-16T19:36:55.374202] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-16T19:36:55.942882] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-16T19:36:56.750932] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-16T19:36:56.756761] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:36:57.384104] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:36:57.542874] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-16T19:36:58.342798] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-16T19:36:58.416042] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T19:36:58.818899] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-16T19:36:59.142805] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-16T19:36:59.740004] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:36:59.942789] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-16T19:37:00.512777] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-16T19:37:00.742782] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-16T19:37:01.375126] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:37:01.542828] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-16T19:37:02.293209] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:37:02.342771] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-16T19:37:03.131312] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:37:03.142766] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-16T19:37:03.390436] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T19:37:03.942862] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-16T19:37:04.742790] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-16T19:37:04.985889] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-16T19:37:05.052170] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:37:05.057908] [INFO ] [REMOTE ] INN: Full fetch complete (57798 records). [2025-10-16T19:37:05.058030] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-16T19:37:05.429084] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-16T19:37:05.429168] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-16T19:37:05.430084] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-16T19:37:05.430147] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-16T19:37:05.431283] [DEBUG] [LOCAL ] INN: Trimmed 57798 records to 42104 (keeping 200 days of data) [2025-10-16T19:37:05.542857] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-16T19:37:05.671823] [DEBUG] [LOCAL ] INN: Primary data saved (42104 records). [2025-10-16T19:37:05.671958] [INFO ] [MAIN ] INN: Full history saved. [2025-10-16T19:37:05.672034] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INN took 32.7s. Estimated remaining: 2h 57m 13s. Rate: 7.1 symbols/min [2025-10-16T19:37:05.852382] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:05.884588] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-16T19:37:05.884931] [INFO ] [MAIN ] INVX: Loaded 29342 existing records. [2025-10-16T19:37:06.081889] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:06.082281] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-16T19:37:06.082428] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-16T19:37:06.082774] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-16T19:37:06.082831] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-16T19:37:06.346423] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-16T19:37:06.503287] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:06.505308] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:37:07.142797] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-16T19:37:07.200906] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:37:07.942788] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-16T19:37:08.106831] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:37:08.467768] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:37:08.742855] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-16T19:37:09.405226] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T19:37:09.542822] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-16T19:37:10.324044] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:37:10.342768] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-16T19:37:11.142867] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-16T19:37:11.283396] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:37:11.646922] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:37:11.942844] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-16T19:37:12.742853] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-16T19:37:12.859343] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:37:13.542816] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-16T19:37:13.675262] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-16T19:37:14.050308] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T19:37:14.342826] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-16T19:37:15.144195] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-16T19:37:15.146274] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T19:37:15.152262] [INFO ] [REMOTE ] INSP: Full fetch complete (53698 records). [2025-10-16T19:37:15.152357] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-16T19:37:15.532154] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-16T19:37:15.532235] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-16T19:37:15.533159] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-16T19:37:15.533221] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-16T19:37:15.534314] [DEBUG] [LOCAL ] INSP: Trimmed 53698 records to 38596 (keeping 200 days of data) [2025-10-16T19:37:15.762149] [DEBUG] [LOCAL ] INSP: Primary data saved (38596 records). [2025-10-16T19:37:15.762285] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-16T19:37:15.762770] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 39.6s. Estimated remaining: 2h 57m 6s. Rate: 7.1 symbols/min [2025-10-16T19:37:15.935085] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:15.949025] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-16T19:37:15.961246] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:37:16.020148] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-16T19:37:16.020553] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-16T19:37:16.199109] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:16.199327] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-16T19:37:16.199374] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-16T19:37:16.199714] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-16T19:37:16.199770] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-16T19:37:16.552271] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:16.742813] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-16T19:37:16.773060] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-16T19:37:16.780096] [INFO ] [REMOTE ] INVH: Full fetch complete (76964 records). [2025-10-16T19:37:16.780270] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-16T19:37:17.215271] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-16T19:37:17.221199] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-16T19:37:17.232046] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-16T19:37:17.233437] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-16T19:37:17.232681] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-16T19:37:17.241144] [DEBUG] [LOCAL ] INVH: Trimmed 76964 records to 53585 (keeping 200 days of data) [2025-10-16T19:37:17.555689] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-16T19:37:17.580865] [DEBUG] [LOCAL ] INVH: Primary data saved (53585 records). [2025-10-16T19:37:17.581006] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-16T19:37:17.581086] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INVH took 26.5s. Estimated remaining: 2h 56m 50s. Rate: 7.1 symbols/min [2025-10-16T19:37:17.745283] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:17.793071] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-16T19:37:17.793415] [INFO ] [MAIN ] IOT: Loaded 53480 existing records. [2025-10-16T19:37:17.968716] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:17.968915] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-16T19:37:17.968972] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-16T19:37:17.969178] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-16T19:37:17.969218] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-16T19:37:18.316743] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:18.342776] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-16T19:37:18.469970] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-16T19:37:19.025055] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-16T19:37:19.142775] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-16T19:37:19.942789] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-16T19:37:20.286934] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-16T19:37:20.496379] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:37:20.742816] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-16T19:37:21.542809] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-16T19:37:22.076171] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-16T19:37:22.342801] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-16T19:37:22.575248] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-16T19:37:22.603994] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-16T19:37:23.142862] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-16T19:37:23.778781] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-16T19:37:23.942817] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-16T19:37:24.576073] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:37:24.742773] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-16T19:37:24.873171] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-16T19:37:25.542779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-16T19:37:25.951106] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-16T19:37:26.342808] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-16T19:37:27.147962] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-16T19:37:27.166491] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:37:27.943051] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-16T19:37:28.461522] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-16T19:37:28.647374] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:37:28.742906] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-16T19:37:29.483066] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-16T19:37:29.542798] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-16T19:37:30.342870] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-16T19:37:30.935473] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-16T19:37:30.941806] [INFO ] [REMOTE ] INSW: Full fetch complete (59929 records). [2025-10-16T19:37:30.942134] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-16T19:37:31.148194] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-16T19:37:31.456489] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-16T19:37:31.456630] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-16T19:37:31.458770] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-16T19:37:31.458996] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-16T19:37:31.461128] [DEBUG] [LOCAL ] INSW: Trimmed 59929 records to 39916 (keeping 200 days of data) [2025-10-16T19:37:31.655622] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-16T19:37:31.890376] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:37:31.941482] [DEBUG] [LOCAL ] INSW: Primary data saved (39916 records). [2025-10-16T19:37:31.941631] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-16T19:37:31.941749] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INSW took 41.7s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-16T19:37:31.953048] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-16T19:37:32.131754] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:32.181542] [DEBUG] [LOCAL ] IP: Loaded 53307 existing records from primary storage. [2025-10-16T19:37:32.181920] [INFO ] [MAIN ] IP: Loaded 53307 existing records. [2025-10-16T19:37:32.366800] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:32.367158] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-16T19:37:32.367231] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-16T19:37:32.374027] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-16T19:37:32.384767] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-16T19:37:32.470007] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:37:32.748962] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-16T19:37:32.755221] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:37:33.542794] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-16T19:37:33.975123] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-16T19:37:34.342833] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-16T19:37:34.668725] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-16T19:37:35.142850] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-16T19:37:35.269606] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:37:35.410461] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:37:35.942824] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-16T19:37:36.732218] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:37:36.742805] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-16T19:37:37.542910] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-16T19:37:38.342958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-16T19:37:38.520105] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:37:38.525257] [INFO ] [REMOTE ] INVX: Full fetch complete (43189 records). [2025-10-16T19:37:38.525425] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-16T19:37:38.718500] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-16T19:37:39.079224] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-16T19:37:39.079598] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-16T19:37:39.081172] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-16T19:37:39.084013] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-16T19:37:39.083921] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-16T19:37:39.099924] [DEBUG] [LOCAL ] INVX: Trimmed 43189 records to 29473 (keeping 200 days of data) [2025-10-16T19:37:39.146627] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-16T19:37:39.267338] [DEBUG] [LOCAL ] INVX: Primary data saved (29473 records). [2025-10-16T19:37:39.267468] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-16T19:37:39.267546] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVX took 33.6s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-16T19:37:39.942812] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-16T19:37:40.022310] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:37:40.742798] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-16T19:37:40.953297] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:37:41.542812] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-16T19:37:42.405547] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-16T19:37:42.417848] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-16T19:37:42.497871] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:37:43.142844] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-16T19:37:43.394599] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-16T19:37:43.942867] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-16T19:37:44.865517] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-16T19:37:44.877768] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-16T19:37:45.177209] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T19:37:45.542783] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-16T19:37:45.659996] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:37:46.342842] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-16T19:37:47.096808] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-16T19:37:47.142800] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-16T19:37:47.573850] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-16T19:37:47.635314] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-16T19:37:47.942827] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-16T19:37:48.742825] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-16T19:37:49.189869] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-16T19:37:49.542815] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-16T19:37:49.609730] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:37:50.336084] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:37:50.343083] [INFO ] [REMOTE ] IOT: Full fetch complete (77552 records). [2025-10-16T19:37:50.342892] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-16T19:37:50.344157] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-16T19:37:50.725680] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-16T19:37:50.725771] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-16T19:37:50.726821] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-16T19:37:50.726885] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-16T19:37:50.728325] [DEBUG] [LOCAL ] IOT: Trimmed 77552 records to 53870 (keeping 200 days of data) [2025-10-16T19:37:51.037100] [DEBUG] [LOCAL ] IOT: Primary data saved (53870 records). [2025-10-16T19:37:51.037238] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-16T19:37:51.037792] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 33.5s. Estimated remaining: 2h 56m 34s. Rate: 7.1 symbols/min [2025-10-16T19:37:51.818629] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-16T19:37:51.825850] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-16T19:37:51.825975] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-16T19:37:52.232777] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-16T19:37:52.232880] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-16T19:37:52.233980] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-16T19:37:52.234061] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-16T19:37:52.235578] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-16T19:37:52.384315] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-16T19:37:52.480073] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-16T19:37:52.596523] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-16T19:37:52.596685] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-16T19:37:52.597218] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 36.8s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-16T19:37:54.314695] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:37:54.326009] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-16T19:37:55.716183] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:37:55.733233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-16T19:37:57.194380] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:37:57.201445] [INFO ] [REMOTE ] IP: Full fetch complete (77380 records). [2025-10-16T19:37:57.201609] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-16T19:37:57.624706] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-16T19:37:57.624832] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-16T19:37:57.625985] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-16T19:37:57.626055] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-16T19:37:57.627575] [DEBUG] [LOCAL ] IP: Trimmed 77380 records to 53697 (keeping 200 days of data) [2025-10-16T19:37:57.947720] [DEBUG] [LOCAL ] IP: Primary data saved (53697 records). [2025-10-16T19:37:57.947910] [INFO ] [MAIN ] IP: Full history saved. [2025-10-16T19:37:57.948004] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 26.0s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-16T19:37:58.641473] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.680697] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.722078] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.724020] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:37:58.748790] [DEBUG] [LOCAL ] IQI: Loaded 17837 existing records from primary storage. [2025-10-16T19:37:58.749320] [INFO ] [MAIN ] IQI: Loaded 17837 existing records. [2025-10-16T19:37:58.837260] [DEBUG] [LOCAL ] IPI: Loaded 21357 existing records from primary storage. [2025-10-16T19:37:58.848265] [INFO ] [MAIN ] IPI: Loaded 21357 existing records. [2025-10-16T19:37:59.069495] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.081171] [DEBUG] [LOCAL ] IQV: Loaded 50051 existing records from primary storage. [2025-10-16T19:37:59.103581] [INFO ] [MAIN ] IQV: Loaded 50051 existing records. [2025-10-16T19:37:59.103461] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.138672] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-16T19:37:59.197969] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-16T19:37:59.192710] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-16T19:37:59.217119] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-16T19:37:59.227798] [INFO ] [MAIN ] IPG: Loaded 53331 existing records. [2025-10-16T19:37:59.302516] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.342162] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.431997] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-16T19:37:59.541628] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-16T19:37:59.541855] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-16T19:37:59.845537] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.893803] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:37:59.918059] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.938485] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-16T19:37:59.938407] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-16T19:37:59.974811] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-16T19:37:59.953345] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-16T19:38:00.007701] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-16T19:38:00.018137] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-16T19:38:00.079059] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-16T19:38:00.596100] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:00.637281] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-16T19:38:01.008041] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.040474] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-16T19:38:01.155827] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.188884] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-16T19:38:01.225256] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:01.225562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-16T19:38:01.761475] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-16T19:38:01.766683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-16T19:38:02.097792] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:38:02.102344] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-16T19:38:02.817331] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:38:02.821911] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-16T19:38:02.968915] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:38:02.981278] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-16T19:38:03.088600] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-16T19:38:03.092456] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-16T19:38:03.123626] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:38:03.133556] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-16T19:38:03.913524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-16T19:38:03.918625] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-16T19:38:04.097350] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-16T19:38:04.101425] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-16T19:38:04.410917] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:38:04.422046] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-16T19:38:04.601989] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T19:38:04.605925] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-16T19:38:04.828209] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:38:04.837898] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-16T19:38:04.921066] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-16T19:38:05.517040] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-16T19:38:05.542819] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-16T19:38:05.816421] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:38:06.342815] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-16T19:38:06.432833] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:38:06.469570] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-16T19:38:07.142808] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-16T19:38:07.910696] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:38:07.942773] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-16T19:38:08.742798] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-16T19:38:08.811320] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T19:38:09.383140] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:38:09.542787] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-16T19:38:09.712454] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-16T19:38:10.342819] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-16T19:38:11.142803] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-16T19:38:11.568239] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-16T19:38:11.916612] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-16T19:38:11.942773] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-16T19:38:12.272685] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-16T19:38:12.742878] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-16T19:38:13.542882] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-16T19:38:13.831544] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:38:13.853836] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-16T19:38:14.342814] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-16T19:38:15.004224] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:38:15.142780] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-16T19:38:15.942854] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-16T19:38:16.014251] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:38:16.742786] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-16T19:38:16.927515] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:38:17.150220] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-16T19:38:17.542860] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-16T19:38:18.009482] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:38:18.119764] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:38:18.342852] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-16T19:38:19.143016] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-16T19:38:19.475521] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T19:38:19.941741] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T19:38:19.943850] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-16T19:38:19.945170] [INFO ] [REMOTE ] IQI: Full fetch complete (26606 records). [2025-10-16T19:38:19.945265] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-16T19:38:20.306408] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-16T19:38:20.306485] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-16T19:38:20.307062] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-16T19:38:20.307123] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-16T19:38:20.307808] [DEBUG] [LOCAL ] IQI: Trimmed 26606 records to 17994 (keeping 200 days of data) [2025-10-16T19:38:20.416681] [DEBUG] [LOCAL ] IQI: Primary data saved (17994 records). [2025-10-16T19:38:20.416841] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-16T19:38:20.416935] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 22.5s. Estimated remaining: 2h 56m 13s. Rate: 7.1 symbols/min [2025-10-16T19:38:20.582491] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:20.631363] [DEBUG] [LOCAL ] IR: Loaded 52780 existing records from primary storage. [2025-10-16T19:38:20.631689] [INFO ] [MAIN ] IR: Loaded 52780 existing records. [2025-10-16T19:38:20.748039] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-16T19:38:20.810261] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:20.810604] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-16T19:38:20.810689] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-16T19:38:20.810999] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-16T19:38:20.811056] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-16T19:38:21.153934] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:21.542785] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-16T19:38:21.611684] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:38:22.342785] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-16T19:38:22.546990] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-16T19:38:22.581756] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:38:23.142831] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-16T19:38:23.953332] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-16T19:38:23.989253] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-16T19:38:24.030866] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:38:24.742802] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-16T19:38:25.542808] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-16T19:38:25.632625] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-16T19:38:25.684347] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T19:38:26.342837] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-16T19:38:27.045660] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-16T19:38:27.142779] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-16T19:38:27.942788] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-16T19:38:28.004124] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T19:38:28.646172] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:38:28.653095] [INFO ] [REMOTE ] IPG: Full fetch complete (77433 records). [2025-10-16T19:38:28.653241] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-16T19:38:28.748692] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-16T19:38:29.037050] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-16T19:38:29.037180] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-16T19:38:29.038279] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-16T19:38:29.038343] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-16T19:38:29.039875] [DEBUG] [LOCAL ] IPG: Trimmed 77433 records to 53721 (keeping 200 days of data) [2025-10-16T19:38:29.361866] [DEBUG] [LOCAL ] IPG: Primary data saved (53721 records). [2025-10-16T19:38:29.361998] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-16T19:38:29.362076] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPG took 31.4s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-16T19:38:29.543369] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-16T19:38:29.546732] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:29.586131] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-16T19:38:29.616946] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-16T19:38:29.623896] [INFO ] [REMOTE ] IQV: Full fetch complete (72436 records). [2025-10-16T19:38:29.624095] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-16T19:38:29.821241] [DEBUG] [LOCAL ] IRM: Loaded 49144 existing records from primary storage. [2025-10-16T19:38:29.834392] [INFO ] [MAIN ] IRM: Loaded 49144 existing records. [2025-10-16T19:38:30.189339] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:30.208253] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-16T19:38:30.231722] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-16T19:38:30.232343] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-16T19:38:30.232488] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-16T19:38:30.234081] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-16T19:38:30.234152] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-16T19:38:30.234029] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-16T19:38:30.300430] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-16T19:38:30.345449] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-16T19:38:30.372109] [DEBUG] [LOCAL ] IQV: Trimmed 72436 records to 50425 (keeping 200 days of data) [2025-10-16T19:38:30.662034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T19:38:30.701232] [INFO ] [REMOTE ] IPI: Full fetch complete (30021 records). [2025-10-16T19:38:30.745062] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:30.740937] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-16T19:38:31.163237] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-16T19:38:31.241009] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-16T19:38:31.241127] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-16T19:38:31.242407] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-16T19:38:31.242492] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-16T19:38:31.251600] [DEBUG] [LOCAL ] IPI: Trimmed 30021 records to 21575 (keeping 200 days of data) [2025-10-16T19:38:31.410003] [DEBUG] [LOCAL ] IPI: Primary data saved (21575 records). [2025-10-16T19:38:31.441479] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-16T19:38:31.455556] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPI took 33.5s. Estimated remaining: 2h 55m 49s. Rate: 7.1 symbols/min [2025-10-16T19:38:31.589293] [DEBUG] [LOCAL ] IQV: Primary data saved (50425 records). [2025-10-16T19:38:31.607281] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-16T19:38:31.627441] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IQV took 33.7s. Estimated remaining: 2h 55m 31s. Rate: 7.1 symbols/min [2025-10-16T19:38:31.665208] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:31.841545] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:31.842678] [DEBUG] [LOCAL ] IRS: Loaded 23063 existing records from primary storage. [2025-10-16T19:38:31.842953] [INFO ] [MAIN ] IRS: Loaded 23063 existing records. [2025-10-16T19:38:32.037222] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:32.037711] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-16T19:38:32.037828] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-16T19:38:32.038035] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-16T19:38:32.038719] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-16T19:38:32.220604] [DEBUG] [LOCAL ] IRT: Loaded 50567 existing records from primary storage. [2025-10-16T19:38:32.245056] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:38:32.255731] [INFO ] [MAIN ] IRT: Loaded 50567 existing records. [2025-10-16T19:38:32.378930] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-16T19:38:32.592000] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:32.680591] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:32.681048] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-16T19:38:32.681175] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-16T19:38:32.681574] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-16T19:38:32.681678] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-16T19:38:32.755488] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-16T19:38:33.060879] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:38:33.138305] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:33.542817] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-16T19:38:33.842758] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:38:33.947979] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:38:34.342815] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-16T19:38:34.652348] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-16T19:38:35.142819] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-16T19:38:35.942798] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-16T19:38:36.047321] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:38:36.515357] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:38:36.742776] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-16T19:38:37.068070] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:38:37.542850] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-16T19:38:38.342805] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-16T19:38:38.436402] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:38:38.703392] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-16T19:38:38.974738] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-16T19:38:39.142875] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-16T19:38:39.908225] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-16T19:38:39.942824] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-16T19:38:40.742800] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-16T19:38:41.044958] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T19:38:41.542817] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-16T19:38:42.220133] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:38:42.342800] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-16T19:38:43.120581] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-16T19:38:43.142770] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-16T19:38:43.942788] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-16T19:38:44.141777] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-16T19:38:44.742834] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-16T19:38:44.842408] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-16T19:38:45.542835] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-16T19:38:46.342943] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-16T19:38:46.547299] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:38:46.825865] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-16T19:38:46.992223] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-16T19:38:47.142876] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-16T19:38:47.793023] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:38:47.942854] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-16T19:38:48.742813] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-16T19:38:48.811143] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:38:48.952446] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-16T19:38:49.542819] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-16T19:38:50.132181] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:38:50.342843] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-16T19:38:50.587189] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-16T19:38:51.142829] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-16T19:38:51.942810] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-16T19:38:52.124596] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-16T19:38:52.237516] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-16T19:38:52.742847] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-16T19:38:53.535759] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:38:53.546369] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-16T19:38:54.163040] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-16T19:38:54.342832] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-16T19:38:55.142838] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-16T19:38:55.223430] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:38:55.787667] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:38:55.942851] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-16T19:38:56.742811] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-16T19:38:56.874860] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-16T19:38:56.887180] [INFO ] [REMOTE ] IR: Full fetch complete (76477 records). [2025-10-16T19:38:56.887571] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-16T19:38:57.305063] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-16T19:38:57.305182] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-16T19:38:57.307224] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-16T19:38:57.307310] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-16T19:38:57.309512] [DEBUG] [LOCAL ] IR: Trimmed 76477 records to 53164 (keeping 200 days of data) [2025-10-16T19:38:57.544327] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-16T19:38:57.712108] [DEBUG] [LOCAL ] IR: Primary data saved (53164 records). [2025-10-16T19:38:57.712380] [INFO ] [MAIN ] IR: Full history saved. [2025-10-16T19:38:57.713228] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IR took 37.3s. Estimated remaining: 2h 55m 43s. Rate: 7.1 symbols/min [2025-10-16T19:38:57.726945] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:38:57.914619] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:57.937067] [DEBUG] [LOCAL ] ISD: Loaded 15874 existing records from primary storage. [2025-10-16T19:38:57.937579] [INFO ] [MAIN ] ISD: Loaded 15874 existing records. [2025-10-16T19:38:58.101100] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:38:58.141133] [INFO ] [REMOTE ] IRS: Full fetch complete (32707 records). [2025-10-16T19:38:58.158338] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-16T19:38:58.163990] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:58.164573] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-16T19:38:58.213183] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-16T19:38:58.274705] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-16T19:38:58.275341] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-16T19:38:58.348639] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-16T19:38:58.931998] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-16T19:38:58.944803] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-16T19:38:58.946032] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-16T19:38:58.946509] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-16T19:38:59.015820] [DEBUG] [LOCAL ] IRS: Trimmed 32707 records to 23269 (keeping 200 days of data) [2025-10-16T19:38:59.042383] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:38:59.151765] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-16T19:38:59.200576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:38:59.248734] [DEBUG] [LOCAL ] IRS: Primary data saved (23269 records). [2025-10-16T19:38:59.248904] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-16T19:38:59.249001] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IRS took 27.8s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-10-16T19:38:59.427578] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:38:59.473059] [DEBUG] [LOCAL ] IT: Loaded 42223 existing records from primary storage. [2025-10-16T19:38:59.473488] [INFO ] [MAIN ] IT: Loaded 42223 existing records. [2025-10-16T19:38:59.656018] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:38:59.656330] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-16T19:38:59.656392] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-16T19:38:59.656611] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-16T19:38:59.656872] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-16T19:38:59.954918] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-16T19:39:00.078384] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:39:00.082533] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:00.269628] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-16T19:39:00.742847] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-16T19:39:01.542925] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-16T19:39:01.933850] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:39:02.342850] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-16T19:39:02.525921] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:39:02.572379] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:39:03.142831] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-16T19:39:03.681977] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-16T19:39:03.942841] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-16T19:39:04.603503] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:39:04.610796] [INFO ] [REMOTE ] IRT: Full fetch complete (72969 records). [2025-10-16T19:39:04.610971] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-16T19:39:04.754845] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-16T19:39:05.030807] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-16T19:39:05.030941] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-16T19:39:05.032471] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-16T19:39:05.032540] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-16T19:39:05.034583] [DEBUG] [LOCAL ] IRT: Trimmed 72969 records to 50924 (keeping 200 days of data) [2025-10-16T19:39:05.376435] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:39:05.405139] [DEBUG] [LOCAL ] IRT: Primary data saved (50924 records). [2025-10-16T19:39:05.405342] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-16T19:39:05.405452] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRT took 33.8s. Estimated remaining: 2h 55m 15s. Rate: 7.1 symbols/min [2025-10-16T19:39:05.547938] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-16T19:39:05.597063] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:05.634330] [DEBUG] [LOCAL ] ITGR: Loaded 31316 existing records from primary storage. [2025-10-16T19:39:05.634706] [INFO ] [MAIN ] ITGR: Loaded 31316 existing records. [2025-10-16T19:39:05.823505] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:05.823816] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-16T19:39:05.823871] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-16T19:39:05.824121] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-16T19:39:05.824180] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-16T19:39:06.223876] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:06.351597] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-16T19:39:06.369970] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:39:06.498343] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-16T19:39:07.142849] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-16T19:39:07.198696] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:39:07.942876] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-16T19:39:08.742789] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-16T19:39:08.932192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:39:09.333442] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:39:09.542861] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-16T19:39:09.840687] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-16T19:39:10.232251] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-16T19:39:10.342834] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-16T19:39:11.142859] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-16T19:39:11.487096] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:39:11.942816] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-16T19:39:12.704353] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:39:12.742806] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-16T19:39:12.955459] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:39:13.542819] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-16T19:39:14.258485] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:39:14.342846] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-16T19:39:15.149593] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-16T19:39:15.152438] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:39:15.942790] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-16T19:39:16.106509] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T19:39:16.113817] [INFO ] [REMOTE ] IRM: Full fetch complete (72301 records). [2025-10-16T19:39:16.120380] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-16T19:39:16.125600] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-16T19:39:16.525260] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-16T19:39:16.525335] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-16T19:39:16.526343] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-16T19:39:16.526406] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-16T19:39:16.527736] [DEBUG] [LOCAL ] IRM: Trimmed 72301 records to 49463 (keeping 200 days of data) [2025-10-16T19:39:16.742912] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-16T19:39:16.831106] [DEBUG] [LOCAL ] IRM: Primary data saved (49463 records). [2025-10-16T19:39:16.831231] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-16T19:39:16.832060] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRM took 47.5s. Estimated remaining: 2h 55m 10s. Rate: 7.1 symbols/min [2025-10-16T19:39:17.000791] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:17.021615] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:39:17.059250] [DEBUG] [LOCAL ] ITT: Loaded 32710 existing records from primary storage. [2025-10-16T19:39:17.059509] [INFO ] [MAIN ] ITT: Loaded 32710 existing records. [2025-10-16T19:39:17.234434] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:17.234632] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-16T19:39:17.234711] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-16T19:39:17.234989] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-16T19:39:17.235044] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-16T19:39:17.547969] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-16T19:39:17.587923] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:18.249834] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:39:18.342789] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-16T19:39:18.403013] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-16T19:39:19.142820] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-16T19:39:19.537453] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:39:19.942794] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-16T19:39:20.162091] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:39:20.742795] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-16T19:39:20.913200] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-16T19:39:21.542791] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-16T19:39:21.693311] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-16T19:39:22.342826] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-16T19:39:22.791448] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:39:23.142828] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-16T19:39:23.160103] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-16T19:39:23.942834] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-16T19:39:24.750931] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-16T19:39:24.758196] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:39:24.833762] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:39:25.542803] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-16T19:39:25.708756] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-16T19:39:26.342813] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-16T19:39:27.142864] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-16T19:39:27.242572] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:39:27.538958] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-16T19:39:27.942812] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-16T19:39:28.532864] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-16T19:39:28.742878] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-16T19:39:29.542854] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-16T19:39:29.704248] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-16T19:39:29.710247] [INFO ] [REMOTE ] IT: Full fetch complete (57446 records). [2025-10-16T19:39:29.710386] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-16T19:39:30.120935] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-16T19:39:30.122116] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-16T19:39:30.122013] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:39:30.123246] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-16T19:39:30.129074] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-16T19:39:30.140063] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:39:30.144286] [DEBUG] [LOCAL ] IT: Trimmed 57446 records to 42544 (keeping 200 days of data) [2025-10-16T19:39:30.348480] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-16T19:39:30.400925] [DEBUG] [LOCAL ] IT: Primary data saved (42544 records). [2025-10-16T19:39:30.401059] [INFO ] [MAIN ] IT: Full history saved. [2025-10-16T19:39:30.401151] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IT took 31.2s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-16T19:39:30.566761] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:30.614203] [DEBUG] [LOCAL ] ITUB: Loaded 53332 existing records from primary storage. [2025-10-16T19:39:30.614560] [INFO ] [MAIN ] ITUB: Loaded 53332 existing records. [2025-10-16T19:39:30.793112] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:30.793321] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-16T19:39:30.793369] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-16T19:39:30.793558] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-16T19:39:30.793597] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-16T19:39:31.143523] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-16T19:39:31.149723] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:31.225727] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-16T19:39:31.228521] [INFO ] [REMOTE ] ISD: Full fetch complete (24118 records). [2025-10-16T19:39:31.228600] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-16T19:39:31.600545] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-16T19:39:31.600664] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-16T19:39:31.601372] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-16T19:39:31.601441] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-16T19:39:31.602422] [DEBUG] [LOCAL ] ISD: Trimmed 24118 records to 15985 (keeping 200 days of data) [2025-10-16T19:39:31.728836] [DEBUG] [LOCAL ] ISD: Primary data saved (15985 records). [2025-10-16T19:39:31.728999] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-16T19:39:31.729088] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. ISD took 34.0s. Estimated remaining: 2h 54m 51s. Rate: 7.1 symbols/min [2025-10-16T19:39:31.945932] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-16T19:39:31.947938] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:32.005154] [DEBUG] [LOCAL ] ITW: Loaded 45789 existing records from primary storage. [2025-10-16T19:39:32.005559] [INFO ] [MAIN ] ITW: Loaded 45789 existing records. [2025-10-16T19:39:32.261041] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:32.261352] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-16T19:39:32.261440] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-16T19:39:32.261782] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-16T19:39:32.261842] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-16T19:39:32.729855] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:32.747962] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-16T19:39:32.765941] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T19:39:33.200939] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:39:33.542835] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-16T19:39:34.054841] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:39:34.342816] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-16T19:39:35.142833] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-16T19:39:35.268245] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-16T19:39:35.761244] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-16T19:39:35.942839] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-16T19:39:36.266046] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-16T19:39:36.270360] [INFO ] [REMOTE ] ITGR: Full fetch complete (42840 records). [2025-10-16T19:39:36.270446] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-16T19:39:36.655997] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-16T19:39:36.656074] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-16T19:39:36.656855] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-16T19:39:36.656917] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-16T19:39:36.657868] [DEBUG] [LOCAL ] ITGR: Trimmed 42840 records to 31563 (keeping 200 days of data) [2025-10-16T19:39:36.745274] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-16T19:39:36.851809] [DEBUG] [LOCAL ] ITGR: Primary data saved (31563 records). [2025-10-16T19:39:36.851972] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-16T19:39:36.852054] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ITGR took 31.4s. Estimated remaining: 2h 54m 39s. Rate: 7.1 symbols/min [2025-10-16T19:39:37.041759] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:37.042092] [DEBUG] [LOCAL ] IVR: No existing data file found in primary storage. [2025-10-16T19:39:37.042144] [WARN ] [MAIN ] IVR: No existing data found, performing full refresh instead. [2025-10-16T19:39:37.042303] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-16T19:39:37.042355] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-16T19:39:37.042400] [DEBUG] [LOCAL ] IVR: No primary data file found to delete. [2025-10-16T19:39:37.042486] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-16T19:39:37.421891] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:37.444633] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-16T19:39:37.542808] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-16T19:39:38.342859] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-16T19:39:38.376840] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:39:38.530797] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:39:39.142826] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-16T19:39:39.942797] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-16T19:39:40.176861] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-16T19:39:40.290295] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:39:40.742854] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-16T19:39:41.542840] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-16T19:39:41.927895] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:39:41.984600] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:39:42.342841] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-16T19:39:42.915868] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:39:43.142786] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-16T19:39:43.181087] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:39:43.942795] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-16T19:39:44.742859] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-16T19:39:44.815874] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:39:45.262802] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:39:45.266959] [INFO ] [REMOTE ] ITT: Full fetch complete (47350 records). [2025-10-16T19:39:45.267048] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-16T19:39:45.546480] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-16T19:39:45.634067] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-16T19:39:45.634141] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-16T19:39:45.634942] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-16T19:39:45.635005] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-16T19:39:45.635934] [DEBUG] [LOCAL ] ITT: Trimmed 47350 records to 32949 (keeping 200 days of data) [2025-10-16T19:39:45.842145] [DEBUG] [LOCAL ] ITT: Primary data saved (32949 records). [2025-10-16T19:39:45.842345] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-16T19:39:45.842448] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 29.0s. Estimated remaining: 2h 54m 31s. Rate: 7.1 symbols/min [2025-10-16T19:39:46.006439] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:39:46.037113] [DEBUG] [LOCAL ] IVT: Loaded 31347 existing records from primary storage. [2025-10-16T19:39:46.037368] [INFO ] [MAIN ] IVT: Loaded 31347 existing records. [2025-10-16T19:39:46.213087] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:39:46.213317] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-16T19:39:46.213364] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-16T19:39:46.213541] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-16T19:39:46.213595] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-16T19:39:46.350430] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-16T19:39:46.594907] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:39:46.598452] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:39:46.830903] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:39:47.142799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-16T19:39:47.942863] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-16T19:39:48.157774] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:39:48.742838] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-16T19:39:48.849199] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-16T19:39:49.473690] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-16T19:39:49.542783] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-16T19:39:49.908090] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:39:50.342817] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-16T19:39:51.142798] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-16T19:39:51.217499] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-16T19:39:51.804283] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:39:51.942827] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-16T19:39:52.565629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-16T19:39:52.742844] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-16T19:39:53.229306] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-16T19:39:53.542789] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-16T19:39:54.342807] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-16T19:39:54.639496] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:39:54.867890] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-16T19:39:55.142782] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-16T19:39:55.942789] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-16T19:39:56.041458] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:39:56.606950] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:39:56.742803] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-16T19:39:57.211243] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:39:57.542872] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-16T19:39:58.128602] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-16T19:39:58.342859] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-16T19:39:58.780834] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:39:59.142836] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-16T19:39:59.582343] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T19:39:59.942814] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-16T19:40:00.702761] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:40:00.742814] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-16T19:40:01.552270] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-16T19:40:01.577922] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:40:02.155506] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-16T19:40:02.163111] [INFO ] [REMOTE ] ITW: Full fetch complete (66754 records). [2025-10-16T19:40:02.163318] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-16T19:40:02.345102] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-16T19:40:02.561682] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-16T19:40:02.561778] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-16T19:40:02.562757] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-16T19:40:02.562822] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-16T19:40:02.564172] [DEBUG] [LOCAL ] ITW: Trimmed 66754 records to 46082 (keeping 200 days of data) [2025-10-16T19:40:02.875469] [DEBUG] [LOCAL ] ITW: Primary data saved (46082 records). [2025-10-16T19:40:02.875631] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-16T19:40:02.876234] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITW took 31.1s. Estimated remaining: 2h 54m 32s. Rate: 7.1 symbols/min [2025-10-16T19:40:03.044095] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:03.096910] [DEBUG] [LOCAL ] IVZ: Loaded 53117 existing records from primary storage. [2025-10-16T19:40:03.097468] [INFO ] [MAIN ] IVZ: Loaded 53117 existing records. [2025-10-16T19:40:03.162131] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-16T19:40:03.307281] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:03.307471] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-16T19:40:03.307520] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-16T19:40:03.307784] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-16T19:40:03.307843] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-16T19:40:03.705744] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:03.710508] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-16T19:40:03.841309] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:40:03.942817] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-16T19:40:04.742862] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-16T19:40:05.011516] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-16T19:40:05.362167] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:40:05.542902] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-16T19:40:05.617058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:40:06.342845] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-16T19:40:07.142838] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-16T19:40:07.268947] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-16T19:40:07.583515] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-16T19:40:07.942825] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-16T19:40:08.742856] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-16T19:40:08.839272] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-16T19:40:09.542833] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-16T19:40:09.570269] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:40:10.134546] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-16T19:40:10.342845] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-16T19:40:10.673638] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:40:11.142782] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-16T19:40:11.942801] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-16T19:40:12.325230] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:40:12.331838] [INFO ] [REMOTE ] IVR: Full fetch complete (69227 records). [2025-10-16T19:40:12.331994] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-16T19:40:12.718266] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-16T19:40:12.718355] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-16T19:40:12.719390] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-16T19:40:12.719453] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-16T19:40:12.720869] [DEBUG] [LOCAL ] IVR: Trimmed 69227 records to 48437 (keeping 200 days of data) [2025-10-16T19:40:12.768055] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-16T19:40:12.930023] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:40:13.000709] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:40:13.075215] [DEBUG] [LOCAL ] IVR: Primary data saved (48437 records). [2025-10-16T19:40:13.075354] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-16T19:40:13.075428] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. IVR took 36.2s. Estimated remaining: 2h 54m 25s. Rate: 7.1 symbols/min [2025-10-16T19:40:13.255377] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:13.284215] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-16T19:40:13.284544] [INFO ] [MAIN ] IX: Loaded 22281 existing records. [2025-10-16T19:40:13.460286] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:13.460515] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-16T19:40:13.460565] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-16T19:40:13.460767] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-16T19:40:13.460824] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-16T19:40:13.551781] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-16T19:40:13.813872] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:14.342792] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-16T19:40:14.671704] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T19:40:14.878462] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:40:15.142849] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-16T19:40:15.942922] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-16T19:40:16.115604] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-16T19:40:16.742820] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-16T19:40:16.977368] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:40:17.542778] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-16T19:40:17.602761] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:40:17.607625] [INFO ] [REMOTE ] IVT: Full fetch complete (45933 records). [2025-10-16T19:40:17.607745] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-16T19:40:18.001381] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-16T19:40:18.001524] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-16T19:40:18.002668] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-16T19:40:18.002734] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-16T19:40:18.003759] [DEBUG] [LOCAL ] IVT: Trimmed 45933 records to 31572 (keeping 200 days of data) [2025-10-16T19:40:18.193634] [DEBUG] [LOCAL ] IVT: Primary data saved (31572 records). [2025-10-16T19:40:18.193870] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-16T19:40:18.193964] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 32.4s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-16T19:40:18.343718] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-16T19:40:18.369166] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-16T19:40:18.404066] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:18.453907] [DEBUG] [LOCAL ] J: Loaded 40381 existing records from primary storage. [2025-10-16T19:40:18.454217] [INFO ] [MAIN ] J: Loaded 40381 existing records. [2025-10-16T19:40:18.635048] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:18.635222] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-16T19:40:18.635268] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-16T19:40:18.635679] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-16T19:40:18.635741] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-16T19:40:19.003180] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:19.142305] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-16T19:40:19.144169] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:40:19.144361] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-16T19:40:19.942866] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-16T19:40:20.604317] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:40:20.742806] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-16T19:40:21.542797] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-16T19:40:21.785864] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:40:21.792719] [INFO ] [REMOTE ] ITUB: Full fetch complete (77320 records). [2025-10-16T19:40:21.792862] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-16T19:40:22.197580] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-16T19:40:22.197829] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-16T19:40:22.199036] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-16T19:40:22.199122] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-16T19:40:22.200750] [DEBUG] [LOCAL ] ITUB: Trimmed 77320 records to 53720 (keeping 200 days of data) [2025-10-16T19:40:22.327894] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-16T19:40:22.329454] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:40:22.344067] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-16T19:40:22.561549] [DEBUG] [LOCAL ] ITUB: Primary data saved (53720 records). [2025-10-16T19:40:22.561680] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-16T19:40:22.562278] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. ITUB took 52.2s. Estimated remaining: 2h 54m 0s. Rate: 7.1 symbols/min [2025-10-16T19:40:22.732545] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:22.773372] [DEBUG] [LOCAL ] JBGS: Loaded 42194 existing records from primary storage. [2025-10-16T19:40:22.773688] [INFO ] [MAIN ] JBGS: Loaded 42194 existing records. [2025-10-16T19:40:22.945976] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:22.946171] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-16T19:40:22.946219] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-16T19:40:22.946409] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-16T19:40:22.946464] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-16T19:40:23.148135] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-16T19:40:23.299697] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:23.827926] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:40:23.942839] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-16T19:40:24.742785] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-16T19:40:25.031450] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-16T19:40:25.212145] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-16T19:40:25.542782] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-16T19:40:25.565587] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:40:26.342790] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-16T19:40:27.142844] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-16T19:40:27.266698] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:40:27.555763] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-16T19:40:27.942837] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-16T19:40:28.326373] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:40:28.742874] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-16T19:40:29.542784] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-16T19:40:29.779358] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:40:29.786878] [INFO ] [REMOTE ] IVZ: Full fetch complete (77015 records). [2025-10-16T19:40:29.787173] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-16T19:40:29.963242] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-16T19:40:30.222147] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-16T19:40:30.222232] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-16T19:40:30.223275] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-16T19:40:30.223338] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-16T19:40:30.224874] [DEBUG] [LOCAL ] IVZ: Trimmed 77015 records to 53506 (keeping 200 days of data) [2025-10-16T19:40:30.345956] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-16T19:40:30.542559] [DEBUG] [LOCAL ] IVZ: Primary data saved (53506 records). [2025-10-16T19:40:30.542730] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-16T19:40:30.543209] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IVZ took 27.7s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-16T19:40:30.716895] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:30.758825] [DEBUG] [LOCAL ] JBI: Loaded 42989 existing records from primary storage. [2025-10-16T19:40:30.759136] [INFO ] [MAIN ] JBI: Loaded 42989 existing records. [2025-10-16T19:40:30.934707] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:30.935022] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-16T19:40:30.935144] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-16T19:40:30.935374] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-16T19:40:30.935440] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-16T19:40:31.156968] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-16T19:40:31.194474] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:40:31.351122] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:31.371255] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-16T19:40:31.942818] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-16T19:40:32.458098] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-16T19:40:32.742838] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-16T19:40:33.112000] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-16T19:40:33.542805] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-16T19:40:33.965597] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:40:34.342804] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-16T19:40:35.039778] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-16T19:40:35.142812] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-16T19:40:35.445443] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-16T19:40:35.942832] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-16T19:40:36.543278] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-16T19:40:36.742837] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-16T19:40:37.549777] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-16T19:40:37.552746] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:40:37.940817] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:40:38.342803] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-16T19:40:38.652116] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-16T19:40:39.142842] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-16T19:40:39.755419] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-16T19:40:39.942846] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-16T19:40:40.230101] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-16T19:40:40.737368] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:40:40.742769] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-16T19:40:41.542820] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-16T19:40:41.726074] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-16T19:40:42.342814] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-16T19:40:43.021266] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:40:43.142808] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-16T19:40:43.944598] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-16T19:40:43.949861] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:40:44.261812] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:40:44.742809] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-16T19:40:45.436850] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-16T19:40:45.542816] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-16T19:40:46.149522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-16T19:40:46.342786] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-16T19:40:47.025831] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:40:47.142883] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-16T19:40:47.782347] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:40:47.942814] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-16T19:40:48.742468] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:40:48.751416] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-16T19:40:49.354892] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:40:49.542809] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-16T19:40:49.934140] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-16T19:40:50.342830] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-16T19:40:50.601902] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-16T19:40:51.142823] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-16T19:40:51.413491] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:40:51.417934] [INFO ] [REMOTE ] IX: Full fetch complete (28263 records). [2025-10-16T19:40:51.418074] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-16T19:40:51.793593] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-16T19:40:51.793727] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-16T19:40:51.794325] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-16T19:40:51.794371] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-16T19:40:51.795346] [DEBUG] [LOCAL ] IX: Trimmed 28263 records to 22439 (keeping 200 days of data) [2025-10-16T19:40:51.925674] [DEBUG] [LOCAL ] IX: Primary data saved (22439 records). [2025-10-16T19:40:51.925810] [INFO ] [MAIN ] IX: Full history saved. [2025-10-16T19:40:51.925889] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IX took 38.9s. Estimated remaining: 2h 53m 57s. Rate: 7.1 symbols/min [2025-10-16T19:40:51.947969] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-16T19:40:52.101054] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:52.146810] [DEBUG] [LOCAL ] JBL: Loaded 48349 existing records from primary storage. [2025-10-16T19:40:52.147246] [INFO ] [MAIN ] JBL: Loaded 48349 existing records. [2025-10-16T19:40:52.327295] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:52.327501] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-16T19:40:52.327548] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-16T19:40:52.328429] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-16T19:40:52.328504] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-16T19:40:52.693345] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:52.721794] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-16T19:40:52.742793] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-16T19:40:53.110534] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-16T19:40:53.542817] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-16T19:40:54.335592] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-16T19:40:54.344485] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-16T19:40:54.940348] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-16T19:40:54.946038] [INFO ] [REMOTE ] J: Full fetch complete (59590 records). [2025-10-16T19:40:54.946178] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-16T19:40:55.149173] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-16T19:40:55.330475] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-16T19:40:55.330551] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-16T19:40:55.331438] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-16T19:40:55.331500] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-16T19:40:55.334003] [DEBUG] [LOCAL ] J: Trimmed 59590 records to 40700 (keeping 200 days of data) [2025-10-16T19:40:55.588954] [DEBUG] [LOCAL ] J: Primary data saved (40700 records). [2025-10-16T19:40:55.589076] [INFO ] [MAIN ] J: Full history saved. [2025-10-16T19:40:55.589152] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. J took 37.4s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-16T19:40:55.760703] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:55.789960] [DEBUG] [LOCAL ] JBND: Loaded 26907 existing records from primary storage. [2025-10-16T19:40:55.790238] [INFO ] [MAIN ] JBND: Loaded 26907 existing records. [2025-10-16T19:40:55.963909] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-16T19:40:55.969143] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:40:56.004906] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:40:56.005930] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-16T19:40:56.006152] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-16T19:40:56.006746] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-16T19:40:56.006839] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-16T19:40:56.359245] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:56.583884] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-16T19:40:56.742876] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-16T19:40:57.542859] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-16T19:40:57.572008] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-16T19:40:57.687105] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-16T19:40:58.342815] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-16T19:40:58.707939] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T19:40:58.712838] [INFO ] [REMOTE ] JBGS: Full fetch complete (59314 records). [2025-10-16T19:40:58.712940] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-16T19:40:59.111599] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-16T19:40:59.111695] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-16T19:40:59.112580] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-16T19:40:59.112621] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-16T19:40:59.113809] [DEBUG] [LOCAL ] JBGS: Trimmed 59314 records to 42407 (keeping 200 days of data) [2025-10-16T19:40:59.165734] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-16T19:40:59.364826] [DEBUG] [LOCAL ] JBGS: Primary data saved (42407 records). [2025-10-16T19:40:59.364976] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-16T19:40:59.365664] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. JBGS took 36.8s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-16T19:40:59.535391] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:40:59.535698] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-16T19:40:59.535754] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-16T19:40:59.535863] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-16T19:40:59.535903] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-16T19:40:59.535944] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-16T19:40:59.535975] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-16T19:40:59.904304] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:40:59.908548] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-16T19:40:59.942763] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-16T19:41:00.222157] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:41:00.742814] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-16T19:41:01.203388] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-16T19:41:01.542856] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-16T19:41:01.676744] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:41:01.750049] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:41:01.750340] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-16T19:41:01.750435] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:01.750502] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-16T19:41:01.750567] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:01.750639] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-16T19:41:01.750764] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-16T19:41:01.750803] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-16T19:41:01.750843] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-16T19:41:01.750941] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBS took 2.4s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-16T19:41:01.920311] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:01.920529] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-16T19:41:01.920571] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-16T19:41:01.920707] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-16T19:41:01.920758] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-16T19:41:01.920800] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-16T19:41:01.920832] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-16T19:41:02.266146] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:02.342803] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-16T19:41:02.542885] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:41:02.543118] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-16T19:41:02.543204] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:02.543251] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-16T19:41:02.543292] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:02.543354] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-16T19:41:02.543414] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-16T19:41:02.543449] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-16T19:41:02.543488] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-16T19:41:02.543533] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBTM took 0.8s. Estimated remaining: 2h 52m 58s. Rate: 7.1 symbols/min [2025-10-16T19:41:02.707603] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:02.718605] [DEBUG] [LOCAL ] JCE: Loaded 7439 existing records from primary storage. [2025-10-16T19:41:02.718862] [INFO ] [MAIN ] JCE: Loaded 7439 existing records. [2025-10-16T19:41:02.890557] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:02.890780] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-16T19:41:02.890829] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-16T19:41:02.891015] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-16T19:41:02.891070] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-16T19:41:03.148077] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-16T19:41:03.239442] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:03.942793] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-16T19:41:04.498742] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:41:04.742945] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-16T19:41:05.522821] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:41:05.528365] [INFO ] [REMOTE ] JBI: Full fetch complete (63990 records). [2025-10-16T19:41:05.528510] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-16T19:41:05.549748] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-16T19:41:05.909331] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-16T19:41:05.909423] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-16T19:41:05.910418] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-16T19:41:05.910485] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-16T19:41:05.911816] [DEBUG] [LOCAL ] JBI: Trimmed 63990 records to 43293 (keeping 200 days of data) [2025-10-16T19:41:06.151188] [DEBUG] [LOCAL ] JBI: Primary data saved (43293 records). [2025-10-16T19:41:06.151314] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-16T19:41:06.151875] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBI took 35.6s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-16T19:41:06.331206] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:06.342806] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-16T19:41:06.388597] [DEBUG] [LOCAL ] JCI: Loaded 53527 existing records from primary storage. [2025-10-16T19:41:06.389032] [INFO ] [MAIN ] JCI: Loaded 53527 existing records. [2025-10-16T19:41:06.578922] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:06.579238] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-16T19:41:06.579322] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-16T19:41:06.579747] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-16T19:41:06.579830] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-16T19:41:06.767404] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-16T19:41:06.947133] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:41:07.020220] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:07.027966] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:41:07.142785] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-16T19:41:07.942789] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-16T19:41:08.132397] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-16T19:41:08.742818] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-16T19:41:09.364292] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-16T19:41:09.542783] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-16T19:41:09.688042] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:41:10.126326] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:41:10.342807] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-16T19:41:11.142846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-16T19:41:11.331295] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:41:11.504508] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T19:41:11.942809] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-16T19:41:12.742878] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-16T19:41:13.542804] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-16T19:41:13.790987] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:41:14.342846] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-16T19:41:14.643404] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-16T19:41:14.690944] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-16T19:41:14.756852] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-16T19:41:15.142821] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-16T19:41:15.942832] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-16T19:41:16.434480] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-16T19:41:16.742837] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-16T19:41:17.276580] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:41:17.314357] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:41:17.542876] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-16T19:41:18.342835] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-16T19:41:18.744428] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:41:19.142884] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-16T19:41:19.915417] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:41:19.942823] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-16T19:41:20.742844] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-16T19:41:20.902352] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:41:21.431024] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-16T19:41:21.542820] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-16T19:41:21.650634] [DEBUG] [REMOTE ] JCE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-16T19:41:21.651244] [WARN ] [REMOTE ] JCE: No data returned for month 2025-07 [2025-10-16T19:41:21.651359] [FATAL] [REMOTE ] JCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:41:21.651466] [FATAL] [MAIN ] JCE: Failed to fetch primary data. [2025-10-16T19:41:21.651546] [WARN ] [MAIN ] JCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:41:21.651636] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-16T19:41:21.651767] [DEBUG] [LOCAL ] JCE: No primary data file found to delete. [2025-10-16T19:41:21.651823] [INFO ] [LOCAL ] JCE: Starting deletion of derivative data. [2025-10-16T19:41:21.652210] [DEBUG] [LOCAL ] JCE: Deleted derivative data file. [2025-10-16T19:41:21.652314] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JCE took 19.1s. Estimated remaining: 2h 52m 43s. Rate: 7.1 symbols/min [2025-10-16T19:41:21.850153] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:21.881854] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:41:21.938228] [DEBUG] [LOCAL ] JEF: Loaded 50171 existing records from primary storage. [2025-10-16T19:41:21.938603] [INFO ] [MAIN ] JEF: Loaded 50171 existing records. [2025-10-16T19:41:22.112975] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:22.113198] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-16T19:41:22.113246] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-16T19:41:22.113808] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-16T19:41:22.113869] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-16T19:41:22.349380] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-16T19:41:22.467613] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:23.142812] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-16T19:41:23.942810] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-16T19:41:24.215795] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:41:24.481044] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-16T19:41:24.742817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-16T19:41:25.394457] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-16T19:41:25.542811] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-16T19:41:26.348048] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-16T19:41:26.373600] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-16T19:41:27.142797] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-16T19:41:27.417914] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-16T19:41:27.801839] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-16T19:41:27.942795] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-16T19:41:28.654763] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:41:28.742837] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-16T19:41:29.259256] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:41:29.542814] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-16T19:41:30.342826] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-16T19:41:30.376700] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-16T19:41:30.564760] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:41:30.569471] [INFO ] [REMOTE ] JBND: Full fetch complete (35631 records). [2025-10-16T19:41:30.569597] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-16T19:41:30.937700] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-16T19:41:30.937793] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-16T19:41:30.938524] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-16T19:41:30.938587] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-16T19:41:30.939582] [DEBUG] [LOCAL ] JBND: Trimmed 35631 records to 27187 (keeping 200 days of data) [2025-10-16T19:41:31.101181] [DEBUG] [LOCAL ] JBND: Primary data saved (27187 records). [2025-10-16T19:41:31.101311] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-16T19:41:31.101390] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JBND took 35.5s. Estimated remaining: 2h 52m 36s. Rate: 7.1 symbols/min [2025-10-16T19:41:31.147916] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-16T19:41:31.272635] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:31.314789] [DEBUG] [LOCAL ] JELD: Loaded 46134 existing records from primary storage. [2025-10-16T19:41:31.315090] [INFO ] [MAIN ] JELD: Loaded 46134 existing records. [2025-10-16T19:41:31.492385] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:31.492594] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-16T19:41:31.492660] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-16T19:41:31.493006] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-16T19:41:31.493077] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-16T19:41:31.858969] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:31.942774] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-16T19:41:32.249861] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-16T19:41:32.256480] [INFO ] [REMOTE ] JBL: Full fetch complete (70609 records). [2025-10-16T19:41:32.256602] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-16T19:41:32.649216] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-16T19:41:32.649384] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-16T19:41:32.650439] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-16T19:41:32.650502] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-16T19:41:32.651839] [DEBUG] [LOCAL ] JBL: Trimmed 70609 records to 48716 (keeping 200 days of data) [2025-10-16T19:41:32.743769] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-16T19:41:32.960455] [DEBUG] [LOCAL ] JBL: Primary data saved (48716 records). [2025-10-16T19:41:32.960792] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-16T19:41:32.960883] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBL took 41.0s. Estimated remaining: 2h 52m 20s. Rate: 7.1 symbols/min [2025-10-16T19:41:33.058863] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-16T19:41:33.177225] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:33.206755] [DEBUG] [LOCAL ] JFR: Loaded 30985 existing records from primary storage. [2025-10-16T19:41:33.207047] [INFO ] [MAIN ] JFR: Loaded 30985 existing records. [2025-10-16T19:41:33.419325] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:41:33.416883] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:33.427565] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-16T19:41:33.427668] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-16T19:41:33.428005] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-16T19:41:33.428045] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-16T19:41:33.547984] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-16T19:41:33.776913] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:34.309263] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-16T19:41:34.342771] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-16T19:41:34.586404] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T19:41:35.142887] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-16T19:41:35.692943] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T19:41:35.942845] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-16T19:41:36.742802] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-16T19:41:36.905621] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:41:36.961327] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:41:37.542816] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-16T19:41:38.342862] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-16T19:41:38.664247] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-16T19:41:39.021771] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:41:39.142853] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-16T19:41:39.424348] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T19:41:39.942821] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-16T19:41:40.742832] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-16T19:41:40.873314] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:41:40.982884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:41:41.542820] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-16T19:41:42.203309] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:41:42.342794] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-16T19:41:42.372251] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:41:42.379261] [INFO ] [REMOTE ] JCI: Full fetch complete (77626 records). [2025-10-16T19:41:42.379405] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-16T19:41:42.775012] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-16T19:41:42.775090] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-16T19:41:42.776126] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-16T19:41:42.776189] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-16T19:41:42.777845] [DEBUG] [LOCAL ] JCI: Trimmed 77626 records to 53916 (keeping 200 days of data) [2025-10-16T19:41:43.112792] [DEBUG] [LOCAL ] JCI: Primary data saved (53916 records). [2025-10-16T19:41:43.112989] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-16T19:41:43.113508] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 37.0s. Estimated remaining: 2h 52m 14s. Rate: 7.1 symbols/min [2025-10-16T19:41:43.148045] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-16T19:41:43.286200] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:41:43.301743] [DEBUG] [LOCAL ] JGH: Loaded 12453 existing records from primary storage. [2025-10-16T19:41:43.301983] [INFO ] [MAIN ] JGH: Loaded 12453 existing records. [2025-10-16T19:41:43.480194] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:41:43.480423] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-16T19:41:43.480469] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-16T19:41:43.480731] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-16T19:41:43.480801] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-16T19:41:43.863736] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:41:43.867734] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T19:41:43.942798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-16T19:41:44.742815] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-16T19:41:44.824065] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-16T19:41:44.890182] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-16T19:41:45.542868] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-16T19:41:46.342817] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-16T19:41:46.503160] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-16T19:41:46.660246] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-16T19:41:47.142896] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-16T19:41:47.857248] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:41:47.942784] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-16T19:41:48.742820] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-16T19:41:48.790443] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:41:49.416884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:41:49.542778] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-16T19:41:49.633434] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-16T19:41:50.342814] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-16T19:41:51.005839] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:41:51.142830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-16T19:41:51.547916] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-16T19:41:51.942860] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-16T19:41:52.460749] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-16T19:41:52.680385] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:41:52.742807] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-16T19:41:53.455696] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:41:53.542787] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-16T19:41:54.123325] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-16T19:41:54.342823] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-16T19:41:55.142838] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-16T19:41:55.413385] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:41:55.942820] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-16T19:41:56.692019] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:41:56.742777] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-16T19:41:57.542852] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-16T19:41:57.617745] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-16T19:41:58.335278] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-16T19:41:58.344452] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-16T19:41:58.588753] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-16T19:41:59.060211] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:41:59.142788] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-16T19:41:59.942793] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-16T19:42:00.730967] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:42:00.742770] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-16T19:42:01.503678] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T19:42:01.508413] [INFO ] [REMOTE ] JFR: Full fetch complete (48442 records). [2025-10-16T19:42:01.508538] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-16T19:42:01.551306] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-16T19:42:01.910839] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-16T19:42:01.910914] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-16T19:42:01.911758] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-16T19:42:01.911840] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-16T19:42:01.912815] [DEBUG] [LOCAL ] JFR: Trimmed 48442 records to 31245 (keeping 200 days of data) [2025-10-16T19:42:02.096154] [DEBUG] [LOCAL ] JFR: Primary data saved (31245 records). [2025-10-16T19:42:02.096281] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-16T19:42:02.096371] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JFR took 29.1s. Estimated remaining: 2h 52m 16s. Rate: 7.1 symbols/min [2025-10-16T19:42:02.270689] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:02.311127] [DEBUG] [LOCAL ] JHG: Loaded 47560 existing records from primary storage. [2025-10-16T19:42:02.311784] [INFO ] [MAIN ] JHG: Loaded 47560 existing records. [2025-10-16T19:42:02.345631] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-16T19:42:02.399477] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-16T19:42:02.452065] [INFO ] [REMOTE ] JELD: Full fetch complete (64464 records). [2025-10-16T19:42:02.462579] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-16T19:42:02.541601] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:02.563142] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-16T19:42:02.575143] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-16T19:42:02.619486] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-16T19:42:02.630463] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-16T19:42:02.637110] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:42:03.162507] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-16T19:42:03.302862] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-16T19:42:03.317276] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-16T19:42:03.324267] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-16T19:42:03.323221] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:03.324594] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-16T19:42:03.325753] [DEBUG] [LOCAL ] JELD: Trimmed 64464 records to 46434 (keeping 200 days of data) [2025-10-16T19:42:03.578865] [DEBUG] [LOCAL ] JELD: Primary data saved (46434 records). [2025-10-16T19:42:03.578996] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-16T19:42:03.579076] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JELD took 32.5s. Estimated remaining: 2h 52m 1s. Rate: 7.1 symbols/min [2025-10-16T19:42:03.744249] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:03.751719] [DEBUG] [LOCAL ] JHI: Loaded 4041 existing records from primary storage. [2025-10-16T19:42:03.751900] [INFO ] [MAIN ] JHI: Loaded 4041 existing records. [2025-10-16T19:42:03.931258] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:03.931570] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-16T19:42:03.931665] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-16T19:42:03.939381] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-16T19:42:03.939120] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-16T19:42:03.941959] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-16T19:42:03.953970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-16T19:42:04.304235] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:04.323166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:42:04.330069] [INFO ] [REMOTE ] JEF: Full fetch complete (73313 records). [2025-10-16T19:42:04.330193] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-16T19:42:04.719818] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-16T19:42:04.719898] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-16T19:42:04.720985] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-16T19:42:04.721047] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-16T19:42:04.722386] [DEBUG] [LOCAL ] JEF: Trimmed 73313 records to 50561 (keeping 200 days of data) [2025-10-16T19:42:04.775496] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-16T19:42:05.028270] [DEBUG] [LOCAL ] JEF: Primary data saved (50561 records). [2025-10-16T19:42:05.028423] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-16T19:42:05.029194] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JEF took 43.4s. Estimated remaining: 2h 51m 45s. Rate: 7.1 symbols/min [2025-10-16T19:42:05.197527] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:05.203285] [DEBUG] [LOCAL ] JHS: Loaded 2933 existing records from primary storage. [2025-10-16T19:42:05.203475] [INFO ] [MAIN ] JHS: Loaded 2933 existing records. [2025-10-16T19:42:05.380601] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:05.380921] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-16T19:42:05.380980] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-16T19:42:05.381312] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-16T19:42:05.381408] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-16T19:42:05.486221] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:42:05.544389] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-16T19:42:05.699954] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-16T19:42:05.785732] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:06.037685] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-16T19:42:06.342828] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-16T19:42:07.142815] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-16T19:42:07.886604] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T19:42:07.911915] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:42:07.942773] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-16T19:42:08.742805] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-16T19:42:09.194842] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-16T19:42:09.465561] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:42:09.542893] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-16T19:42:10.026120] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-16T19:42:10.342823] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-16T19:42:11.142825] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-16T19:42:11.707053] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-16T19:42:11.942845] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-16T19:42:11.987123] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-16T19:42:12.573055] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-16T19:42:12.742811] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-16T19:42:13.383924] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-16T19:42:13.542824] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-16T19:42:14.089942] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:42:14.342826] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-16T19:42:14.782081] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-16T19:42:15.142820] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-16T19:42:15.942863] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-16T19:42:16.742850] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-16T19:42:16.771050] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:42:16.831212] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:42:17.211321] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:42:17.542815] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-16T19:42:18.342877] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-16T19:42:18.806819] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-16T19:42:19.141679] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:42:19.151389] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-16T19:42:19.620609] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T19:42:19.942818] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-16T19:42:20.742812] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-16T19:42:21.216179] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:42:21.526301] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:42:21.542769] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-16T19:42:22.342815] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-16T19:42:23.121435] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-16T19:42:23.142763] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-16T19:42:23.232757] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:42:23.622956] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-16T19:42:23.942908] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-16T19:42:24.305315] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-16T19:42:24.742833] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-16T19:42:25.304607] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T19:42:25.542826] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-16T19:42:26.342795] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-16T19:42:26.411227] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:42:27.142802] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-16T19:42:27.947194] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-16T19:42:27.952707] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:42:28.166127] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:42:28.169846] [INFO ] [REMOTE ] JGH: Full fetch complete (16292 records). [2025-10-16T19:42:28.169944] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-16T19:42:28.539931] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-16T19:42:28.540034] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-16T19:42:28.545156] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:42:28.544999] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-16T19:42:28.547194] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-16T19:42:28.547809] [DEBUG] [LOCAL ] JGH: Trimmed 16292 records to 12686 (keeping 200 days of data) [2025-10-16T19:42:28.624824] [DEBUG] [LOCAL ] JGH: Primary data saved (12686 records). [2025-10-16T19:42:28.624965] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-16T19:42:28.625044] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 45.5s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-16T19:42:28.747984] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-16T19:42:28.795186] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:28.851876] [DEBUG] [LOCAL ] JHX: Loaded 53161 existing records from primary storage. [2025-10-16T19:42:28.852276] [INFO ] [MAIN ] JHX: Loaded 53161 existing records. [2025-10-16T19:42:29.061980] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:29.062201] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-16T19:42:29.062250] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-16T19:42:29.062862] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-16T19:42:29.062921] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-16T19:42:29.397427] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-16T19:42:29.399621] [INFO ] [REMOTE ] JHI: Full fetch complete (5750 records). [2025-10-16T19:42:29.399733] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-16T19:42:29.576195] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:29.570406] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-16T19:42:29.856968] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-16T19:42:29.857043] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-16T19:42:29.857217] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-16T19:42:29.857255] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-16T19:42:29.857610] [DEBUG] [LOCAL ] JHI: Trimmed 5750 records to 4106 (keeping 200 days of data) [2025-10-16T19:42:29.881414] [DEBUG] [LOCAL ] JHI: Primary data saved (4106 records). [2025-10-16T19:42:29.881500] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-16T19:42:29.881572] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JHI took 26.3s. Estimated remaining: 2h 51m 36s. Rate: 7.1 symbols/min [2025-10-16T19:42:30.043742] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:30.060735] [DEBUG] [LOCAL ] JILL: Loaded 15931 existing records from primary storage. [2025-10-16T19:42:30.060985] [INFO ] [MAIN ] JILL: Loaded 15931 existing records. [2025-10-16T19:42:30.231353] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:30.231548] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-16T19:42:30.231595] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-16T19:42:30.231790] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-16T19:42:30.231861] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-16T19:42:30.347988] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-16T19:42:30.579064] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:31.142794] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-16T19:42:31.317554] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-16T19:42:31.474205] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:42:31.542461] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:42:31.942853] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-16T19:42:32.742820] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-16T19:42:32.862038] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:42:33.028807] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-16T19:42:33.542823] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-16T19:42:34.342839] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-16T19:42:34.600154] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:42:34.724704] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-16T19:42:35.142864] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-16T19:42:35.700683] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:42:35.701578] [INFO ] [REMOTE ] JHS: Full fetch complete (4494 records). [2025-10-16T19:42:35.701675] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-16T19:42:35.947941] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-16T19:42:36.062151] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-16T19:42:36.062227] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-16T19:42:36.062384] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-16T19:42:36.062422] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-16T19:42:36.062805] [DEBUG] [LOCAL ] JHS: Trimmed 4494 records to 2944 (keeping 200 days of data) [2025-10-16T19:42:36.081147] [DEBUG] [LOCAL ] JHS: Primary data saved (2944 records). [2025-10-16T19:42:36.081226] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-16T19:42:36.081302] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHS took 31.1s. Estimated remaining: 2h 51m 25s. Rate: 7.1 symbols/min [2025-10-16T19:42:36.246205] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:36.284243] [DEBUG] [LOCAL ] JKS: Loaded 39674 existing records from primary storage. [2025-10-16T19:42:36.284551] [INFO ] [MAIN ] JKS: Loaded 39674 existing records. [2025-10-16T19:42:36.456902] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:36.457120] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-16T19:42:36.457166] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-16T19:42:36.457813] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-16T19:42:36.457871] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-16T19:42:36.747912] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-16T19:42:36.820716] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:36.829538] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:42:37.542858] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-16T19:42:37.595973] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T19:42:38.342878] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-16T19:42:39.142796] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-16T19:42:39.177814] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-16T19:42:39.207883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:42:39.942849] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-16T19:42:40.262025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-16T19:42:40.742875] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-16T19:42:41.492537] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T19:42:41.542774] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-16T19:42:42.342906] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-16T19:42:42.428175] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:42:42.972602] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:42:43.038385] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-16T19:42:43.142795] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-16T19:42:43.942812] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-16T19:42:44.742783] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-16T19:42:44.776345] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:42:45.200857] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-16T19:42:45.206881] [INFO ] [REMOTE ] JHG: Full fetch complete (68517 records). [2025-10-16T19:42:45.206999] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-16T19:42:45.552389] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-16T19:42:45.591347] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-16T19:42:45.591439] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-16T19:42:45.592461] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-16T19:42:45.592525] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-16T19:42:45.593943] [DEBUG] [LOCAL ] JHG: Trimmed 68517 records to 47922 (keeping 200 days of data) [2025-10-16T19:42:45.837523] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-16T19:42:45.914451] [DEBUG] [LOCAL ] JHG: Primary data saved (47922 records). [2025-10-16T19:42:45.914607] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-16T19:42:45.914737] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 43.8s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-16T19:42:46.117481] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:42:46.146579] [DEBUG] [LOCAL ] JLL: Loaded 31768 existing records from primary storage. [2025-10-16T19:42:46.146871] [INFO ] [MAIN ] JLL: Loaded 31768 existing records. [2025-10-16T19:42:46.318985] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:42:46.319200] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-16T19:42:46.319249] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-16T19:42:46.319836] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-16T19:42:46.319893] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-16T19:42:46.350329] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-16T19:42:46.669024] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:42:47.142842] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-16T19:42:47.202355] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-16T19:42:47.942771] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-16T19:42:48.004784] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-16T19:42:48.339453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:42:48.742875] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-16T19:42:49.542845] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-16T19:42:49.623845] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:42:50.088394] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-16T19:42:50.342805] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-16T19:42:50.401102] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:42:51.029547] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-16T19:42:51.142821] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-16T19:42:51.942881] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-16T19:42:52.573235] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-16T19:42:52.742827] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-16T19:42:53.050980] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T19:42:53.542872] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-16T19:42:54.142838] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-16T19:42:54.342792] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-16T19:42:54.951035] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:42:54.974090] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T19:42:55.142799] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-16T19:42:55.942805] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-16T19:42:56.638948] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-16T19:42:56.742785] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-16T19:42:56.821025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-16T19:42:57.542844] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-16T19:42:57.713189] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:42:58.342849] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-16T19:42:59.028495] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-16T19:42:59.142787] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-16T19:42:59.465343] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-16T19:42:59.942856] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-16T19:43:00.684806] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:43:00.742779] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-16T19:43:01.271543] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-16T19:43:01.542907] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-16T19:43:02.289491] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:43:02.342826] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-16T19:43:03.065052] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:43:03.142805] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-16T19:43:03.264826] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-16T19:43:03.267080] [INFO ] [REMOTE ] JILL: Full fetch complete (22549 records). [2025-10-16T19:43:03.267170] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-16T19:43:03.624569] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-16T19:43:03.624683] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-16T19:43:03.625164] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-16T19:43:03.625205] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-16T19:43:03.625824] [DEBUG] [LOCAL ] JILL: Trimmed 22549 records to 15989 (keeping 200 days of data) [2025-10-16T19:43:03.721318] [DEBUG] [LOCAL ] JILL: Primary data saved (15989 records). [2025-10-16T19:43:03.721474] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-16T19:43:03.721559] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JILL took 33.8s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-16T19:43:03.889519] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:03.895410] [DEBUG] [LOCAL ] JLS: Loaded 4209 existing records from primary storage. [2025-10-16T19:43:03.895611] [INFO ] [MAIN ] JLS: Loaded 4209 existing records. [2025-10-16T19:43:03.948264] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-16T19:43:04.098054] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:04.098275] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-16T19:43:04.098321] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-16T19:43:04.098579] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-16T19:43:04.098636] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-16T19:43:04.455991] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:04.742865] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-16T19:43:05.008208] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-16T19:43:05.015263] [INFO ] [REMOTE ] JHX: Full fetch complete (61431 records). [2025-10-16T19:43:05.015481] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-16T19:43:05.297315] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:43:05.434142] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-16T19:43:05.434231] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-16T19:43:05.435174] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-16T19:43:05.435256] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-16T19:43:05.436551] [DEBUG] [LOCAL ] JHX: Trimmed 61431 records to 53550 (keeping 200 days of data) [2025-10-16T19:43:05.544931] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-16T19:43:05.745189] [DEBUG] [LOCAL ] JHX: Primary data saved (53550 records). [2025-10-16T19:43:05.745336] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-16T19:43:05.745868] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 37.1s. Estimated remaining: 2h 51m 4s. Rate: 7.1 symbols/min [2025-10-16T19:43:05.911782] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:05.959760] [DEBUG] [LOCAL ] JMIA: Loaded 51055 existing records from primary storage. [2025-10-16T19:43:05.960088] [INFO ] [MAIN ] JMIA: Loaded 51055 existing records. [2025-10-16T19:43:06.131836] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:06.132373] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-16T19:43:06.132475] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-16T19:43:06.133351] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-16T19:43:06.133411] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-16T19:43:06.348046] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-16T19:43:06.520181] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:43:06.551473] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:06.694111] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-16T19:43:06.706110] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-16T19:43:07.142823] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-16T19:43:07.942820] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-16T19:43:08.579197] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-16T19:43:08.742809] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-16T19:43:09.480520] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:43:09.542782] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-16T19:43:10.034535] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-16T19:43:10.342812] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-16T19:43:11.142800] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-16T19:43:11.365857] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:43:11.942786] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-16T19:43:12.294890] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T19:43:12.301197] [INFO ] [REMOTE ] JKS: Full fetch complete (58855 records). [2025-10-16T19:43:12.301320] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-16T19:43:12.634852] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:43:12.699166] [INFO ] [REMOTE ] JLL: Full fetch complete (45034 records). [2025-10-16T19:43:12.719293] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-16T19:43:12.719621] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-16T19:43:12.719782] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-16T19:43:12.752566] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-16T19:43:12.720874] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-16T19:43:12.765005] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-16T19:43:12.847954] [DEBUG] [LOCAL ] JKS: Trimmed 58855 records to 39945 (keeping 200 days of data) [2025-10-16T19:43:13.290697] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-16T19:43:13.316508] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-16T19:43:13.317512] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-16T19:43:13.317590] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-16T19:43:13.323570] [DEBUG] [LOCAL ] JLL: Trimmed 45034 records to 31952 (keeping 200 days of data) [2025-10-16T19:43:13.425815] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:43:13.475432] [DEBUG] [LOCAL ] JKS: Primary data saved (39945 records). [2025-10-16T19:43:13.480026] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-16T19:43:13.480251] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JKS took 37.4s. Estimated remaining: 2h 50m 55s. Rate: 7.1 symbols/min [2025-10-16T19:43:13.546130] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-16T19:43:13.553095] [DEBUG] [LOCAL ] JLL: Primary data saved (31952 records). [2025-10-16T19:43:13.553188] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-16T19:43:13.553293] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLL took 27.6s. Estimated remaining: 2h 50m 38s. Rate: 7.1 symbols/min [2025-10-16T19:43:13.577890] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-16T19:43:13.953358] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-16T19:43:14.342818] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-16T19:43:14.884340] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:43:15.142794] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-16T19:43:15.691079] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-16T19:43:15.942868] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-16T19:43:16.515384] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-16T19:43:16.742812] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-16T19:43:17.309183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-16T19:43:17.542886] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-16T19:43:18.342841] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-16T19:43:18.916932] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-16T19:43:19.142819] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-16T19:43:19.194510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:43:19.697639] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-16T19:43:19.942806] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-16T19:43:20.347433] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-16T19:43:20.742828] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-16T19:43:21.542802] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-16T19:43:22.432879] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-16T19:43:22.434183] [INFO ] [REMOTE ] JLS: Full fetch complete (5850 records). [2025-10-16T19:43:22.434398] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-16T19:43:22.647892] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-16T19:43:22.758456] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-16T19:43:22.849947] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-16T19:43:22.850024] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-16T19:43:22.850184] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-16T19:43:22.850222] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-16T19:43:22.850584] [DEBUG] [LOCAL ] JLS: Trimmed 5850 records to 4239 (keeping 200 days of data) [2025-10-16T19:43:22.875874] [DEBUG] [LOCAL ] JLS: Primary data saved (4239 records). [2025-10-16T19:43:22.876032] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-16T19:43:22.876131] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLS took 19.2s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-16T19:43:24.735394] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:43:24.745960] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-16T19:43:26.181107] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:43:26.191251] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-16T19:43:28.117795] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:43:28.128768] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-16T19:43:30.095540] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:43:30.106598] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-16T19:43:31.917638] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T19:43:31.928856] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-16T19:43:33.773563] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-16T19:43:33.780364] [INFO ] [REMOTE ] JMIA: Full fetch complete (73449 records). [2025-10-16T19:43:33.780500] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-16T19:43:34.163937] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-16T19:43:34.164023] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-16T19:43:34.165144] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-16T19:43:34.165208] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-16T19:43:34.166686] [DEBUG] [LOCAL ] JMIA: Trimmed 73449 records to 51442 (keeping 200 days of data) [2025-10-16T19:43:34.465474] [DEBUG] [LOCAL ] JMIA: Primary data saved (51442 records). [2025-10-16T19:43:34.465658] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-16T19:43:34.466238] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JMIA took 28.7s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-16T19:43:35.026320] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.133799] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.132989] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.155606] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-16T19:43:35.158191] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-16T19:43:35.159971] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-16T19:43:35.160045] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-16T19:43:35.160092] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-16T19:43:35.160126] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-16T19:43:35.159493] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:35.389562] [DEBUG] [LOCAL ] JOE: Loaded 23893 existing records from primary storage. [2025-10-16T19:43:35.409496] [INFO ] [MAIN ] JOE: Loaded 23893 existing records. [2025-10-16T19:43:35.565280] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-16T19:43:35.637857] [INFO ] [MAIN ] JOBY: Loaded 53808 existing records. [2025-10-16T19:43:35.653126] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-16T19:43:35.714465] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-16T19:43:35.877063] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:35.920527] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-16T19:43:35.920422] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:35.926015] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-16T19:43:35.959205] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-16T19:43:35.964470] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-16T19:43:36.018422] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-16T19:43:36.128080] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:36.147143] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-16T19:43:36.177378] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-16T19:43:36.212432] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-16T19:43:36.252253] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-16T19:43:36.381596] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:36.387556] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-16T19:43:36.401415] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-16T19:43:36.466175] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-16T19:43:36.466467] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-16T19:43:36.519720] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:43:36.545542] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-16T19:43:37.078724] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-16T19:43:37.150694] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-16T19:43:37.271032] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.343470] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-16T19:43:37.369131] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.374537] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-16T19:43:37.433129] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:37.433389] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-16T19:43:37.669295] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-16T19:43:37.670345] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-16T19:43:38.003288] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-16T19:43:38.004559] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-16T19:43:38.365195] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-16T19:43:38.366401] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-16T19:43:38.657232] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:43:38.663202] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-16T19:43:38.831725] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-16T19:43:38.833062] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-16T19:43:39.164688] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-16T19:43:39.166627] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-16T19:43:39.571404] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-16T19:43:39.577812] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-16T19:43:39.626957] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:43:39.628223] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-16T19:43:39.658923] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-16T19:43:39.670178] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-16T19:43:40.000625] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-16T19:43:40.012746] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-16T19:43:40.083072] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:43:40.084933] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-16T19:43:40.603982] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-16T19:43:40.618806] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:43:40.742812] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-16T19:43:41.542839] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-16T19:43:41.726602] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-16T19:43:41.753364] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-16T19:43:41.902233] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-16T19:43:41.902970] [INFO ] [REMOTE ] JMM: Full fetch complete (2297 records). [2025-10-16T19:43:41.903039] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-16T19:43:42.083694] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-16T19:43:42.083949] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:43:42.084186] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:43:42.084265] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-16T19:43:42.084461] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-16T19:43:42.084587] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-16T19:43:42.084751] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-16T19:43:42.084876] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 7.6s. Estimated remaining: 2h 50m 16s. Rate: 7.1 symbols/min [2025-10-16T19:43:42.258348] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:42.290980] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-16T19:43:42.305170] [DEBUG] [LOCAL ] JOF: Loaded 6891 existing records from primary storage. [2025-10-16T19:43:42.305360] [INFO ] [MAIN ] JOF: Loaded 6891 existing records. [2025-10-16T19:43:42.347881] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-16T19:43:42.480589] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:42.480816] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-16T19:43:42.480864] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-16T19:43:42.481007] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-16T19:43:42.481043] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-16T19:43:42.833003] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:43.142812] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-16T19:43:43.772896] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-16T19:43:43.942784] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-16T19:43:44.742796] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-16T19:43:44.885419] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T19:43:45.217400] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-16T19:43:45.542822] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-16T19:43:46.342822] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-16T19:43:46.902989] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-16T19:43:47.142784] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-16T19:43:47.422583] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-16T19:43:47.667505] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-16T19:43:47.942845] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-16T19:43:48.742858] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-16T19:43:49.351562] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-16T19:43:49.506110] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-16T19:43:49.542853] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-16T19:43:50.174468] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-16T19:43:50.342865] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-16T19:43:51.142866] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-16T19:43:51.890586] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-16T19:43:51.919975] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-16T19:43:51.942773] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-16T19:43:52.749219] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-16T19:43:52.755280] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:43:53.132681] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T19:43:53.152745] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-16T19:43:53.542826] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-16T19:43:54.342871] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-16T19:43:54.621128] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-16T19:43:55.142946] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-16T19:43:55.942793] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-16T19:43:56.278282] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-16T19:43:56.742840] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-16T19:43:57.051495] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:43:57.054627] [INFO ] [REMOTE ] JOE: Full fetch complete (35675 records). [2025-10-16T19:43:57.054728] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-16T19:43:57.385854] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-16T19:43:57.474555] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-16T19:43:57.474795] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-16T19:43:57.475818] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-16T19:43:57.475920] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-16T19:43:57.477322] [DEBUG] [LOCAL ] JOE: Trimmed 35675 records to 24021 (keeping 200 days of data) [2025-10-16T19:43:57.545294] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-16T19:43:57.600056] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-16T19:43:57.668487] [DEBUG] [LOCAL ] JOE: Primary data saved (24021 records). [2025-10-16T19:43:57.668677] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-16T19:43:57.668784] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOE took 23.2s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-16T19:43:57.841513] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:43:57.876851] [DEBUG] [LOCAL ] JPC: Loaded 37227 existing records from primary storage. [2025-10-16T19:43:57.877158] [INFO ] [MAIN ] JPC: Loaded 37227 existing records. [2025-10-16T19:43:58.051063] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:43:58.051269] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-16T19:43:58.051316] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-16T19:43:58.052043] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-16T19:43:58.052112] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-16T19:43:58.347910] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-16T19:43:58.399577] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:43:58.871327] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-16T19:43:59.142813] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-16T19:43:59.666489] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-16T19:43:59.929120] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-16T19:43:59.942781] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-16T19:44:00.742825] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-16T19:44:01.542850] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-16T19:44:02.187730] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-16T19:44:02.342801] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-16T19:44:02.522189] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-16T19:44:03.142811] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-16T19:44:03.450816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-16T19:44:03.918782] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:44:03.942823] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-16T19:44:04.449754] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T19:44:04.742895] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-16T19:44:05.532480] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-16T19:44:05.543487] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-16T19:44:06.148185] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-16T19:44:06.342860] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-16T19:44:06.745948] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:44:07.142859] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-16T19:44:07.547029] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-16T19:44:07.805416] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-16T19:44:07.942831] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-16T19:44:08.742827] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-16T19:44:09.542794] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-16T19:44:10.213879] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:44:10.342841] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-16T19:44:10.748732] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-16T19:44:11.129786] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:44:11.142804] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-16T19:44:11.622199] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-16T19:44:11.629209] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-16T19:44:11.629358] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-16T19:44:11.739508] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-16T19:44:11.948018] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-16T19:44:12.073898] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-16T19:44:12.073971] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-16T19:44:12.075032] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-16T19:44:12.075095] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-16T19:44:12.076430] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54143 (keeping 200 days of data) [2025-10-16T19:44:12.410587] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-16T19:44:12.410762] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-16T19:44:12.410864] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 37.9s. Estimated remaining: 2h 50m 13s. Rate: 7.1 symbols/min [2025-10-16T19:44:12.576151] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:12.623729] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-16T19:44:12.624038] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-16T19:44:12.748049] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-16T19:44:12.823709] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:12.823932] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-16T19:44:12.823985] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-16T19:44:12.825051] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-16T19:44:12.825107] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-16T19:44:13.169481] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:13.536054] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-16T19:44:13.537480] [INFO ] [REMOTE ] JOF: Full fetch complete (9464 records). [2025-10-16T19:44:13.537548] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-16T19:44:13.548887] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-16T19:44:13.892295] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-16T19:44:13.892376] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-16T19:44:13.892632] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-16T19:44:13.892707] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-16T19:44:13.893183] [DEBUG] [LOCAL ] JOF: Trimmed 9464 records to 6944 (keeping 200 days of data) [2025-10-16T19:44:13.936143] [DEBUG] [LOCAL ] JOF: Primary data saved (6944 records). [2025-10-16T19:44:13.936288] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-16T19:44:13.936369] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JOF took 31.9s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-16T19:44:14.103604] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:14.135303] [DEBUG] [LOCAL ] JQC: Loaded 33645 existing records from primary storage. [2025-10-16T19:44:14.135632] [INFO ] [MAIN ] JQC: Loaded 33645 existing records. [2025-10-16T19:44:14.314096] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:14.314590] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-16T19:44:14.314638] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-16T19:44:14.315749] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-16T19:44:14.315809] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-16T19:44:14.348087] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-16T19:44:14.679281] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:14.777236] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-16T19:44:15.142818] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-16T19:44:15.942806] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-16T19:44:15.990864] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-16T19:44:16.063284] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:44:16.742831] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-16T19:44:16.963350] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-16T19:44:17.542812] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-16T19:44:18.078399] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-16T19:44:18.085711] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-16T19:44:18.085871] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-16T19:44:18.355402] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-16T19:44:18.486446] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-16T19:44:18.486561] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-16T19:44:18.487607] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-16T19:44:18.487698] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-16T19:44:18.489148] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54198 (keeping 200 days of data) [2025-10-16T19:44:18.802323] [DEBUG] [LOCAL ] JOBY: Primary data saved (54198 records). [2025-10-16T19:44:18.802448] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-16T19:44:18.802525] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOBY took 44.3s. Estimated remaining: 2h 49m 45s. Rate: 7.1 symbols/min [2025-10-16T19:44:18.996707] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:18.998552] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-16T19:44:19.021182] [DEBUG] [LOCAL ] JRI: Loaded 15410 existing records from primary storage. [2025-10-16T19:44:19.021414] [INFO ] [MAIN ] JRI: Loaded 15410 existing records. [2025-10-16T19:44:19.145411] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-16T19:44:19.231429] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:19.231742] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-16T19:44:19.231806] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-16T19:44:19.232263] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-16T19:44:19.232321] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-16T19:44:19.544027] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-16T19:44:19.633217] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:19.872115] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:44:19.942818] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-16T19:44:20.109088] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:44:20.586996] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T19:44:20.742807] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-16T19:44:21.542801] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-16T19:44:21.596104] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-16T19:44:22.342815] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-16T19:44:23.142823] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-16T19:44:23.638555] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:44:23.747283] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-16T19:44:23.942804] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-16T19:44:23.974435] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-16T19:44:24.742802] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-16T19:44:24.930994] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-16T19:44:25.542817] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-16T19:44:25.822797] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-16T19:44:26.260821] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-16T19:44:26.342860] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-16T19:44:27.142795] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-16T19:44:27.345528] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:44:27.942827] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-16T19:44:28.742862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-16T19:44:29.406572] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:44:29.547907] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-16T19:44:29.565185] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-16T19:44:29.840486] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-16T19:44:30.342864] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-16T19:44:30.490420] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-16T19:44:31.142826] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-16T19:44:31.700788] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-16T19:44:31.942842] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-16T19:44:32.742848] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-16T19:44:32.965690] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:44:33.145880] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-16T19:44:33.542824] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-16T19:44:34.288631] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-16T19:44:34.293756] [INFO ] [REMOTE ] JPC: Full fetch complete (55289 records). [2025-10-16T19:44:34.293892] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-16T19:44:34.350555] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-16T19:44:34.694389] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-16T19:44:34.694484] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-16T19:44:34.695346] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-16T19:44:34.695408] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-16T19:44:34.696432] [DEBUG] [LOCAL ] JPC: Trimmed 55289 records to 37494 (keeping 200 days of data) [2025-10-16T19:44:34.913164] [DEBUG] [LOCAL ] JPC: Primary data saved (37494 records). [2025-10-16T19:44:34.913287] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-16T19:44:34.913915] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPC took 37.2s. Estimated remaining: 2h 49m 44s. Rate: 7.1 symbols/min [2025-10-16T19:44:35.084838] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:44:35.118138] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:35.130547] [DEBUG] [LOCAL ] JRS: Loaded 11669 existing records from primary storage. [2025-10-16T19:44:35.130792] [INFO ] [MAIN ] JRS: Loaded 11669 existing records. [2025-10-16T19:44:35.150934] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-16T19:44:35.335624] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:35.335953] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-16T19:44:35.336010] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-16T19:44:35.336282] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-16T19:44:35.336339] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-16T19:44:35.687114] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:35.942781] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-16T19:44:36.147051] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:44:36.734891] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-16T19:44:36.746602] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-16T19:44:36.945020] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-16T19:44:37.542880] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-16T19:44:37.598121] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-16T19:44:38.342898] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-16T19:44:39.014177] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-16T19:44:39.142829] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-16T19:44:39.284506] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-16T19:44:39.945971] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-16T19:44:39.946844] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:44:40.742872] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-16T19:44:41.220219] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-16T19:44:41.503328] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T19:44:41.542786] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-16T19:44:42.342841] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-16T19:44:42.509553] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-16T19:44:42.904842] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-16T19:44:43.142807] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-16T19:44:43.886941] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-16T19:44:43.942770] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-16T19:44:44.714276] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:44:44.742820] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-16T19:44:45.427350] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-16T19:44:45.542812] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-16T19:44:46.342898] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-16T19:44:46.915577] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:44:47.058276] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-16T19:44:47.063365] [INFO ] [REMOTE ] JQC: Full fetch complete (49729 records). [2025-10-16T19:44:47.063500] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-16T19:44:47.148052] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-16T19:44:47.448856] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-16T19:44:47.448932] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-16T19:44:47.449840] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-16T19:44:47.449903] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-16T19:44:47.450906] [DEBUG] [LOCAL ] JQC: Trimmed 49729 records to 33945 (keeping 200 days of data) [2025-10-16T19:44:47.644149] [DEBUG] [LOCAL ] JQC: Primary data saved (33945 records). [2025-10-16T19:44:47.644281] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-16T19:44:47.644361] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JQC took 33.7s. Estimated remaining: 2h 49m 40s. Rate: 7.1 symbols/min [2025-10-16T19:44:47.816801] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:47.858125] [DEBUG] [LOCAL ] JXN: Loaded 44730 existing records from primary storage. [2025-10-16T19:44:47.858424] [INFO ] [MAIN ] JXN: Loaded 44730 existing records. [2025-10-16T19:44:47.947929] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-16T19:44:48.039863] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:48.040251] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-16T19:44:48.045618] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-16T19:44:48.052549] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-16T19:44:48.052629] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-16T19:44:48.053580] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:44:48.405956] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:48.742800] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-16T19:44:49.542836] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-16T19:44:49.626376] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-16T19:44:50.258198] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-16T19:44:50.259199] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T19:44:50.342781] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-16T19:44:50.800639] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-16T19:44:51.142826] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-16T19:44:51.942801] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-16T19:44:52.044310] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:44:52.047041] [INFO ] [REMOTE ] JRI: Full fetch complete (23214 records). [2025-10-16T19:44:52.047135] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-16T19:44:52.432726] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-16T19:44:52.432809] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-16T19:44:52.433282] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-16T19:44:52.433320] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-16T19:44:52.433931] [DEBUG] [LOCAL ] JRI: Trimmed 23214 records to 15503 (keeping 200 days of data) [2025-10-16T19:44:52.526547] [DEBUG] [LOCAL ] JRI: Primary data saved (15503 records). [2025-10-16T19:44:52.526714] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-16T19:44:52.526809] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JRI took 33.7s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-16T19:44:52.706571] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:44:52.709848] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:52.712682] [INFO ] [REMOTE ] JRS: Full fetch complete (16339 records). [2025-10-16T19:44:52.712839] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-16T19:44:52.744390] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-16T19:44:53.057266] [DEBUG] [LOCAL ] K: Loaded 50422 existing records from primary storage. [2025-10-16T19:44:53.080574] [INFO ] [MAIN ] K: Loaded 50422 existing records. [2025-10-16T19:44:53.230252] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-16T19:44:53.232636] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-16T19:44:53.233065] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-16T19:44:53.233372] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-16T19:44:53.277244] [DEBUG] [LOCAL ] JRS: Trimmed 16339 records to 11746 (keeping 200 days of data) [2025-10-16T19:44:53.313609] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:53.314029] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-16T19:44:53.314091] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-16T19:44:53.340496] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-16T19:44:53.340612] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-16T19:44:53.486560] [DEBUG] [LOCAL ] JRS: Primary data saved (11746 records). [2025-10-16T19:44:53.487006] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-16T19:44:53.492455] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRS took 18.6s. Estimated remaining: 2h 49m 12s. Rate: 7.1 symbols/min [2025-10-16T19:44:53.547904] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-16T19:44:53.924618] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:44:53.947564] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:53.966306] [DEBUG] [LOCAL ] KAI: Loaded 13579 existing records from primary storage. [2025-10-16T19:44:53.966623] [INFO ] [MAIN ] KAI: Loaded 13579 existing records. [2025-10-16T19:44:54.136081] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-16T19:44:54.187182] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:44:54.187482] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-16T19:44:54.187541] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-16T19:44:54.187730] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-16T19:44:54.187786] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-16T19:44:54.361604] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-16T19:44:54.543375] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:44:55.142809] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-16T19:44:55.474026] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-16T19:44:55.929345] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:44:55.942757] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-16T19:44:56.023150] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-16T19:44:56.742841] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-16T19:44:57.542824] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-16T19:44:57.911563] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-16T19:44:58.342843] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-16T19:44:58.411450] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-16T19:44:58.646728] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-16T19:44:58.797481] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-16T19:44:59.142850] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-16T19:44:59.942826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-16T19:45:00.742853] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-16T19:45:01.542891] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-16T19:45:01.682893] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-16T19:45:01.690198] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-16T19:45:01.690376] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-16T19:45:02.092381] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:45:02.144189] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-16T19:45:02.208638] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-16T19:45:02.208865] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-16T19:45:02.210511] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-16T19:45:02.210592] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-16T19:45:02.212257] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54184 (keeping 200 days of data) [2025-10-16T19:45:02.389724] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-16T19:45:02.554988] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-16T19:45:02.555162] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-16T19:45:02.555260] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JPM took 50.1s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-16T19:45:02.754798] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:02.813218] [DEBUG] [LOCAL ] KAR: Loaded 40054 existing records from primary storage. [2025-10-16T19:45:02.813690] [INFO ] [MAIN ] KAR: Loaded 40054 existing records. [2025-10-16T19:45:03.110856] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:03.111169] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-16T19:45:03.111228] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-16T19:45:03.111621] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-16T19:45:03.111742] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-16T19:45:03.156884] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-16T19:45:03.531692] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:45:03.739040] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:03.942786] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-16T19:45:03.995849] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:45:04.037548] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-16T19:45:04.742813] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-16T19:45:05.456312] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:45:05.542816] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-16T19:45:06.163933] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:45:06.342849] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-16T19:45:07.121102] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:45:07.142774] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-16T19:45:07.715119] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:45:07.942803] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-16T19:45:08.601138] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:45:08.734695] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:45:08.742767] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-16T19:45:09.472396] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:45:09.542833] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-16T19:45:10.342866] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-16T19:45:10.666360] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:45:11.006219] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-16T19:45:11.142810] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-16T19:45:11.942798] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-16T19:45:12.742784] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-16T19:45:12.848816] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T19:45:13.405019] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-16T19:45:13.542797] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-16T19:45:13.922492] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-16T19:45:14.342824] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-16T19:45:14.621286] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-16T19:45:15.142815] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-16T19:45:15.942780] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-16T19:45:16.199299] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:45:16.425703] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-16T19:45:16.742862] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-16T19:45:17.106989] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-16T19:45:17.542816] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-16T19:45:18.108077] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:45:18.128192] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-16T19:45:18.342811] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-16T19:45:19.142815] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-16T19:45:19.428982] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-16T19:45:19.593913] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:45:19.942814] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-16T19:45:20.742821] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-16T19:45:21.542821] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-16T19:45:21.589601] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:45:22.352288] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-16T19:45:22.358679] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T19:45:22.515814] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-16T19:45:23.142884] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-16T19:45:23.876138] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-16T19:45:23.878831] [INFO ] [REMOTE ] KAI: Full fetch complete (19174 records). [2025-10-16T19:45:23.878915] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-16T19:45:23.944834] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-16T19:45:24.177984] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-16T19:45:24.299899] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-16T19:45:24.299982] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-16T19:45:24.300393] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-16T19:45:24.300433] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-16T19:45:24.301131] [DEBUG] [LOCAL ] KAI: Trimmed 19174 records to 13688 (keeping 200 days of data) [2025-10-16T19:45:24.387316] [DEBUG] [LOCAL ] KAI: Primary data saved (13688 records). [2025-10-16T19:45:24.387446] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-16T19:45:24.387524] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. KAI took 30.9s. Estimated remaining: 2h 49m 9s. Rate: 7.1 symbols/min [2025-10-16T19:45:24.560235] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:24.582402] [DEBUG] [LOCAL ] KB: Loaded 23340 existing records from primary storage. [2025-10-16T19:45:24.582689] [INFO ] [MAIN ] KB: Loaded 23340 existing records. [2025-10-16T19:45:24.748781] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-16T19:45:24.780011] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:24.780266] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-16T19:45:24.780320] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-16T19:45:24.780498] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-16T19:45:24.780557] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-16T19:45:25.136108] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:25.535680] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:45:25.545400] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-16T19:45:25.908413] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-16T19:45:26.342879] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-16T19:45:26.673368] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-16T19:45:27.142886] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-16T19:45:27.875247] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-16T19:45:27.880506] [INFO ] [REMOTE ] JXN: Full fetch complete (65598 records). [2025-10-16T19:45:27.880619] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-16T19:45:27.948068] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-16T19:45:28.275275] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-16T19:45:28.275400] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-16T19:45:28.276367] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-16T19:45:28.276455] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-16T19:45:28.277849] [DEBUG] [LOCAL ] JXN: Trimmed 65598 records to 45020 (keeping 200 days of data) [2025-10-16T19:45:28.553291] [DEBUG] [LOCAL ] JXN: Primary data saved (45020 records). [2025-10-16T19:45:28.553411] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-16T19:45:28.554023] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JXN took 40.9s. Estimated remaining: 2h 48m 57s. Rate: 7.1 symbols/min [2025-10-16T19:45:28.721307] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-16T19:45:28.738198] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:28.742910] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-16T19:45:28.744727] [INFO ] [REMOTE ] KAR: Full fetch complete (57018 records). [2025-10-16T19:45:28.744902] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-16T19:45:28.958023] [DEBUG] [LOCAL ] KBDC: Loaded 22209 existing records from primary storage. [2025-10-16T19:45:28.985848] [INFO ] [MAIN ] KBDC: Loaded 22209 existing records. [2025-10-16T19:45:29.297263] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-16T19:45:29.297040] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:45:29.297378] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-16T19:45:29.326812] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-16T19:45:29.339613] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-16T19:45:29.367292] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:29.367672] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-16T19:45:29.367828] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-16T19:45:29.368147] [DEBUG] [LOCAL ] KAR: Trimmed 57018 records to 40339 (keeping 200 days of data) [2025-10-16T19:45:29.368433] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-16T19:45:29.368526] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-16T19:45:29.549373] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-16T19:45:29.946671] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:29.971216] [DEBUG] [LOCAL ] KAR: Primary data saved (40339 records). [2025-10-16T19:45:29.971332] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-16T19:45:29.971407] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. KAR took 27.4s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-16T19:45:30.142885] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:30.186816] [DEBUG] [LOCAL ] KBH: Loaded 48840 existing records from primary storage. [2025-10-16T19:45:30.187113] [INFO ] [MAIN ] KBH: Loaded 48840 existing records. [2025-10-16T19:45:30.347796] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-16T19:45:30.367140] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:30.368244] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-16T19:45:30.368332] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-16T19:45:30.369104] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-16T19:45:30.369180] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-16T19:45:30.748564] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:30.795391] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-16T19:45:30.803722] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-16T19:45:31.035794] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-16T19:45:31.142792] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-16T19:45:31.942799] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-16T19:45:31.980357] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-16T19:45:32.742818] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-16T19:45:33.551906] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-16T19:45:33.571053] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-16T19:45:34.342810] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-16T19:45:34.396601] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T19:45:34.428200] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:45:35.142843] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-16T19:45:35.942807] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-16T19:45:36.157451] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-16T19:45:36.742813] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-16T19:45:36.884224] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:45:36.943399] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-16T19:45:37.542862] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-16T19:45:38.312052] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:45:38.318962] [INFO ] [REMOTE ] K: Full fetch complete (72346 records). [2025-10-16T19:45:38.319128] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-16T19:45:38.354168] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-16T19:45:38.791310] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-16T19:45:38.791446] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-16T19:45:38.792581] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-16T19:45:38.792664] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-16T19:45:38.794093] [DEBUG] [LOCAL ] K: Trimmed 72346 records to 50804 (keeping 200 days of data) [2025-10-16T19:45:39.102909] [DEBUG] [LOCAL ] K: Primary data saved (50804 records). [2025-10-16T19:45:39.103044] [INFO ] [MAIN ] K: Full history saved. [2025-10-16T19:45:39.103811] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 46.6s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-10-16T19:45:39.160821] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-16T19:45:39.285597] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:39.313327] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-16T19:45:39.366229] [DEBUG] [LOCAL ] KBR: Loaded 48081 existing records from primary storage. [2025-10-16T19:45:39.366548] [INFO ] [MAIN ] KBR: Loaded 48081 existing records. [2025-10-16T19:45:39.568503] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-16T19:45:39.567140] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:39.574356] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-16T19:45:39.574612] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-16T19:45:39.576322] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-16T19:45:39.576469] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-16T19:45:39.961847] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:39.955834] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-16T19:45:39.956365] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-16T19:45:40.742840] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-16T19:45:41.542798] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-16T19:45:41.711464] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-16T19:45:42.342846] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-16T19:45:42.383733] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-16T19:45:42.441098] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-16T19:45:43.142786] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-16T19:45:43.301891] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-16T19:45:43.942837] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-16T19:45:44.487163] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-16T19:45:44.669765] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-16T19:45:44.742806] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-16T19:45:45.470966] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-16T19:45:45.542790] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-16T19:45:46.342810] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-16T19:45:46.557803] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-16T19:45:47.142825] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-16T19:45:47.323152] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-16T19:45:47.942820] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-16T19:45:48.728317] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-16T19:45:48.742787] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-16T19:45:49.542780] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-16T19:45:49.688501] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-16T19:45:49.889864] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-16T19:45:50.162389] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-16T19:45:50.342840] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-16T19:45:51.142818] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-16T19:45:51.842163] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-16T19:45:51.942796] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-16T19:45:52.217745] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:45:52.725549] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-16T19:45:52.742776] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-16T19:45:53.542819] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-16T19:45:54.342919] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-16T19:45:54.414213] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:45:54.439510] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-16T19:45:54.442413] [INFO ] [REMOTE ] KB: Full fetch complete (33722 records). [2025-10-16T19:45:54.442506] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-16T19:45:54.819569] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-16T19:45:54.819677] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-16T19:45:54.820361] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-16T19:45:54.820406] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-16T19:45:54.821295] [DEBUG] [LOCAL ] KB: Trimmed 33722 records to 23518 (keeping 200 days of data) [2025-10-16T19:45:54.960614] [DEBUG] [LOCAL ] KB: Primary data saved (23518 records). [2025-10-16T19:45:54.960772] [INFO ] [MAIN ] KB: Full history saved. [2025-10-16T19:45:54.960858] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KB took 30.6s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-16T19:45:55.132536] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:55.142859] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-16T19:45:55.185632] [DEBUG] [LOCAL ] KD: Loaded 52354 existing records from primary storage. [2025-10-16T19:45:55.185997] [INFO ] [MAIN ] KD: Loaded 52354 existing records. [2025-10-16T19:45:55.381692] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:55.381942] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-16T19:45:55.382004] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-16T19:45:55.382221] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-16T19:45:55.382286] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-16T19:45:55.856069] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-16T19:45:55.943609] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-16T19:45:55.975457] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:56.232570] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-16T19:45:56.742839] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-16T19:45:57.542845] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-16T19:45:57.722243] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:45:58.114634] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-16T19:45:58.120168] [INFO ] [REMOTE ] KBDC: Full fetch complete (30312 records). [2025-10-16T19:45:58.120308] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-16T19:45:58.350636] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-16T19:45:58.497810] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-16T19:45:58.497900] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-16T19:45:58.498661] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-16T19:45:58.498727] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-16T19:45:58.499757] [DEBUG] [LOCAL ] KBDC: Trimmed 30312 records to 22431 (keeping 200 days of data) [2025-10-16T19:45:58.656360] [DEBUG] [LOCAL ] KBDC: Primary data saved (22431 records). [2025-10-16T19:45:58.656703] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-16T19:45:58.656807] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KBDC took 30.1s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-16T19:45:58.861005] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:45:58.895172] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:45:58.895429] [DEBUG] [LOCAL ] KEN: Loaded 4705 existing records from primary storage. [2025-10-16T19:45:58.905121] [INFO ] [MAIN ] KEN: Loaded 4705 existing records. [2025-10-16T19:45:59.082838] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:45:59.083054] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-16T19:45:59.083102] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-16T19:45:59.083236] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-16T19:45:59.083274] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-16T19:45:59.148078] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-16T19:45:59.431494] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:45:59.942787] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-16T19:45:59.974452] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-16T19:46:00.742833] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-16T19:46:00.980746] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T19:46:01.549256] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-16T19:46:01.555916] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:46:02.108756] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-16T19:46:02.112221] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:46:02.342826] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-16T19:46:03.142833] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-16T19:46:03.942791] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-16T19:46:04.005107] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-16T19:46:04.383114] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:46:04.742811] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-16T19:46:05.542797] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-16T19:46:05.700733] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:46:06.303508] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:46:06.342770] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-16T19:46:07.142794] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-16T19:46:07.196262] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:46:07.697524] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-16T19:46:07.942548] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-16T19:46:07.948424] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-16T19:46:07.950215] [INFO ] [REMOTE ] KBH: Full fetch complete (71131 records). [2025-10-16T19:46:07.950302] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-16T19:46:08.336846] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-16T19:46:08.336944] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-16T19:46:08.340766] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-16T19:46:08.340890] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-16T19:46:08.341033] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-16T19:46:08.343668] [DEBUG] [LOCAL ] KBH: Trimmed 71131 records to 49212 (keeping 200 days of data) [2025-10-16T19:46:08.638056] [DEBUG] [LOCAL ] KBH: Primary data saved (49212 records). [2025-10-16T19:46:08.638192] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-16T19:46:08.638321] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBH took 38.7s. Estimated remaining: 2h 48m 12s. Rate: 7.1 symbols/min [2025-10-16T19:46:08.747911] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-16T19:46:08.812061] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:08.843225] [DEBUG] [LOCAL ] KEP: Loaded 31996 existing records from primary storage. [2025-10-16T19:46:08.843487] [INFO ] [MAIN ] KEP: Loaded 31996 existing records. [2025-10-16T19:46:09.018262] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:09.018489] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-16T19:46:09.018547] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-16T19:46:09.018758] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-16T19:46:09.018832] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-16T19:46:09.370887] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:09.542815] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-16T19:46:10.342771] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-16T19:46:10.548731] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:46:10.598556] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:46:11.007660] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-16T19:46:11.142807] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-16T19:46:11.942780] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-16T19:46:12.003883] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-16T19:46:12.696790] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-16T19:46:12.742876] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-16T19:46:13.324425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:46:13.542812] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-16T19:46:14.342810] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-16T19:46:15.008927] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:46:15.142824] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-16T19:46:15.423481] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-16T19:46:15.942822] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-16T19:46:16.747017] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-16T19:46:16.748483] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:46:16.781627] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-16T19:46:17.542880] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-16T19:46:18.115152] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-16T19:46:18.256308] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-16T19:46:18.342771] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-16T19:46:19.142824] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-16T19:46:19.651203] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T19:46:19.942806] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-16T19:46:20.742789] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-16T19:46:21.062141] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-16T19:46:21.505886] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:46:21.542825] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-16T19:46:21.638165] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T19:46:22.342871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-16T19:46:22.874431] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-16T19:46:22.881251] [INFO ] [REMOTE ] KBR: Full fetch complete (69985 records). [2025-10-16T19:46:22.881393] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-16T19:46:23.144732] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-16T19:46:23.182442] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-16T19:46:23.275128] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-16T19:46:23.275204] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-16T19:46:23.276174] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-16T19:46:23.276238] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-16T19:46:23.277520] [DEBUG] [LOCAL ] KBR: Trimmed 69985 records to 48409 (keeping 200 days of data) [2025-10-16T19:46:23.561034] [DEBUG] [LOCAL ] KBR: Primary data saved (48409 records). [2025-10-16T19:46:23.561162] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-16T19:46:23.561979] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBR took 44.5s. Estimated remaining: 2h 48m 10s. Rate: 7.1 symbols/min [2025-10-16T19:46:23.725945] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:23.764333] [DEBUG] [LOCAL ] KEX: Loaded 38604 existing records from primary storage. [2025-10-16T19:46:23.764611] [INFO ] [MAIN ] KEX: Loaded 38604 existing records. [2025-10-16T19:46:23.939471] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:23.939707] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-16T19:46:23.939766] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-16T19:46:23.940064] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-16T19:46:23.940120] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-16T19:46:23.951328] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-16T19:46:24.320831] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:24.663174] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-16T19:46:24.742792] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-16T19:46:25.117275] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-16T19:46:25.542839] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-16T19:46:26.228753] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:46:26.342808] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-16T19:46:27.060417] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:46:27.142777] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-16T19:46:27.414616] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:46:27.942853] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-16T19:46:28.730554] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:46:28.737434] [INFO ] [REMOTE ] KD: Full fetch complete (76051 records). [2025-10-16T19:46:28.737585] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-16T19:46:28.749454] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-16T19:46:29.168014] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-16T19:46:29.168150] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-16T19:46:29.169242] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-16T19:46:29.169304] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-16T19:46:29.170725] [DEBUG] [LOCAL ] KD: Trimmed 76051 records to 52742 (keeping 200 days of data) [2025-10-16T19:46:29.398245] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:46:29.397207] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-16T19:46:29.505630] [DEBUG] [LOCAL ] KD: Primary data saved (52742 records). [2025-10-16T19:46:29.505806] [INFO ] [MAIN ] KD: Full history saved. [2025-10-16T19:46:29.506450] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KD took 34.5s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-16T19:46:29.547950] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-16T19:46:29.677121] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:29.677290] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-16T19:46:29.677327] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-16T19:46:29.677493] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-16T19:46:29.677534] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-16T19:46:29.677578] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-16T19:46:29.677612] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-16T19:46:30.031563] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:30.065258] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-16T19:46:30.066424] [INFO ] [REMOTE ] KEN: Full fetch complete (5972 records). [2025-10-16T19:46:30.066510] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-16T19:46:30.347952] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-16T19:46:30.452668] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-16T19:46:30.452815] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-16T19:46:30.453020] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-16T19:46:30.453907] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-16T19:46:30.454372] [DEBUG] [LOCAL ] KEN: Trimmed 5972 records to 4721 (keeping 200 days of data) [2025-10-16T19:46:30.482455] [DEBUG] [LOCAL ] KEN: Primary data saved (4721 records). [2025-10-16T19:46:30.482590] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-16T19:46:30.482697] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KEN took 31.8s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-16T19:46:30.649199] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:30.690762] [DEBUG] [LOCAL ] KEYS: Loaded 43274 existing records from primary storage. [2025-10-16T19:46:30.691103] [INFO ] [MAIN ] KEYS: Loaded 43274 existing records. [2025-10-16T19:46:30.866538] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:30.866804] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-16T19:46:30.866855] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-16T19:46:30.867171] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-16T19:46:30.867228] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-16T19:46:31.148186] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-16T19:46:31.227335] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:31.942793] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-16T19:46:32.126165] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-16T19:46:32.605827] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:46:32.742854] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-16T19:46:33.487587] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:46:33.542834] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-16T19:46:34.342846] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-16T19:46:34.461822] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-16T19:46:34.810447] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-16T19:46:35.142839] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-16T19:46:35.912395] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:46:35.942805] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-16T19:46:36.270160] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-16T19:46:36.742854] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-16T19:46:37.520608] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:46:37.542776] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-16T19:46:37.585638] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:46:38.342835] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-16T19:46:39.142801] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-16T19:46:39.244933] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-16T19:46:39.713985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-16T19:46:39.942801] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-16T19:46:40.462626] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-16T19:46:40.466882] [INFO ] [REMOTE ] KEP: Full fetch complete (42077 records). [2025-10-16T19:46:40.466962] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-16T19:46:40.748012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-16T19:46:40.842064] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-16T19:46:40.842162] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-16T19:46:40.843026] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-16T19:46:40.843088] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-16T19:46:40.844108] [DEBUG] [LOCAL ] KEP: Trimmed 42077 records to 32230 (keeping 200 days of data) [2025-10-16T19:46:41.031560] [DEBUG] [LOCAL ] KEP: Primary data saved (32230 records). [2025-10-16T19:46:41.031728] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-16T19:46:41.031818] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 32.4s. Estimated remaining: 2h 47m 37s. Rate: 7.1 symbols/min [2025-10-16T19:46:41.210838] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:41.210997] [DEBUG] [LOCAL ] KF: No existing data file found in primary storage. [2025-10-16T19:46:41.211034] [WARN ] [MAIN ] KF: No existing data found, performing full refresh instead. [2025-10-16T19:46:41.211149] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-16T19:46:41.211189] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-16T19:46:41.211230] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-16T19:46:41.211262] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-16T19:46:41.549344] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-16T19:46:41.579755] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:41.619291] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-16T19:46:41.779203] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-16T19:46:42.342888] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-16T19:46:42.921992] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-16T19:46:43.142787] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-16T19:46:43.298999] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-16T19:46:43.616046] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:46:43.942781] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-16T19:46:44.452361] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-16T19:46:44.742872] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-16T19:46:45.542859] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-16T19:46:46.342805] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-16T19:46:46.548269] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-16T19:46:46.647034] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-16T19:46:46.911608] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-16T19:46:47.142810] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-16T19:46:47.611399] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-16T19:46:47.942808] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-16T19:46:48.385294] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T19:46:48.742845] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-16T19:46:49.542869] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-16T19:46:50.105122] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-16T19:46:50.224702] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-16T19:46:50.342798] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-16T19:46:51.142809] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-16T19:46:51.615049] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-16T19:46:51.634280] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:46:51.942808] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-16T19:46:52.387948] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-16T19:46:52.742807] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-16T19:46:53.542824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-16T19:46:54.342805] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-16T19:46:54.672191] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-16T19:46:54.815693] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-16T19:46:55.008188] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-16T19:46:55.142802] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-16T19:46:55.942860] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-16T19:46:56.563495] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-16T19:46:56.742870] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-16T19:46:57.362242] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-16T19:46:57.363175] [INFO ] [REMOTE ] KF: Full fetch complete (3555 records). [2025-10-16T19:46:57.363245] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-16T19:46:57.547285] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-16T19:46:57.654028] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:46:57.788868] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-16T19:46:57.788957] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-16T19:46:57.789088] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-16T19:46:57.789126] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-16T19:46:57.789515] [DEBUG] [LOCAL ] KF: Trimmed 3555 records to 2377 (keeping 200 days of data) [2025-10-16T19:46:57.803491] [DEBUG] [LOCAL ] KF: Primary data saved (2377 records). [2025-10-16T19:46:57.803606] [INFO ] [MAIN ] KF: Full history saved. [2025-10-16T19:46:57.803701] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KF took 16.8s. Estimated remaining: 2h 47m 36s. Rate: 7.1 symbols/min [2025-10-16T19:46:57.967200] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:46:57.986767] [DEBUG] [LOCAL ] KFRC: Loaded 20493 existing records from primary storage. [2025-10-16T19:46:57.986997] [INFO ] [MAIN ] KFRC: Loaded 20493 existing records. [2025-10-16T19:46:58.163530] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:46:58.163769] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-16T19:46:58.163820] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-16T19:46:58.164014] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-16T19:46:58.164070] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-16T19:46:58.347959] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-16T19:46:58.540228] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:46:59.142837] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-16T19:46:59.330365] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-16T19:46:59.942802] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-16T19:46:59.989267] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-16T19:47:00.376199] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:47:00.742797] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-16T19:47:01.019610] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-16T19:47:01.542869] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-16T19:47:02.284636] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-16T19:47:02.342770] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-16T19:47:02.509381] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-16T19:47:03.142830] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-16T19:47:03.642174] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-16T19:47:03.942882] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-16T19:47:03.978304] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:47:04.742837] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-16T19:47:05.324413] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-16T19:47:05.329913] [INFO ] [REMOTE ] KEX: Full fetch complete (56053 records). [2025-10-16T19:47:05.330002] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-16T19:47:05.547993] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-16T19:47:05.719977] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:47:05.720111] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-16T19:47:05.723848] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-16T19:47:05.724747] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-16T19:47:05.724809] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-16T19:47:05.725802] [DEBUG] [LOCAL ] KEX: Trimmed 56053 records to 38962 (keeping 200 days of data) [2025-10-16T19:47:05.954170] [DEBUG] [LOCAL ] KEX: Primary data saved (38962 records). [2025-10-16T19:47:05.954315] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-16T19:47:05.954401] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEX took 42.4s. Estimated remaining: 2h 47m 28s. Rate: 7.1 symbols/min [2025-10-16T19:47:06.122173] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:06.132543] [DEBUG] [LOCAL ] KFS: Loaded 8664 existing records from primary storage. [2025-10-16T19:47:06.132762] [INFO ] [MAIN ] KFS: Loaded 8664 existing records. [2025-10-16T19:47:06.304143] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:06.304320] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-16T19:47:06.304366] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-16T19:47:06.304529] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-16T19:47:06.304584] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-16T19:47:06.348126] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-16T19:47:06.659379] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:07.142864] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-16T19:47:07.252513] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-16T19:47:07.715112] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-16T19:47:07.942799] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-16T19:47:08.063840] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-16T19:47:08.071147] [INFO ] [REMOTE ] KEYS: Full fetch complete (63011 records). [2025-10-16T19:47:08.071335] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-16T19:47:08.494588] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-16T19:47:08.494711] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-16T19:47:08.495768] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-16T19:47:08.495830] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-16T19:47:08.497155] [DEBUG] [LOCAL ] KEYS: Trimmed 63011 records to 43613 (keeping 200 days of data) [2025-10-16T19:47:08.745368] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-16T19:47:08.757892] [DEBUG] [LOCAL ] KEYS: Primary data saved (43613 records). [2025-10-16T19:47:08.758164] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-16T19:47:08.758821] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEYS took 38.3s. Estimated remaining: 2h 47m 14s. Rate: 7.1 symbols/min [2025-10-16T19:47:08.927414] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:08.959768] [DEBUG] [LOCAL ] KFY: Loaded 29991 existing records from primary storage. [2025-10-16T19:47:08.960031] [INFO ] [MAIN ] KFY: Loaded 29991 existing records. [2025-10-16T19:47:09.140468] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:09.140784] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-16T19:47:09.140842] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-16T19:47:09.141107] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-16T19:47:09.141162] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-16T19:47:09.433977] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-16T19:47:09.513459] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:09.542769] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-16T19:47:09.771912] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-16T19:47:10.342839] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-16T19:47:10.768755] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:47:10.907347] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-16T19:47:11.142781] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-16T19:47:11.942815] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-16T19:47:12.585152] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-16T19:47:12.742797] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-16T19:47:13.067606] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T19:47:13.467130] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-16T19:47:13.542778] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-16T19:47:14.342807] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-16T19:47:14.624603] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-16T19:47:15.142811] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-16T19:47:15.913009] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-16T19:47:15.948999] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-16T19:47:15.968138] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:47:16.742780] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-16T19:47:16.815149] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-16T19:47:17.517834] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T19:47:17.542828] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-16T19:47:18.342829] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-16T19:47:19.070125] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-16T19:47:19.142779] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-16T19:47:19.462639] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:47:19.470097] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-16T19:47:19.470269] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-16T19:47:19.679397] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T19:47:19.680285] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:47:19.680362] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:47:19.680437] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-16T19:47:19.680506] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-16T19:47:19.680543] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-16T19:47:19.680583] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-16T19:47:19.680670] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 50.2s. Estimated remaining: 2h 47m 8s. Rate: 7.1 symbols/min [2025-10-16T19:47:19.853198] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:19.914002] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-16T19:47:19.914433] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-16T19:47:19.947992] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-16T19:47:20.101698] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-16T19:47:20.114476] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:20.119233] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-16T19:47:20.119290] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-16T19:47:20.119776] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-16T19:47:20.119832] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-16T19:47:20.473958] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:20.742805] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-16T19:47:21.166375] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:47:21.542843] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-16T19:47:22.271339] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-16T19:47:22.342875] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-16T19:47:22.522368] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-16T19:47:23.145426] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-16T19:47:23.146398] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:47:23.899395] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-16T19:47:23.942809] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-16T19:47:24.742829] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-16T19:47:24.953878] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-16T19:47:25.542864] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-16T19:47:26.342818] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-16T19:47:26.434753] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-16T19:47:26.600349] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-16T19:47:26.903967] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-16T19:47:26.905864] [INFO ] [REMOTE ] KFS: Full fetch complete (11031 records). [2025-10-16T19:47:26.905953] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-16T19:47:27.147881] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-16T19:47:27.275059] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-16T19:47:27.275159] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-16T19:47:27.275500] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-16T19:47:27.275562] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-16T19:47:27.276083] [DEBUG] [LOCAL ] KFS: Trimmed 11031 records to 8736 (keeping 200 days of data) [2025-10-16T19:47:27.329555] [DEBUG] [LOCAL ] KFS: Primary data saved (8736 records). [2025-10-16T19:47:27.329761] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-16T19:47:27.329860] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KFS took 21.4s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-16T19:47:27.497289] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:27.538819] [DEBUG] [LOCAL ] KGS: Loaded 46135 existing records from primary storage. [2025-10-16T19:47:27.539103] [INFO ] [MAIN ] KGS: Loaded 46135 existing records. [2025-10-16T19:47:27.714089] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:27.714276] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-16T19:47:27.714322] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-16T19:47:27.714696] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-16T19:47:27.714751] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-16T19:47:27.950934] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-16T19:47:28.095720] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:28.616819] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:47:28.742775] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-16T19:47:28.788106] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-16T19:47:29.542816] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-16T19:47:30.342813] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-16T19:47:30.644932] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-16T19:47:30.983512] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:47:31.142849] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-16T19:47:31.904860] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:47:31.942802] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-16T19:47:32.376406] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-16T19:47:32.742829] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-16T19:47:33.187954] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-16T19:47:33.191395] [INFO ] [REMOTE ] KFRC: Full fetch complete (26649 records). [2025-10-16T19:47:33.191467] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-16T19:47:33.548092] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-16T19:47:33.558418] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-16T19:47:33.558520] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-16T19:47:33.559920] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-16T19:47:33.560004] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-16T19:47:33.560868] [DEBUG] [LOCAL ] KFRC: Trimmed 26649 records to 20719 (keeping 200 days of data) [2025-10-16T19:47:33.691321] [DEBUG] [LOCAL ] KFRC: Primary data saved (20719 records). [2025-10-16T19:47:33.691454] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-16T19:47:33.691535] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFRC took 35.9s. Estimated remaining: 2h 46m 48s. Rate: 7.1 symbols/min [2025-10-16T19:47:33.859058] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:33.879102] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-16T19:47:33.932108] [DEBUG] [LOCAL ] KIM: Loaded 53004 existing records from primary storage. [2025-10-16T19:47:33.932507] [INFO ] [MAIN ] KIM: Loaded 53004 existing records. [2025-10-16T19:47:34.106057] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:34.106277] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-16T19:47:34.106324] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-16T19:47:34.106551] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-16T19:47:34.106607] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-16T19:47:34.352377] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-16T19:47:34.466890] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:35.142788] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-16T19:47:35.535345] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-16T19:47:35.651241] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T19:47:35.942825] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-16T19:47:36.721017] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-16T19:47:36.742761] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-16T19:47:36.845554] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-16T19:47:37.542810] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-16T19:47:38.091681] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:47:38.342800] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-16T19:47:38.886745] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-16T19:47:39.142830] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-16T19:47:39.491068] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-16T19:47:39.942829] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-16T19:47:40.492071] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:47:40.742900] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-16T19:47:41.424735] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-16T19:47:41.542823] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-16T19:47:41.875969] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-16T19:47:41.880118] [INFO ] [REMOTE ] KFY: Full fetch complete (43405 records). [2025-10-16T19:47:41.880220] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-16T19:47:42.251836] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-16T19:47:42.251915] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-16T19:47:42.252687] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-16T19:47:42.252748] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-16T19:47:42.253711] [DEBUG] [LOCAL ] KFY: Trimmed 43405 records to 30189 (keeping 200 days of data) [2025-10-16T19:47:42.343323] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-16T19:47:42.444958] [DEBUG] [LOCAL ] KFY: Primary data saved (30189 records). [2025-10-16T19:47:42.445100] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-16T19:47:42.445182] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFY took 33.7s. Estimated remaining: 2h 46m 39s. Rate: 7.1 symbols/min [2025-10-16T19:47:42.613544] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:47:42.635587] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-16T19:47:42.635920] [INFO ] [MAIN ] KIO: Loaded 21606 existing records. [2025-10-16T19:47:42.817626] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:47:42.817970] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-16T19:47:42.818238] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-16T19:47:42.818634] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-16T19:47:42.818756] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-16T19:47:43.030470] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-16T19:47:43.147950] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-16T19:47:43.214960] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:47:43.942796] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-16T19:47:44.186057] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T19:47:44.742853] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-16T19:47:44.822868] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-16T19:47:45.345668] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-16T19:47:45.542826] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-16T19:47:46.091570] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-16T19:47:46.342801] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-16T19:47:47.142812] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-16T19:47:47.261861] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-16T19:47:47.351109] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:47:47.942843] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-16T19:47:48.659776] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:47:48.742890] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-16T19:47:49.548013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-16T19:47:49.567500] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-16T19:47:50.284914] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-16T19:47:50.342871] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-16T19:47:50.593705] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:47:51.142851] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-16T19:47:51.942803] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-16T19:47:52.447396] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:47:52.545797] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-16T19:47:52.742859] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-16T19:47:53.106711] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-16T19:47:53.542842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-16T19:47:54.342794] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-16T19:47:54.518909] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:47:55.142801] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-16T19:47:55.251204] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:47:55.892678] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:47:55.942797] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-16T19:47:56.742893] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-16T19:47:57.080775] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-16T19:47:57.526240] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-16T19:47:57.542766] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-16T19:47:57.786065] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-16T19:47:58.342803] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-16T19:47:58.543264] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:47:59.142815] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-16T19:47:59.942825] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-16T19:48:00.534036] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-16T19:48:00.541329] [INFO ] [REMOTE ] KGC: Full fetch complete (77871 records). [2025-10-16T19:48:00.541499] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-16T19:48:00.747892] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-16T19:48:00.974138] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-16T19:48:00.974280] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-16T19:48:00.975386] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-16T19:48:00.975458] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-16T19:48:00.977001] [DEBUG] [LOCAL ] KGC: Trimmed 77871 records to 54090 (keeping 200 days of data) [2025-10-16T19:48:01.076926] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-16T19:48:01.246433] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:48:01.383412] [DEBUG] [LOCAL ] KGC: Primary data saved (54090 records). [2025-10-16T19:48:01.383557] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-16T19:48:01.384145] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KGC took 41.7s. Estimated remaining: 2h 46m 41s. Rate: 7.1 symbols/min [2025-10-16T19:48:01.551803] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-16T19:48:01.583831] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:01.640661] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-16T19:48:01.640981] [INFO ] [MAIN ] KKR: Loaded 53503 existing records. [2025-10-16T19:48:01.830974] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:01.831183] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-16T19:48:01.831229] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-16T19:48:01.831533] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-16T19:48:01.831589] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-16T19:48:02.198706] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:02.230957] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-16T19:48:02.342828] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-16T19:48:03.142785] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-16T19:48:03.452271] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-16T19:48:03.942798] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-16T19:48:04.310562] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-16T19:48:04.337201] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:48:04.742859] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-16T19:48:05.265193] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:48:05.542786] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-16T19:48:06.315677] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-16T19:48:06.342761] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-16T19:48:07.142848] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-16T19:48:07.524118] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-16T19:48:07.530816] [INFO ] [REMOTE ] KIM: Full fetch complete (76967 records). [2025-10-16T19:48:07.530938] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-16T19:48:07.935163] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-16T19:48:07.935301] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-16T19:48:07.936504] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-16T19:48:07.936752] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-16T19:48:07.938265] [DEBUG] [LOCAL ] KIM: Trimmed 76967 records to 53394 (keeping 200 days of data) [2025-10-16T19:48:07.990056] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-16T19:48:08.056867] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T19:48:08.064977] [INFO ] [REMOTE ] KGS: Full fetch complete (66515 records). [2025-10-16T19:48:08.065561] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-16T19:48:08.524477] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:48:08.642692] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-16T19:48:08.643039] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-16T19:48:08.644253] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-16T19:48:08.644629] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-16T19:48:08.659735] [DEBUG] [LOCAL ] KGS: Trimmed 66515 records to 46426 (keeping 200 days of data) [2025-10-16T19:48:08.761020] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-16T19:48:08.858006] [DEBUG] [LOCAL ] KIM: Primary data saved (53394 records). [2025-10-16T19:48:08.859472] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-16T19:48:08.861192] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KIM took 35.2s. Estimated remaining: 2h 46m 32s. Rate: 7.1 symbols/min [2025-10-16T19:48:09.109906] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:09.165747] [DEBUG] [LOCAL ] KKRS: Loaded 5638 existing records from primary storage. [2025-10-16T19:48:09.166945] [INFO ] [MAIN ] KKRS: Loaded 5638 existing records. [2025-10-16T19:48:09.400290] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:09.407965] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-16T19:48:09.413208] [DEBUG] [LOCAL ] KGS: Primary data saved (46426 records). [2025-10-16T19:48:09.413317] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-16T19:48:09.413543] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-16T19:48:09.413724] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-16T19:48:09.413968] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-16T19:48:09.426174] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 42.1s. Estimated remaining: 2h 46m 16s. Rate: 7.1 symbols/min [2025-10-16T19:48:09.734478] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:09.775837] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-16T19:48:09.836221] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-16T19:48:09.894251] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-16T19:48:09.905416] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-16T19:48:09.905836] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-16T19:48:09.905987] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-16T19:48:10.082591] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-16T19:48:10.116516] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-16T19:48:10.138400] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:10.147285] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-16T19:48:10.347929] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-16T19:48:10.411284] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:11.112991] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:48:11.116691] [INFO ] [REMOTE ] KIO: Full fetch complete (32024 records). [2025-10-16T19:48:11.116768] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-16T19:48:11.151268] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-16T19:48:11.409463] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:48:11.428026] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-16T19:48:11.437176] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:48:11.440681] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-16T19:48:11.440762] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:48:11.451676] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-16T19:48:11.462162] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-16T19:48:11.481561] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-16T19:48:11.501839] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-16T19:48:11.501947] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KKRT took 2.1s. Estimated remaining: 2h 46m 1s. Rate: 7.1 symbols/min [2025-10-16T19:48:11.562497] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-16T19:48:11.594471] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-16T19:48:11.600565] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-16T19:48:11.600667] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-16T19:48:11.643491] [DEBUG] [LOCAL ] KIO: Trimmed 32024 records to 21866 (keeping 200 days of data) [2025-10-16T19:48:11.761215] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:11.762181] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-16T19:48:11.762337] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-16T19:48:11.792487] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-16T19:48:11.798566] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-16T19:48:11.804700] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-16T19:48:11.809878] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-16T19:48:11.948242] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-16T19:48:11.967177] [DEBUG] [LOCAL ] KIO: Primary data saved (21866 records). [2025-10-16T19:48:11.980358] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-16T19:48:11.985858] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIO took 29.5s. Estimated remaining: 2h 45m 45s. Rate: 7.1 symbols/min [2025-10-16T19:48:12.344550] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:12.414031] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:12.420869] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-16T19:48:12.451303] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-16T19:48:12.485338] [DEBUG] [LOCAL ] KLC: Loaded 36505 existing records from primary storage. [2025-10-16T19:48:12.485624] [INFO ] [MAIN ] KLC: Loaded 36505 existing records. [2025-10-16T19:48:12.657438] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:12.657720] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-16T19:48:12.657776] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-16T19:48:12.658033] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-16T19:48:12.658089] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-16T19:48:12.748034] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-16T19:48:13.006151] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:13.036103] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:48:13.036393] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-16T19:48:13.036491] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:48:13.036548] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-16T19:48:13.036631] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:48:13.036726] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-16T19:48:13.036788] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-16T19:48:13.036822] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-16T19:48:13.036861] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-16T19:48:13.036906] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KLAR took 1.5s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-16T19:48:13.213335] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:13.265109] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-16T19:48:13.265489] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-16T19:48:13.438399] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:13.438619] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-16T19:48:13.438695] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-16T19:48:13.439051] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-16T19:48:13.439106] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-16T19:48:13.547989] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-16T19:48:13.788533] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:14.342841] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-16T19:48:15.142831] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-16T19:48:15.278405] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-16T19:48:15.942810] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-16T19:48:16.408936] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-16T19:48:16.440185] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-16T19:48:16.615121] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-16T19:48:16.742812] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-16T19:48:17.542809] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-16T19:48:17.948677] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-16T19:48:18.342827] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-16T19:48:19.142811] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-16T19:48:19.581667] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-16T19:48:19.742793] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-16T19:48:19.942809] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-16T19:48:20.197482] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:48:20.742820] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-16T19:48:21.267882] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T19:48:21.319274] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-16T19:48:21.542843] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-16T19:48:22.328717] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-16T19:48:22.342772] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-16T19:48:22.966619] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-16T19:48:23.142816] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-16T19:48:23.559453] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-16T19:48:23.942814] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-16T19:48:24.742854] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-16T19:48:25.542822] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-16T19:48:25.911775] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T19:48:25.926133] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:48:26.342786] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-16T19:48:26.740392] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-16T19:48:26.839327] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-16T19:48:27.142821] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-16T19:48:27.542435] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-16T19:48:27.942857] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-16T19:48:28.742875] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-16T19:48:29.542798] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-16T19:48:29.965105] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-16T19:48:30.131436] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-16T19:48:30.132414] [INFO ] [REMOTE ] KKRS: Full fetch complete (7647 records). [2025-10-16T19:48:30.132483] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-16T19:48:30.345279] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-16T19:48:30.500907] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-16T19:48:30.501096] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-16T19:48:30.501379] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-16T19:48:30.501514] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-16T19:48:30.502336] [DEBUG] [LOCAL ] KKRS: Trimmed 7647 records to 5648 (keeping 200 days of data) [2025-10-16T19:48:30.536319] [DEBUG] [LOCAL ] KKRS: Primary data saved (5648 records). [2025-10-16T19:48:30.536450] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-16T19:48:30.536530] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRS took 21.7s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-16T19:48:30.719754] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:30.739810] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-16T19:48:30.754365] [DEBUG] [LOCAL ] KMPB: Loaded 3652 existing records from primary storage. [2025-10-16T19:48:30.754580] [INFO ] [MAIN ] KMPB: Loaded 3652 existing records. [2025-10-16T19:48:30.930212] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:30.930451] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-16T19:48:30.930500] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-16T19:48:30.930668] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-16T19:48:30.930749] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-16T19:48:31.148032] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-16T19:48:31.299802] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:31.942862] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-16T19:48:32.330591] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-16T19:48:32.742859] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-16T19:48:32.979360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-16T19:48:33.075600] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-16T19:48:33.542868] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-16T19:48:34.342780] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-16T19:48:34.414395] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:48:35.142808] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-16T19:48:35.348593] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-16T19:48:35.942810] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-16T19:48:35.966745] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-16T19:48:36.742823] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-16T19:48:37.004521] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T19:48:37.542858] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-16T19:48:37.718459] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-16T19:48:38.162752] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:48:38.342788] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-16T19:48:39.142815] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-16T19:48:39.241965] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:48:39.942778] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-16T19:48:40.149019] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-16T19:48:40.155856] [INFO ] [REMOTE ] KKR: Full fetch complete (77631 records). [2025-10-16T19:48:40.155996] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-16T19:48:40.567943] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-16T19:48:40.568234] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-16T19:48:40.574837] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-16T19:48:40.576331] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-16T19:48:40.576523] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-16T19:48:40.578302] [DEBUG] [LOCAL ] KKR: Trimmed 77631 records to 53893 (keeping 200 days of data) [2025-10-16T19:48:40.760793] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-16T19:48:40.914317] [DEBUG] [LOCAL ] KKR: Primary data saved (53893 records). [2025-10-16T19:48:40.914500] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-16T19:48:40.915131] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKR took 39.5s. Estimated remaining: 2h 45m 23s. Rate: 7.1 symbols/min [2025-10-16T19:48:41.078350] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:48:41.116171] [DEBUG] [LOCAL ] KMPR: Loaded 39987 existing records from primary storage. [2025-10-16T19:48:41.116456] [INFO ] [MAIN ] KMPR: Loaded 39987 existing records. [2025-10-16T19:48:41.288866] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:48:41.289058] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-16T19:48:41.289104] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-16T19:48:41.289336] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-16T19:48:41.289391] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-16T19:48:41.554399] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-16T19:48:41.672747] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:48:41.704991] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:48:42.081276] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-16T19:48:42.203151] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:48:42.342794] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-16T19:48:43.142810] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-16T19:48:43.478439] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-16T19:48:43.942813] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-16T19:48:44.742786] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-16T19:48:44.829680] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-16T19:48:44.886147] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-16T19:48:45.157664] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-16T19:48:45.542814] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-16T19:48:46.342785] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-16T19:48:46.421818] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-16T19:48:47.142791] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-16T19:48:47.215959] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-16T19:48:47.575688] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-16T19:48:47.942807] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-16T19:48:48.739108] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-16T19:48:48.748874] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-16T19:48:48.751125] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-16T19:48:48.752773] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-16T19:48:49.285999] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-16T19:48:49.286118] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-16T19:48:49.287349] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-16T19:48:49.287416] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-16T19:48:49.289056] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54083 (keeping 200 days of data) [2025-10-16T19:48:49.543295] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-16T19:48:49.645760] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-16T19:48:49.645922] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-16T19:48:49.646808] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KMI took 36.6s. Estimated remaining: 2h 45m 14s. Rate: 7.1 symbols/min [2025-10-16T19:48:50.095771] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:48:50.149671] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-16T19:48:50.342823] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-16T19:48:51.142814] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-16T19:48:51.766935] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-16T19:48:51.942833] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-16T19:48:52.388824] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T19:48:52.453940] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-16T19:48:52.459594] [INFO ] [REMOTE ] KLC: Full fetch complete (50532 records). [2025-10-16T19:48:52.459761] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-16T19:48:52.748034] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-16T19:48:52.850316] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-16T19:48:52.850418] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-16T19:48:52.851393] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-16T19:48:52.851458] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-16T19:48:52.852783] [DEBUG] [LOCAL ] KLC: Trimmed 50532 records to 36757 (keeping 200 days of data) [2025-10-16T19:48:53.060962] [DEBUG] [LOCAL ] KLC: Primary data saved (36757 records). [2025-10-16T19:48:53.061116] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-16T19:48:53.061196] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLC took 41.1s. Estimated remaining: 2h 45m 1s. Rate: 7.1 symbols/min [2025-10-16T19:48:53.382557] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-16T19:48:53.542828] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-16T19:48:53.860715] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-16T19:48:54.342814] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-16T19:48:55.142860] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-16T19:48:55.323162] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-16T19:48:55.713124] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-16T19:48:55.942807] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-16T19:48:56.471865] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-16T19:48:56.742846] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-16T19:48:57.269002] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-16T19:48:57.270048] [INFO ] [REMOTE ] KMPB: Full fetch complete (5008 records). [2025-10-16T19:48:57.270121] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-16T19:48:57.548055] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-16T19:48:57.649905] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-16T19:48:57.649980] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-16T19:48:57.650155] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-16T19:48:57.650194] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-16T19:48:57.650544] [DEBUG] [LOCAL ] KMPB: Trimmed 5008 records to 3667 (keeping 200 days of data) [2025-10-16T19:48:57.672587] [DEBUG] [LOCAL ] KMPB: Primary data saved (3667 records). [2025-10-16T19:48:57.672676] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-16T19:48:57.672761] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KMPB took 27.1s. Estimated remaining: 2h 44m 49s. Rate: 7.1 symbols/min [2025-10-16T19:48:59.055905] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:48:59.063755] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-16T19:49:00.403031] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-16T19:49:00.410166] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-16T19:49:02.010790] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:49:02.018868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-16T19:49:03.581762] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-16T19:49:03.590752] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-16T19:49:05.321198] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:49:05.331018] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-16T19:49:06.988760] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-16T19:49:06.998544] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-16T19:49:08.796069] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-16T19:49:08.802226] [INFO ] [REMOTE ] KMPR: Full fetch complete (53054 records). [2025-10-16T19:49:08.802384] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-16T19:49:09.178341] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-16T19:49:09.178430] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-16T19:49:09.179296] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-16T19:49:09.179357] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-16T19:49:09.180414] [DEBUG] [LOCAL ] KMPR: Trimmed 53054 records to 40369 (keeping 200 days of data) [2025-10-16T19:49:09.427166] [DEBUG] [LOCAL ] KMPR: Primary data saved (40369 records). [2025-10-16T19:49:09.427305] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-16T19:49:09.427836] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KMPR took 28.5s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-10-16T19:49:10.059931] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.135875] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.130806] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.157118] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:10.243406] [DEBUG] [LOCAL ] KNF: Loaded 36599 existing records from primary storage. [2025-10-16T19:49:10.271231] [INFO ] [MAIN ] KNF: Loaded 36599 existing records. [2025-10-16T19:49:10.272227] [DEBUG] [LOCAL ] KMT: Loaded 42946 existing records from primary storage. [2025-10-16T19:49:10.273569] [DEBUG] [LOCAL ] KN: Loaded 38621 existing records from primary storage. [2025-10-16T19:49:10.292629] [INFO ] [MAIN ] KMT: Loaded 42946 existing records. [2025-10-16T19:49:10.287160] [INFO ] [MAIN ] KN: Loaded 38621 existing records. [2025-10-16T19:49:10.274376] [DEBUG] [LOCAL ] KMX: Loaded 53277 existing records from primary storage. [2025-10-16T19:49:10.344192] [INFO ] [MAIN ] KMX: Loaded 53277 existing records. [2025-10-16T19:49:10.940249] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:10.961009] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.009191] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.005631] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.009378] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-16T19:49:11.000342] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.041934] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.042044] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-16T19:49:11.042183] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-16T19:49:11.041896] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-16T19:49:11.047695] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-16T19:49:11.047602] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:11.047940] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-16T19:49:11.058706] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-16T19:49:11.077227] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-16T19:49:11.077308] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-16T19:49:11.082483] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-16T19:49:11.120242] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-16T19:49:11.167774] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-16T19:49:11.206519] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-16T19:49:12.403945] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.511320] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.507552] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.516506] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-16T19:49:12.515886] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-16T19:49:12.518148] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-16T19:49:12.610572] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:12.611004] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-16T19:49:13.944427] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-16T19:49:13.952154] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-16T19:49:13.998712] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:49:14.006566] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-16T19:49:14.033561] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:49:14.041954] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-16T19:49:14.111721] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-16T19:49:14.123525] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-16T19:49:15.082467] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:49:15.089459] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-16T19:49:15.115384] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:49:15.123797] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-16T19:49:15.147532] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-16T19:49:15.156206] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-16T19:49:15.713110] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-16T19:49:15.725859] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-16T19:49:16.122417] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-16T19:49:16.128940] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-16T19:49:16.583106] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:49:16.591913] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-16T19:49:16.677888] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:49:16.686678] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-16T19:49:16.920872] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-16T19:49:16.930576] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-16T19:49:17.492391] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-16T19:49:17.500182] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-16T19:49:17.920752] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-16T19:49:17.930406] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-16T19:49:18.039051] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-16T19:49:18.052436] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-16T19:49:18.309849] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-16T19:49:18.342779] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-16T19:49:19.001002] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-16T19:49:19.142808] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-16T19:49:19.331782] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-16T19:49:19.785921] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:49:19.927120] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T19:49:19.942779] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-16T19:49:20.017980] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-16T19:49:20.742803] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-16T19:49:21.104905] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-16T19:49:21.542827] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-16T19:49:22.342788] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-16T19:49:22.629609] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:49:22.711424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:49:23.142872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-16T19:49:23.694109] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-16T19:49:23.942838] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-16T19:49:24.232395] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-16T19:49:24.742839] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-16T19:49:25.481724] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-16T19:49:25.542783] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-16T19:49:25.732974] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-16T19:49:26.342903] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-16T19:49:26.824127] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-16T19:49:27.142778] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-16T19:49:27.241956] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T19:49:27.942819] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-16T19:49:28.742782] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-16T19:49:28.856445] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-16T19:49:29.371091] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:49:29.542832] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-16T19:49:30.142179] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-16T19:49:30.342845] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-16T19:49:30.800010] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:49:31.142825] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-16T19:49:31.813203] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:49:31.942801] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-16T19:49:32.250971] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-16T19:49:32.742820] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-16T19:49:33.438509] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-16T19:49:33.443863] [INFO ] [REMOTE ] KNF: Full fetch complete (51300 records). [2025-10-16T19:49:33.443982] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-16T19:49:33.547136] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-16T19:49:33.835776] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-16T19:49:33.835901] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-16T19:49:33.836784] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-16T19:49:33.836848] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-16T19:49:33.838054] [DEBUG] [LOCAL ] KNF: Trimmed 51300 records to 36840 (keeping 200 days of data) [2025-10-16T19:49:34.053630] [DEBUG] [LOCAL ] KNF: Primary data saved (36840 records). [2025-10-16T19:49:34.053802] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-16T19:49:34.053884] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KNF took 24.6s. Estimated remaining: 2h 44m 51s. Rate: 7.1 symbols/min [2025-10-16T19:49:34.222967] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:34.234082] [DEBUG] [LOCAL ] KNOP: Loaded 10486 existing records from primary storage. [2025-10-16T19:49:34.234325] [INFO ] [MAIN ] KNOP: Loaded 10486 existing records. [2025-10-16T19:49:34.351533] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-16T19:49:34.439218] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:34.439550] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-16T19:49:34.439622] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-16T19:49:34.440017] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-16T19:49:34.440085] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-16T19:49:34.814509] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:34.846589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-16T19:49:35.093607] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-16T19:49:35.142779] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-16T19:49:35.555967] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-16T19:49:35.561110] [INFO ] [REMOTE ] KN: Full fetch complete (56562 records). [2025-10-16T19:49:35.561229] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-16T19:49:35.946231] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-16T19:49:35.963782] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-16T19:49:35.970728] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-16T19:49:35.970788] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-16T19:49:35.971688] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-16T19:49:35.971760] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-16T19:49:35.972831] [DEBUG] [LOCAL ] KN: Trimmed 56562 records to 38866 (keeping 200 days of data) [2025-10-16T19:49:36.190364] [DEBUG] [LOCAL ] KN: Primary data saved (38866 records). [2025-10-16T19:49:36.190480] [INFO ] [MAIN ] KN: Full history saved. [2025-10-16T19:49:36.191013] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KN took 26.8s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-16T19:49:36.360023] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:36.379835] [DEBUG] [LOCAL ] KNSL: Loaded 18426 existing records from primary storage. [2025-10-16T19:49:36.380069] [INFO ] [MAIN ] KNSL: Loaded 18426 existing records. [2025-10-16T19:49:36.552633] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:36.553036] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-16T19:49:36.553084] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-16T19:49:36.553247] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-16T19:49:36.553285] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-16T19:49:36.748063] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-16T19:49:36.900447] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:37.542842] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-16T19:49:37.971665] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-16T19:49:38.201817] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-16T19:49:38.207252] [INFO ] [REMOTE ] KMT: Full fetch complete (61924 records). [2025-10-16T19:49:38.207392] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-16T19:49:38.318635] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:49:38.347507] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-16T19:49:38.618102] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-16T19:49:38.618177] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-16T19:49:38.619224] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-16T19:49:38.619300] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-16T19:49:38.620921] [DEBUG] [LOCAL ] KMT: Trimmed 61924 records to 43226 (keeping 200 days of data) [2025-10-16T19:49:38.882321] [DEBUG] [LOCAL ] KMT: Primary data saved (43226 records). [2025-10-16T19:49:38.882445] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-16T19:49:38.882529] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 29.5s. Estimated remaining: 2h 44m 22s. Rate: 7.1 symbols/min [2025-10-16T19:49:39.056701] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:39.101339] [DEBUG] [LOCAL ] KNTK: Loaded 47085 existing records from primary storage. [2025-10-16T19:49:39.101758] [INFO ] [MAIN ] KNTK: Loaded 47085 existing records. [2025-10-16T19:49:39.148054] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-16T19:49:39.287928] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:39.288128] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-16T19:49:39.288177] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-16T19:49:39.288978] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-16T19:49:39.289036] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-16T19:49:39.580944] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-16T19:49:39.663608] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:39.893320] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-16T19:49:39.942782] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-16T19:49:40.742887] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-16T19:49:41.464731] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:49:41.531923] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-16T19:49:41.542793] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-16T19:49:42.342839] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-16T19:49:42.447434] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-16T19:49:43.142871] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-16T19:49:43.902589] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-16T19:49:43.942771] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-16T19:49:44.186499] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-16T19:49:44.678858] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-16T19:49:44.742787] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-16T19:49:45.526185] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-16T19:49:45.533028] [INFO ] [REMOTE ] KMX: Full fetch complete (76343 records). [2025-10-16T19:49:45.533153] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-16T19:49:45.547875] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-16T19:49:45.926876] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-16T19:49:45.927011] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-16T19:49:45.928055] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-16T19:49:45.928118] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-16T19:49:45.929560] [DEBUG] [LOCAL ] KMX: Trimmed 76343 records to 53667 (keeping 200 days of data) [2025-10-16T19:49:46.235160] [DEBUG] [LOCAL ] KMX: Primary data saved (53667 records). [2025-10-16T19:49:46.235298] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-16T19:49:46.235998] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMX took 36.8s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-16T19:49:46.348017] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-16T19:49:46.405133] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:46.454508] [DEBUG] [LOCAL ] KNX: Loaded 52615 existing records from primary storage. [2025-10-16T19:49:46.454848] [INFO ] [MAIN ] KNX: Loaded 52615 existing records. [2025-10-16T19:49:46.626916] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:49:46.627142] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-16T19:49:46.627189] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-16T19:49:46.627368] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-16T19:49:46.627405] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-16T19:49:46.980896] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:49:47.076038] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-16T19:49:47.142836] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-16T19:49:47.507428] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-16T19:49:47.942837] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-16T19:49:48.601883] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-16T19:49:48.742794] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-16T19:49:48.781263] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:49:49.542884] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-16T19:49:50.220602] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-16T19:49:50.342802] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-16T19:49:50.683042] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-16T19:49:51.142842] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-16T19:49:51.942815] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-16T19:49:52.032800] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-16T19:49:52.199605] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-16T19:49:52.736606] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-16T19:49:52.742759] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-16T19:49:53.458998] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-16T19:49:53.542866] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-16T19:49:54.342846] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-16T19:49:54.359494] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-16T19:49:55.142812] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-16T19:49:55.331631] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-16T19:49:55.942837] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-16T19:49:56.710090] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-16T19:49:56.742784] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-16T19:49:57.186481] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-16T19:49:57.542850] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-16T19:49:58.349432] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-16T19:49:58.355185] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:49:58.419771] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:49:59.142778] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-16T19:49:59.368157] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:49:59.370284] [INFO ] [REMOTE ] KNOP: Full fetch complete (14704 records). [2025-10-16T19:49:59.370357] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-16T19:49:59.728970] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-16T19:49:59.729059] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-16T19:49:59.729426] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-16T19:49:59.729468] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-16T19:49:59.730158] [DEBUG] [LOCAL ] KNOP: Trimmed 14704 records to 10555 (keeping 200 days of data) [2025-10-16T19:49:59.789994] [DEBUG] [LOCAL ] KNOP: Primary data saved (10555 records). [2025-10-16T19:49:59.790120] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-16T19:49:59.790196] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KNOP took 25.7s. Estimated remaining: 2h 44m 9s. Rate: 7.1 symbols/min [2025-10-16T19:49:59.945363] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-16T19:49:59.965718] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:49:59.965972] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-16T19:49:59.966048] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-16T19:49:59.966166] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-16T19:49:59.966209] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-16T19:49:59.966251] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-16T19:49:59.966284] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-16T19:50:00.321835] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:00.742831] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-16T19:50:00.788825] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-16T19:50:01.542832] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-16T19:50:01.961841] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:50:02.342863] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-16T19:50:02.974017] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-16T19:50:03.142806] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-16T19:50:03.283430] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-16T19:50:03.920186] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:50:03.942776] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-16T19:50:04.000873] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-16T19:50:04.742879] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-16T19:50:05.390322] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-16T19:50:05.542841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-16T19:50:06.342863] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-16T19:50:06.377462] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:50:07.095144] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-16T19:50:07.142842] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-16T19:50:07.942849] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-16T19:50:08.107245] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-16T19:50:08.163847] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:50:08.167248] [INFO ] [REMOTE ] KNSL: Full fetch complete (27134 records). [2025-10-16T19:50:08.167336] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-16T19:50:08.578013] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-16T19:50:08.578091] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-16T19:50:08.578747] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-16T19:50:08.578848] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-16T19:50:08.579512] [DEBUG] [LOCAL ] KNSL: Trimmed 27134 records to 18656 (keeping 200 days of data) [2025-10-16T19:50:08.691422] [DEBUG] [LOCAL ] KNSL: Primary data saved (18656 records). [2025-10-16T19:50:08.691556] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-16T19:50:08.691632] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNSL took 32.5s. Estimated remaining: 2h 44m 1s. Rate: 7.1 symbols/min [2025-10-16T19:50:08.755599] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-16T19:50:08.863086] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:08.901326] [DEBUG] [LOCAL ] KODK: Loaded 43766 existing records from primary storage. [2025-10-16T19:50:08.901611] [INFO ] [MAIN ] KODK: Loaded 43766 existing records. [2025-10-16T19:50:09.079598] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:09.079852] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-16T19:50:09.079900] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-16T19:50:09.080100] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-16T19:50:09.080154] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-16T19:50:09.436148] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:09.511772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-16T19:50:09.542836] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-16T19:50:10.342857] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-16T19:50:11.037107] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:50:11.142790] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-16T19:50:11.247631] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-16T19:50:11.942812] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-16T19:50:12.300299] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T19:50:12.308086] [INFO ] [REMOTE ] KNTK: Full fetch complete (65586 records). [2025-10-16T19:50:12.308236] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-16T19:50:12.705409] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-16T19:50:12.705502] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-16T19:50:12.706706] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-16T19:50:12.706964] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-16T19:50:12.708496] [DEBUG] [LOCAL ] KNTK: Trimmed 65586 records to 47433 (keeping 200 days of data) [2025-10-16T19:50:12.762763] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-16T19:50:13.036755] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-16T19:50:13.038918] [DEBUG] [LOCAL ] KNTK: Primary data saved (47433 records). [2025-10-16T19:50:13.050338] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-16T19:50:13.050457] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNTK took 34.2s. Estimated remaining: 2h 43m 49s. Rate: 7.1 symbols/min [2025-10-16T19:50:13.222199] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:13.249102] [DEBUG] [LOCAL ] KOF: Loaded 26616 existing records from primary storage. [2025-10-16T19:50:13.249404] [INFO ] [MAIN ] KOF: Loaded 26616 existing records. [2025-10-16T19:50:13.430082] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:13.430475] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-16T19:50:13.430608] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-16T19:50:13.430900] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-16T19:50:13.430964] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-16T19:50:13.545124] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-16T19:50:13.748716] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:50:13.847141] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:14.342873] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-16T19:50:15.142820] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-16T19:50:15.438664] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-16T19:50:15.538914] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-16T19:50:15.883251] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-16T19:50:15.942764] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-16T19:50:15.972397] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:50:16.742926] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-16T19:50:16.885585] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-16T19:50:17.542835] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-16T19:50:18.342788] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-16T19:50:18.371731] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-16T19:50:18.869599] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-16T19:50:19.142867] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-16T19:50:19.942853] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-16T19:50:20.002620] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-16T19:50:20.730819] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:50:20.742768] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-16T19:50:20.785221] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:50:21.542794] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-16T19:50:22.342794] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-16T19:50:22.532024] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-16T19:50:22.812044] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-16T19:50:23.142809] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-16T19:50:23.942824] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-16T19:50:24.398347] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-16T19:50:24.742843] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-16T19:50:24.978169] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-16T19:50:25.347830] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-16T19:50:25.542848] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-16T19:50:26.044272] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-16T19:50:26.342838] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-16T19:50:27.142786] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-16T19:50:27.280984] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:50:27.942794] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-16T19:50:28.042514] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-16T19:50:28.742824] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-16T19:50:29.411202] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-16T19:50:29.542785] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-16T19:50:29.643851] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-16T19:50:30.004610] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-16T19:50:30.011622] [INFO ] [REMOTE ] KNX: Full fetch complete (76226 records). [2025-10-16T19:50:30.011788] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-16T19:50:30.352486] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-16T19:50:30.436846] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-16T19:50:30.436957] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-16T19:50:30.438104] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-16T19:50:30.438218] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-16T19:50:30.454877] [DEBUG] [LOCAL ] KNX: Trimmed 76226 records to 53005 (keeping 200 days of data) [2025-10-16T19:50:30.480777] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-16T19:50:30.814569] [DEBUG] [LOCAL ] KNX: Primary data saved (53005 records). [2025-10-16T19:50:30.814754] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-16T19:50:30.815328] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNX took 44.6s. Estimated remaining: 2h 43m 49s. Rate: 7.1 symbols/min [2025-10-16T19:50:30.982140] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:31.001065] [DEBUG] [LOCAL ] KOP: Loaded 17433 existing records from primary storage. [2025-10-16T19:50:31.001330] [INFO ] [MAIN ] KOP: Loaded 17433 existing records. [2025-10-16T19:50:31.149990] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-16T19:50:31.182685] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:31.182885] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-16T19:50:31.182932] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-16T19:50:31.183110] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-16T19:50:31.183179] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-16T19:50:31.536370] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:31.645738] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-16T19:50:31.942820] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-16T19:50:32.742811] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-16T19:50:33.137191] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:50:33.542799] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-16T19:50:33.719144] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-16T19:50:33.974242] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-16T19:50:34.342829] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-16T19:50:34.450619] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-16T19:50:35.142890] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-16T19:50:35.942832] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-16T19:50:36.133576] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-16T19:50:36.139500] [INFO ] [REMOTE ] KODK: Full fetch complete (63481 records). [2025-10-16T19:50:36.139612] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-16T19:50:36.552498] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-16T19:50:36.552382] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:50:36.552732] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-16T19:50:36.559544] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-16T19:50:36.559715] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-16T19:50:36.561510] [DEBUG] [LOCAL ] KODK: Trimmed 63481 records to 44120 (keeping 200 days of data) [2025-10-16T19:50:36.665400] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-16T19:50:36.765087] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-16T19:50:36.821032] [DEBUG] [LOCAL ] KODK: Primary data saved (44120 records). [2025-10-16T19:50:36.821166] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-16T19:50:36.821241] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KODK took 28.1s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-10-16T19:50:36.987613] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:36.992121] [DEBUG] [LOCAL ] KORE: Loaded 2164 existing records from primary storage. [2025-10-16T19:50:36.992269] [INFO ] [MAIN ] KORE: Loaded 2164 existing records. [2025-10-16T19:50:37.172492] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:37.173758] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-16T19:50:37.173819] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-16T19:50:37.174464] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-16T19:50:37.174520] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-16T19:50:37.529138] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:37.542768] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-16T19:50:37.684850] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:50:38.342828] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-16T19:50:38.605578] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:50:39.142852] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-16T19:50:39.942899] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-16T19:50:39.959590] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:50:40.742825] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-16T19:50:41.118080] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-16T19:50:41.146069] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-16T19:50:41.224434] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-16T19:50:41.542829] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-16T19:50:41.901700] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-16T19:50:42.342816] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-16T19:50:42.792386] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-16T19:50:43.142818] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-16T19:50:43.942824] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-16T19:50:44.255221] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-16T19:50:44.378888] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-16T19:50:44.742812] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-16T19:50:45.542805] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-16T19:50:45.811285] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-16T19:50:46.342828] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-16T19:50:46.657245] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-16T19:50:46.661712] [INFO ] [REMOTE ] KOF: Full fetch complete (38042 records). [2025-10-16T19:50:46.661820] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-16T19:50:47.072672] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-16T19:50:47.072758] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-16T19:50:47.073467] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-16T19:50:47.073507] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-16T19:50:47.074394] [DEBUG] [LOCAL ] KOF: Trimmed 38042 records to 26812 (keeping 200 days of data) [2025-10-16T19:50:47.162174] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-16T19:50:47.239808] [DEBUG] [LOCAL ] KOF: Primary data saved (26812 records). [2025-10-16T19:50:47.239945] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-16T19:50:47.240026] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KOF took 34.2s. Estimated remaining: 2h 43m 32s. Rate: 7.1 symbols/min [2025-10-16T19:50:47.405913] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:47.455837] [DEBUG] [LOCAL ] KOS: Loaded 53097 existing records from primary storage. [2025-10-16T19:50:47.456181] [INFO ] [MAIN ] KOS: Loaded 53097 existing records. [2025-10-16T19:50:47.633333] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:47.633549] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-16T19:50:47.633601] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-16T19:50:47.633948] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-16T19:50:47.634006] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-16T19:50:47.947903] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-16T19:50:47.984556] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:48.160198] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-16T19:50:48.346927] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-16T19:50:48.742783] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-16T19:50:48.815492] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-16T19:50:49.233409] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:50:49.542817] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-16T19:50:50.342927] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-16T19:50:50.452589] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:50:50.697044] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T19:50:51.142813] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-16T19:50:51.647606] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-16T19:50:51.942821] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-16T19:50:52.699704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:50:52.701009] [INFO ] [REMOTE ] KORE: Full fetch complete (5114 records). [2025-10-16T19:50:52.701103] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-16T19:50:52.747994] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-16T19:50:53.088356] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-16T19:50:53.088478] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-16T19:50:53.088661] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-16T19:50:53.088722] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-16T19:50:53.089113] [DEBUG] [LOCAL ] KORE: Trimmed 5114 records to 2182 (keeping 200 days of data) [2025-10-16T19:50:53.102042] [DEBUG] [LOCAL ] KORE: Primary data saved (2182 records). [2025-10-16T19:50:53.102190] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-16T19:50:53.102275] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KORE took 16.3s. Estimated remaining: 2h 43m 21s. Rate: 7.1 symbols/min [2025-10-16T19:50:53.274733] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:53.322706] [DEBUG] [LOCAL ] KR: Loaded 53680 existing records from primary storage. [2025-10-16T19:50:53.323023] [INFO ] [MAIN ] KR: Loaded 53680 existing records. [2025-10-16T19:50:53.501938] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:50:53.502210] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-16T19:50:53.502266] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-16T19:50:53.502455] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-16T19:50:53.502492] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-16T19:50:53.544971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-16T19:50:53.841399] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-16T19:50:53.905907] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:54.342829] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-16T19:50:55.142843] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-16T19:50:55.322001] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-16T19:50:55.942803] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-16T19:50:56.031447] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-16T19:50:56.742786] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-16T19:50:56.994788] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-16T19:50:57.542780] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-16T19:50:57.597445] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-16T19:50:57.604499] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-16T19:50:57.604689] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-16T19:50:57.825250] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-16T19:50:57.826186] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:50:57.826405] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:50:57.826570] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-16T19:50:57.826735] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-16T19:50:57.826932] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-16T19:50:57.827066] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-16T19:50:57.827183] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KO took 58.0s. Estimated remaining: 2h 43m 9s. Rate: 7.1 symbols/min [2025-10-16T19:50:58.016508] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-16T19:50:58.037664] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:50:58.048913] [DEBUG] [LOCAL ] KRC: No existing data file found in primary storage. [2025-10-16T19:50:58.048991] [WARN ] [MAIN ] KRC: No existing data found, performing full refresh instead. [2025-10-16T19:50:58.049117] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-16T19:50:58.049160] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-16T19:50:58.049202] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-10-16T19:50:58.049236] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-16T19:50:58.347934] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-16T19:50:58.405759] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:50:59.142796] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-16T19:50:59.393126] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-16T19:50:59.942842] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-16T19:51:00.161044] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-16T19:51:00.742800] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-16T19:51:00.854793] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-16T19:51:01.012998] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-16T19:51:01.542844] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-16T19:51:02.342839] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-16T19:51:02.546843] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-16T19:51:03.119800] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-16T19:51:03.142779] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-16T19:51:03.942801] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-16T19:51:03.999046] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:51:04.742791] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-16T19:51:04.826526] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-16T19:51:04.929132] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:51:04.931903] [INFO ] [REMOTE ] KOP: Full fetch complete (25399 records). [2025-10-16T19:51:04.931993] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-16T19:51:05.304549] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-16T19:51:05.304678] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-16T19:51:05.305307] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-16T19:51:05.305370] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-16T19:51:05.306158] [DEBUG] [LOCAL ] KOP: Trimmed 25399 records to 17544 (keeping 200 days of data) [2025-10-16T19:51:05.429835] [DEBUG] [LOCAL ] KOP: Primary data saved (17544 records). [2025-10-16T19:51:05.430052] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-16T19:51:05.430187] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KOP took 34.6s. Estimated remaining: 2h 42m 60s. Rate: 7.1 symbols/min [2025-10-16T19:51:05.547885] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-16T19:51:05.610842] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:05.647460] [DEBUG] [LOCAL ] KREF: Loaded 37941 existing records from primary storage. [2025-10-16T19:51:05.647858] [INFO ] [MAIN ] KREF: Loaded 37941 existing records. [2025-10-16T19:51:05.822784] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:05.823010] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-16T19:51:05.823064] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-16T19:51:05.823248] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-16T19:51:05.823302] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-16T19:51:06.173844] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:06.342791] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-16T19:51:06.608071] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-16T19:51:07.142809] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-16T19:51:07.454821] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-16T19:51:07.729624] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-16T19:51:07.942815] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-16T19:51:08.516626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-16T19:51:08.742804] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-16T19:51:09.542820] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-16T19:51:09.726219] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:51:10.342820] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-16T19:51:10.694815] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-16T19:51:11.142778] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-16T19:51:11.200827] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-16T19:51:11.624204] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:51:11.942811] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-16T19:51:12.742860] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-16T19:51:12.892792] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-16T19:51:13.162034] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-16T19:51:13.542863] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-16T19:51:14.342805] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-16T19:51:14.473496] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-16T19:51:15.083363] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-16T19:51:15.142811] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-16T19:51:15.903402] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-16T19:51:15.942813] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-16T19:51:16.742793] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-16T19:51:16.821354] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-16T19:51:17.383935] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:51:17.542814] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-16T19:51:18.342798] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-16T19:51:18.635570] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-16T19:51:19.142896] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-16T19:51:19.188987] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:51:19.942826] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-16T19:51:20.205359] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-16T19:51:20.742802] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-16T19:51:21.081033] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-16T19:51:21.507747] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:51:21.542786] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-16T19:51:22.296039] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-16T19:51:22.342791] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-16T19:51:23.133400] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-16T19:51:23.142906] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-16T19:51:23.942808] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-16T19:51:24.465062] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-16T19:51:24.742843] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-16T19:51:24.922776] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:51:25.542874] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-16T19:51:25.572702] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-16T19:51:25.588784] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-16T19:51:25.594873] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-16T19:51:25.596010] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-16T19:51:25.677494] [INFO ] [REMOTE ] KRC: Full fetch complete (70061 records). [2025-10-16T19:51:25.701130] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-16T19:51:26.364227] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-16T19:51:26.367530] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-16T19:51:26.390405] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-16T19:51:26.411410] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-16T19:51:26.415090] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-16T19:51:26.415200] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-16T19:51:26.415445] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-16T19:51:26.416190] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-16T19:51:26.416514] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-16T19:51:26.418320] [DEBUG] [LOCAL ] KRC: Trimmed 70061 records to 48625 (keeping 200 days of data) [2025-10-16T19:51:26.418207] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54070 (keeping 200 days of data) [2025-10-16T19:51:26.995207] [DEBUG] [LOCAL ] KR: Primary data saved (54070 records). [2025-10-16T19:51:26.998962] [INFO ] [MAIN ] KR: Full history saved. [2025-10-16T19:51:26.999106] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KR took 33.9s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-16T19:51:27.199542] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:27.279527] [DEBUG] [LOCAL ] KRC: Primary data saved (48625 records). [2025-10-16T19:51:27.279788] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-16T19:51:27.279900] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KRC took 29.5s. Estimated remaining: 2h 42m 47s. Rate: 7.1 symbols/min [2025-10-16T19:51:27.430156] [DEBUG] [LOCAL ] KRG: Loaded 49285 existing records from primary storage. [2025-10-16T19:51:27.430950] [INFO ] [MAIN ] KRG: Loaded 49285 existing records. [2025-10-16T19:51:27.454351] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:51:27.581707] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:27.603692] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-16T19:51:27.620927] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-16T19:51:27.641192] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-16T19:51:27.641301] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-16T19:51:27.635019] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-16T19:51:27.643166] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-16T19:51:27.643666] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-16T19:51:27.784157] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:27.818667] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-16T19:51:27.834284] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-16T19:51:27.845004] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-16T19:51:27.855564] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-16T19:51:28.439800] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:28.440855] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-16T19:51:28.485036] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-16T19:51:28.538225] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:28.658616] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:51:28.658955] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-16T19:51:28.659064] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:51:28.659112] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-16T19:51:28.659149] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:51:28.659189] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-16T19:51:28.659269] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-16T19:51:28.659328] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-16T19:51:28.659372] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-16T19:51:28.659420] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRMN took 1.4s. Estimated remaining: 2h 42m 32s. Rate: 7.1 symbols/min [2025-10-16T19:51:28.751342] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-16T19:51:28.837431] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:28.862240] [DEBUG] [LOCAL ] KRO: Loaded 26413 existing records from primary storage. [2025-10-16T19:51:28.862532] [INFO ] [MAIN ] KRO: Loaded 26413 existing records. [2025-10-16T19:51:29.063912] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:29.064147] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-16T19:51:29.064205] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-16T19:51:29.064699] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-16T19:51:29.064756] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-16T19:51:29.442677] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:29.542790] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-16T19:51:29.660423] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-16T19:51:29.671751] [INFO ] [REMOTE ] KOS: Full fetch complete (77039 records). [2025-10-16T19:51:29.671939] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-16T19:51:30.069242] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-16T19:51:30.069351] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-16T19:51:30.070658] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-16T19:51:30.070725] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-16T19:51:30.072203] [DEBUG] [LOCAL ] KOS: Trimmed 77039 records to 53487 (keeping 200 days of data) [2025-10-16T19:51:30.350023] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-16T19:51:30.400348] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-16T19:51:30.431591] [DEBUG] [LOCAL ] KOS: Primary data saved (53487 records). [2025-10-16T19:51:30.431779] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-16T19:51:30.432431] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KOS took 43.2s. Estimated remaining: 2h 42m 17s. Rate: 7.1 symbols/min [2025-10-16T19:51:30.619461] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:30.656748] [DEBUG] [LOCAL ] KRP: Loaded 36348 existing records from primary storage. [2025-10-16T19:51:30.657027] [INFO ] [MAIN ] KRP: Loaded 36348 existing records. [2025-10-16T19:51:30.862360] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:51:30.865850] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:30.874372] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-16T19:51:30.874424] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-16T19:51:30.875079] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-16T19:51:30.875137] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-16T19:51:31.145910] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-16T19:51:31.225828] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:31.836764] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-16T19:51:31.942861] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-16T19:51:32.698994] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-16T19:51:32.742727] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-16T19:51:32.775343] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:51:33.542791] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-16T19:51:34.194567] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:51:34.342818] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-16T19:51:34.603100] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-16T19:51:35.142879] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-16T19:51:35.851473] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-16T19:51:35.942839] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-16T19:51:36.496737] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-16T19:51:36.742788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-16T19:51:36.948849] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:51:37.542890] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-16T19:51:38.265674] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:51:38.342775] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-16T19:51:38.804500] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:51:39.142851] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-16T19:51:39.945085] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-16T19:51:39.950469] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-16T19:51:40.470587] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:51:40.742832] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-16T19:51:40.879177] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-16T19:51:41.542816] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-16T19:51:42.305546] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-16T19:51:42.342862] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-16T19:51:42.668741] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:51:43.142828] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-16T19:51:43.827010] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-16T19:51:43.942785] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-16T19:51:44.742860] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-16T19:51:44.854372] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-16T19:51:45.416416] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-16T19:51:45.542799] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-16T19:51:46.305723] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-16T19:51:46.311099] [INFO ] [REMOTE ] KREF: Full fetch complete (52815 records). [2025-10-16T19:51:46.311219] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-16T19:51:46.347991] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-16T19:51:46.693471] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-16T19:51:46.693551] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-16T19:51:46.694463] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-16T19:51:46.694525] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-16T19:51:46.695626] [DEBUG] [LOCAL ] KREF: Trimmed 52815 records to 38221 (keeping 200 days of data) [2025-10-16T19:51:46.925968] [DEBUG] [LOCAL ] KREF: Primary data saved (38221 records). [2025-10-16T19:51:46.926147] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-16T19:51:46.926233] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KREF took 41.5s. Estimated remaining: 2h 42m 16s. Rate: 7.1 symbols/min [2025-10-16T19:51:47.125025] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:47.152308] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-16T19:51:47.174694] [DEBUG] [LOCAL ] KSS: Loaded 53593 existing records from primary storage. [2025-10-16T19:51:47.175020] [INFO ] [MAIN ] KSS: Loaded 53593 existing records. [2025-10-16T19:51:47.351197] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-16T19:51:47.396613] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:47.396838] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-16T19:51:47.396904] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-16T19:51:47.397078] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-16T19:51:47.397115] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-16T19:51:47.754994] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:47.798841] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:51:47.942787] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-16T19:51:48.081769] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-16T19:51:48.742851] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-16T19:51:49.076806] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-16T19:51:49.542839] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-16T19:51:49.935185] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-16T19:51:50.342808] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-16T19:51:51.142853] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-16T19:51:51.659888] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-16T19:51:51.806116] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:51:51.950854] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-16T19:51:51.952957] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T19:51:52.742820] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-16T19:51:53.160763] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-16T19:51:53.542868] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-16T19:51:53.854740] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-16T19:51:54.342907] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-16T19:51:54.613222] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-16T19:51:54.617584] [INFO ] [REMOTE ] KRP: Full fetch complete (55073 records). [2025-10-16T19:51:54.617701] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-16T19:51:54.987123] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-16T19:51:54.987198] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-16T19:51:54.988057] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-16T19:51:54.988120] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-16T19:51:54.989222] [DEBUG] [LOCAL ] KRP: Trimmed 55073 records to 36597 (keeping 200 days of data) [2025-10-16T19:51:55.157815] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-16T19:51:55.217545] [DEBUG] [LOCAL ] KRP: Primary data saved (36597 records). [2025-10-16T19:51:55.217718] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-16T19:51:55.217827] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRP took 24.8s. Estimated remaining: 2h 42m 8s. Rate: 7.1 symbols/min [2025-10-16T19:51:55.389143] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:51:55.431900] [DEBUG] [LOCAL ] KT: Loaded 45480 existing records from primary storage. [2025-10-16T19:51:55.432204] [INFO ] [MAIN ] KT: Loaded 45480 existing records. [2025-10-16T19:51:55.616455] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:51:55.616865] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-16T19:51:55.616925] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-16T19:51:55.617202] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-16T19:51:55.617254] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-16T19:51:55.943180] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-16T19:51:55.979884] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:51:56.008504] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-16T19:51:56.742792] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-16T19:51:57.066639] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-16T19:51:57.105814] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-16T19:51:57.542863] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-16T19:51:58.342783] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-16T19:51:58.474560] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-16T19:51:59.034050] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:51:59.142820] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-16T19:51:59.942827] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-16T19:52:00.148301] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:52:00.742822] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-16T19:52:00.885929] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-16T19:52:01.542851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-16T19:52:01.664271] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:52:02.342788] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-16T19:52:02.576481] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-16T19:52:02.872556] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:52:03.142812] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-16T19:52:03.942789] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-16T19:52:04.050584] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-16T19:52:04.059993] [INFO ] [REMOTE ] KRG: Full fetch complete (71326 records). [2025-10-16T19:52:04.060123] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-16T19:52:04.460419] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-16T19:52:04.460507] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-16T19:52:04.461634] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-16T19:52:04.461723] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-16T19:52:04.463141] [DEBUG] [LOCAL ] KRG: Trimmed 71326 records to 49661 (keeping 200 days of data) [2025-10-16T19:52:04.752753] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-16T19:52:04.764212] [DEBUG] [LOCAL ] KRG: Primary data saved (49661 records). [2025-10-16T19:52:04.764373] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-16T19:52:04.764461] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRG took 37.8s. Estimated remaining: 2h 42m 0s. Rate: 7.1 symbols/min [2025-10-16T19:52:04.960603] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:04.996319] [DEBUG] [LOCAL ] KTB: Loaded 40516 existing records from primary storage. [2025-10-16T19:52:04.996610] [INFO ] [MAIN ] KTB: Loaded 40516 existing records. [2025-10-16T19:52:05.189460] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:52:05.192751] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:05.199698] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-16T19:52:05.200175] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-16T19:52:05.200395] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-16T19:52:05.200451] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-16T19:52:05.522560] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-16T19:52:05.548755] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-16T19:52:05.607714] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:06.349800] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-16T19:52:06.366782] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:52:06.484835] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-16T19:52:06.488453] [INFO ] [REMOTE ] KRO: Full fetch complete (35270 records). [2025-10-16T19:52:06.488532] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-16T19:52:06.856578] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-16T19:52:06.856674] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-16T19:52:06.857396] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-16T19:52:06.857437] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-16T19:52:06.858240] [DEBUG] [LOCAL ] KRO: Trimmed 35270 records to 26679 (keeping 200 days of data) [2025-10-16T19:52:07.006562] [DEBUG] [LOCAL ] KRO: Primary data saved (26679 records). [2025-10-16T19:52:07.006725] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-16T19:52:07.006816] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRO took 38.3s. Estimated remaining: 2h 41m 46s. Rate: 7.1 symbols/min [2025-10-16T19:52:07.145606] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-16T19:52:07.176384] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:07.189282] [DEBUG] [LOCAL ] KTF: Loaded 11799 existing records from primary storage. [2025-10-16T19:52:07.189489] [INFO ] [MAIN ] KTF: Loaded 11799 existing records. [2025-10-16T19:52:07.364148] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:07.364372] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-16T19:52:07.364426] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-16T19:52:07.364581] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-16T19:52:07.364635] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-16T19:52:07.713939] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:07.767380] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:52:07.942829] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-16T19:52:08.499011] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-16T19:52:08.742818] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-16T19:52:09.542786] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-16T19:52:10.034800] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-16T19:52:10.342786] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-16T19:52:10.459469] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-16T19:52:10.664474] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T19:52:11.142859] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-16T19:52:11.942833] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-16T19:52:12.378884] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-16T19:52:12.658737] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:52:12.742810] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-16T19:52:13.543326] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-16T19:52:13.543257] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-16T19:52:13.871099] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:52:14.129828] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-16T19:52:14.342860] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-16T19:52:15.142807] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-16T19:52:15.760681] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-16T19:52:15.942809] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-16T19:52:16.682799] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-16T19:52:16.742798] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-16T19:52:17.282511] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-16T19:52:17.542792] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-16T19:52:17.556027] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:52:18.342829] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-16T19:52:18.921328] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:52:18.940863] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-16T19:52:19.142806] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-16T19:52:19.942808] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-16T19:52:20.164297] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-16T19:52:20.742832] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-16T19:52:21.302793] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:52:21.542853] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-16T19:52:22.342794] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-16T19:52:22.856609] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-16T19:52:23.091477] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:52:23.142825] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-16T19:52:23.152090] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-16T19:52:23.942819] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-16T19:52:24.393045] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:52:24.742871] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-16T19:52:25.542838] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-16T19:52:25.924111] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-16T19:52:26.305170] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-16T19:52:26.342790] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-16T19:52:26.438934] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-16T19:52:27.142804] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-16T19:52:27.947825] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-16T19:52:27.959971] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-16T19:52:28.696226] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-16T19:52:28.742771] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-16T19:52:29.534952] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-16T19:52:29.541831] [INFO ] [REMOTE ] KSS: Full fetch complete (77755 records). [2025-10-16T19:52:29.541963] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-16T19:52:29.553890] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-16T19:52:29.933755] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-16T19:52:29.933849] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-16T19:52:29.934913] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-16T19:52:29.934975] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-16T19:52:29.936413] [DEBUG] [LOCAL ] KSS: Trimmed 77755 records to 53983 (keeping 200 days of data) [2025-10-16T19:52:30.258683] [DEBUG] [LOCAL ] KSS: Primary data saved (53983 records). [2025-10-16T19:52:30.258909] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-16T19:52:30.259492] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KSS took 43.3s. Estimated remaining: 2h 41m 52s. Rate: 7.1 symbols/min [2025-10-16T19:52:30.350746] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-16T19:52:30.432813] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:30.433146] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-16T19:52:30.433199] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-16T19:52:30.455197] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-16T19:52:30.457934] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-16T19:52:30.458013] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-16T19:52:30.458057] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-16T19:52:30.524388] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:52:30.839135] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:31.018923] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-16T19:52:31.122136] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:52:31.129925] [INFO ] [REMOTE ] KT: Full fetch complete (66805 records). [2025-10-16T19:52:31.130048] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-16T19:52:31.150857] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-16T19:52:31.522331] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-16T19:52:31.522415] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-16T19:52:31.523423] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-16T19:52:31.523496] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-16T19:52:31.524834] [DEBUG] [LOCAL ] KT: Trimmed 66805 records to 45863 (keeping 200 days of data) [2025-10-16T19:52:31.796277] [DEBUG] [LOCAL ] KT: Primary data saved (45863 records). [2025-10-16T19:52:31.796419] [INFO ] [MAIN ] KT: Full history saved. [2025-10-16T19:52:31.796532] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KT took 36.6s. Estimated remaining: 2h 41m 37s. Rate: 7.1 symbols/min [2025-10-16T19:52:31.945898] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-16T19:52:31.967293] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:32.017448] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-16T19:52:32.017779] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-16T19:52:32.189950] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:32.190203] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-16T19:52:32.190255] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-16T19:52:32.190959] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-16T19:52:32.191015] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-16T19:52:32.541138] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:32.748891] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-16T19:52:32.754061] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-16T19:52:32.782069] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-16T19:52:33.390666] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-16T19:52:33.542836] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-16T19:52:34.052683] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-16T19:52:34.342859] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-16T19:52:35.142827] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-16T19:52:35.882532] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-16T19:52:35.884039] [INFO ] [REMOTE ] KTF: Full fetch complete (17390 records). [2025-10-16T19:52:35.884107] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-16T19:52:35.951522] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-16T19:52:36.255878] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-16T19:52:36.291945] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-16T19:52:36.292034] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-16T19:52:36.292581] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-16T19:52:36.292697] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-16T19:52:36.293383] [DEBUG] [LOCAL ] KTF: Trimmed 17390 records to 11841 (keeping 200 days of data) [2025-10-16T19:52:36.383412] [DEBUG] [LOCAL ] KTF: Primary data saved (11841 records). [2025-10-16T19:52:36.383553] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-16T19:52:36.383629] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KTF took 29.4s. Estimated remaining: 2h 41m 25s. Rate: 7.1 symbols/min [2025-10-16T19:52:36.547206] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:36.592202] [DEBUG] [LOCAL ] KVYO: Loaded 50785 existing records from primary storage. [2025-10-16T19:52:36.592502] [INFO ] [MAIN ] KVYO: Loaded 50785 existing records. [2025-10-16T19:52:36.745855] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-16T19:52:36.765125] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:36.765976] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-16T19:52:36.766025] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-16T19:52:36.766772] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-16T19:52:36.766829] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-16T19:52:37.117091] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:37.410677] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-16T19:52:37.415281] [INFO ] [REMOTE ] KTB: Full fetch complete (58245 records). [2025-10-16T19:52:37.415372] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-16T19:52:37.552705] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-16T19:52:37.796819] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-16T19:52:37.796890] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-16T19:52:37.797889] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-16T19:52:37.797952] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-16T19:52:37.799047] [DEBUG] [LOCAL ] KTB: Trimmed 58245 records to 40757 (keeping 200 days of data) [2025-10-16T19:52:38.041462] [DEBUG] [LOCAL ] KTB: Primary data saved (40757 records). [2025-10-16T19:52:38.041588] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-16T19:52:38.041701] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTB took 33.3s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-16T19:52:38.210980] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:52:38.244809] [DEBUG] [LOCAL ] KW: Loaded 40511 existing records from primary storage. [2025-10-16T19:52:38.245079] [INFO ] [MAIN ] KW: Loaded 40511 existing records. [2025-10-16T19:52:38.345132] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-16T19:52:38.429724] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:52:38.430243] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-16T19:52:38.430365] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-16T19:52:38.431314] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-16T19:52:38.431387] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-16T19:52:38.746957] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-16T19:52:38.834418] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:52:39.142768] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-16T19:52:39.297414] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:52:39.381044] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-16T19:52:39.942794] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-16T19:52:40.742843] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-16T19:52:40.885087] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-16T19:52:40.920774] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-16T19:52:41.542836] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-16T19:52:42.356261] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-16T19:52:42.359442] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-16T19:52:43.142815] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-16T19:52:43.381470] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-16T19:52:43.678783] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-16T19:52:43.942815] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-16T19:52:44.080077] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-16T19:52:44.742828] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-16T19:52:45.358434] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-16T19:52:45.542824] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-16T19:52:46.342838] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-16T19:52:46.710100] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-16T19:52:47.142817] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-16T19:52:47.190435] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:52:47.468292] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-16T19:52:47.942814] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-16T19:52:48.742799] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-16T19:52:49.013598] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-16T19:52:49.201952] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-16T19:52:49.542690] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-16T19:52:49.542796] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-16T19:52:50.342848] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-16T19:52:51.142817] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-16T19:52:51.360952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-16T19:52:51.942869] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-16T19:52:52.236775] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-16T19:52:52.448796] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-16T19:52:52.742853] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-16T19:52:53.189475] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-16T19:52:53.542856] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-16T19:52:53.607058] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-16T19:52:54.342827] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-16T19:52:54.725612] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-16T19:52:55.142798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-16T19:52:55.942779] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-16T19:52:56.129838] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-16T19:52:56.195380] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-16T19:52:56.742875] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-16T19:52:57.156826] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-16T19:52:57.548135] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-16T19:52:57.553966] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-16T19:52:57.928160] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-16T19:52:58.342816] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-16T19:52:58.978589] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-16T19:52:59.142861] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-16T19:52:59.942829] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-16T19:52:59.953581] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-16T19:53:00.742829] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-16T19:53:01.547936] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-16T19:53:01.561993] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:53:02.342822] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-16T19:53:02.700261] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-16T19:53:03.142798] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-16T19:53:03.312788] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-16T19:53:03.364003] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-16T19:53:03.365971] [INFO ] [REMOTE ] KUKE: Full fetch complete (8938 records). [2025-10-16T19:53:03.366053] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-16T19:53:03.546335] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-16T19:53:03.546616] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-16T19:53:03.546701] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-16T19:53:03.546776] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-16T19:53:03.546849] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-16T19:53:03.546904] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-16T19:53:03.546946] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-16T19:53:03.547002] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KUKE took 33.3s. Estimated remaining: 2h 41m 17s. Rate: 7.1 symbols/min [2025-10-16T19:53:03.726547] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:03.744547] [DEBUG] [LOCAL ] KWR: Loaded 16108 existing records from primary storage. [2025-10-16T19:53:03.744838] [INFO ] [MAIN ] KWR: Loaded 16108 existing records. [2025-10-16T19:53:03.934853] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:03.935064] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-16T19:53:03.935112] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-16T19:53:03.935827] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-16T19:53:03.935888] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-16T19:53:03.947938] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-16T19:53:04.293756] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:04.502561] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-16T19:53:04.742860] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-16T19:53:05.542838] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-16T19:53:05.724219] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-16T19:53:06.261967] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-16T19:53:06.342814] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-16T19:53:06.371607] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-16T19:53:07.142815] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-16T19:53:07.696018] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-16T19:53:07.756313] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-16T19:53:07.942824] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-16T19:53:08.742836] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-16T19:53:09.334397] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-16T19:53:09.542865] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-16T19:53:09.729531] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:53:09.736592] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-16T19:53:09.736752] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-16T19:53:10.131525] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-16T19:53:10.131596] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-16T19:53:10.132758] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-16T19:53:10.132823] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-16T19:53:10.134400] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 54057 (keeping 200 days of data) [2025-10-16T19:53:10.337676] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-16T19:53:10.364242] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-16T19:53:10.492329] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-16T19:53:10.492476] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-16T19:53:10.493464] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KVUE took 38.7s. Estimated remaining: 2h 41m 7s. Rate: 7.1 symbols/min [2025-10-16T19:53:10.665610] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:10.699912] [DEBUG] [LOCAL ] KYN: Loaded 30275 existing records from primary storage. [2025-10-16T19:53:10.700159] [INFO ] [MAIN ] KYN: Loaded 30275 existing records. [2025-10-16T19:53:10.895944] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:10.896173] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-16T19:53:10.896219] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-16T19:53:10.896523] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-16T19:53:10.896578] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-16T19:53:11.147899] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-16T19:53:11.249203] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:11.942787] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-16T19:53:12.185955] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:53:12.248836] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:53:12.742813] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-16T19:53:13.435274] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-16T19:53:13.440908] [INFO ] [REMOTE ] KW: Full fetch complete (57270 records). [2025-10-16T19:53:13.441081] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-16T19:53:13.547900] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-16T19:53:13.830583] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-16T19:53:13.830706] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-16T19:53:13.831740] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-16T19:53:13.831806] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-16T19:53:13.833136] [DEBUG] [LOCAL ] KW: Trimmed 57270 records to 40783 (keeping 200 days of data) [2025-10-16T19:53:14.065606] [DEBUG] [LOCAL ] KW: Primary data saved (40783 records). [2025-10-16T19:53:14.065761] [INFO ] [MAIN ] KW: Full history saved. [2025-10-16T19:53:14.065843] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KW took 36.0s. Estimated remaining: 2h 40m 54s. Rate: 7.1 symbols/min [2025-10-16T19:53:14.231523] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:14.268693] [DEBUG] [LOCAL ] L: Loaded 41169 existing records from primary storage. [2025-10-16T19:53:14.268987] [INFO ] [MAIN ] L: Loaded 41169 existing records. [2025-10-16T19:53:14.358409] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-16T19:53:14.453088] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:14.453388] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-16T19:53:14.453444] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-16T19:53:14.453632] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-16T19:53:14.453714] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-16T19:53:14.813943] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:14.838928] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-16T19:53:14.839992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-16T19:53:14.851396] [INFO ] [REMOTE ] KVYO: Full fetch complete (72072 records). [2025-10-16T19:53:14.851501] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-16T19:53:15.146181] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-16T19:53:15.240895] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-16T19:53:15.240970] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-16T19:53:15.242062] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-16T19:53:15.242124] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-16T19:53:15.243515] [DEBUG] [LOCAL ] KVYO: Trimmed 72072 records to 51171 (keeping 200 days of data) [2025-10-16T19:53:15.541460] [DEBUG] [LOCAL ] KVYO: Primary data saved (51171 records). [2025-10-16T19:53:15.541612] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-16T19:53:15.542240] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KVYO took 39.2s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-16T19:53:15.714039] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:15.761021] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-16T19:53:15.785005] [DEBUG] [LOCAL ] LAC: Loaded 52510 existing records from primary storage. [2025-10-16T19:53:15.785313] [INFO ] [MAIN ] LAC: Loaded 52510 existing records. [2025-10-16T19:53:15.956176] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-16T19:53:15.986992] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:15.988041] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-16T19:53:15.988092] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-16T19:53:15.988933] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-16T19:53:15.988990] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-16T19:53:16.362758] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-16T19:53:16.361729] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:16.742778] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-16T19:53:17.520207] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-16T19:53:17.542773] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-16T19:53:17.575612] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-16T19:53:18.342856] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-16T19:53:19.142782] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-16T19:53:19.498291] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-16T19:53:19.611884] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-16T19:53:19.942767] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-16T19:53:20.087328] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-16T19:53:20.742824] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-16T19:53:21.542785] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-16T19:53:21.885447] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-16T19:53:22.257302] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:53:22.342792] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-16T19:53:22.587012] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-16T19:53:23.142874] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-16T19:53:23.947990] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-16T19:53:23.965058] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:53:24.444849] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-16T19:53:24.742855] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-16T19:53:25.500318] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-16T19:53:25.542872] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-16T19:53:25.632357] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-16T19:53:26.342816] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-16T19:53:26.803784] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-16T19:53:27.142872] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-16T19:53:27.345857] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-16T19:53:27.347980] [INFO ] [REMOTE ] KWR: Full fetch complete (23487 records). [2025-10-16T19:53:27.348111] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-16T19:53:27.777673] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-16T19:53:27.777766] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-16T19:53:27.778322] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-16T19:53:27.778364] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-16T19:53:27.779174] [DEBUG] [LOCAL ] KWR: Trimmed 23487 records to 16172 (keeping 200 days of data) [2025-10-16T19:53:27.881112] [DEBUG] [LOCAL ] KWR: Primary data saved (16172 records). [2025-10-16T19:53:27.881263] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-16T19:53:27.881348] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KWR took 24.3s. Estimated remaining: 2h 40m 34s. Rate: 7.1 symbols/min [2025-10-16T19:53:27.947964] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-16T19:53:28.053314] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:28.076410] [DEBUG] [LOCAL ] LAD: Loaded 23378 existing records from primary storage. [2025-10-16T19:53:28.076680] [INFO ] [MAIN ] LAD: Loaded 23378 existing records. [2025-10-16T19:53:28.247911] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:28.248146] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-16T19:53:28.248244] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-16T19:53:28.248475] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-16T19:53:28.248529] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-16T19:53:28.608596] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:28.742783] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-16T19:53:28.937157] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-16T19:53:29.349566] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:53:29.542874] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-16T19:53:30.342840] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-16T19:53:30.392331] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-16T19:53:30.444965] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-16T19:53:31.142801] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-16T19:53:31.446522] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-16T19:53:31.942796] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-16T19:53:32.400291] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-16T19:53:32.742921] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-16T19:53:33.501531] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-16T19:53:33.542852] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-16T19:53:34.088092] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-16T19:53:34.342815] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-16T19:53:34.718511] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-16T19:53:35.142806] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-16T19:53:35.375463] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-16T19:53:35.942826] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-16T19:53:36.689505] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-16T19:53:36.742787] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-16T19:53:37.176614] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-16T19:53:37.542827] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-16T19:53:38.159016] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-16T19:53:38.343395] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:53:38.342830] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-16T19:53:39.142814] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-16T19:53:39.942828] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-16T19:53:40.348293] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-16T19:53:40.556295] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-16T19:53:40.742786] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-16T19:53:41.059351] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:53:41.542868] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-16T19:53:41.721448] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-16T19:53:41.725824] [INFO ] [REMOTE ] KYN: Full fetch complete (44560 records). [2025-10-16T19:53:41.725949] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-16T19:53:42.132031] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-16T19:53:42.132144] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-16T19:53:42.133023] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-16T19:53:42.133088] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-16T19:53:42.134164] [DEBUG] [LOCAL ] KYN: Trimmed 44560 records to 30494 (keeping 200 days of data) [2025-10-16T19:53:42.317658] [DEBUG] [LOCAL ] KYN: Primary data saved (30494 records). [2025-10-16T19:53:42.317802] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-16T19:53:42.317882] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KYN took 31.8s. Estimated remaining: 2h 40m 32s. Rate: 7.1 symbols/min [2025-10-16T19:53:42.347961] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-16T19:53:42.487045] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:42.523863] [DEBUG] [LOCAL ] LADR: Loaded 39396 existing records from primary storage. [2025-10-16T19:53:42.524138] [INFO ] [MAIN ] LADR: Loaded 39396 existing records. [2025-10-16T19:53:42.700165] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:42.700425] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-16T19:53:42.700478] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-16T19:53:42.700765] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-16T19:53:42.700821] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-16T19:53:43.074706] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:53:43.080055] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:43.142809] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-16T19:53:43.870810] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-16T19:53:43.942792] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-16T19:53:44.583222] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-16T19:53:44.742826] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-16T19:53:45.297591] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-16T19:53:45.542852] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-16T19:53:46.018612] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:53:46.024173] [INFO ] [REMOTE ] L: Full fetch complete (59496 records). [2025-10-16T19:53:46.024351] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-16T19:53:46.354515] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-16T19:53:46.413612] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-16T19:53:46.413718] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-16T19:53:46.414637] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-16T19:53:46.414719] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-16T19:53:46.416106] [DEBUG] [LOCAL ] L: Trimmed 59496 records to 41525 (keeping 200 days of data) [2025-10-16T19:53:46.665466] [DEBUG] [LOCAL ] L: Primary data saved (41525 records). [2025-10-16T19:53:46.665585] [INFO ] [MAIN ] L: Full history saved. [2025-10-16T19:53:46.665683] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. L took 32.6s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-16T19:53:46.837880] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:53:46.842287] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-16T19:53:46.842477] [INFO ] [MAIN ] LANV: Loaded 2784 existing records. [2025-10-16T19:53:47.024594] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:53:47.045212] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:53:47.053683] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-16T19:53:47.053956] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-16T19:53:47.054164] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-16T19:53:47.054217] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-16T19:53:47.144724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-16T19:53:47.431436] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-16T19:53:47.442335] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:53:47.942847] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-16T19:53:48.407921] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-16T19:53:48.742830] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-16T19:53:49.297531] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-16T19:53:49.542810] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-16T19:53:49.632785] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-16T19:53:50.342815] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-16T19:53:50.519787] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-16T19:53:50.667447] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-16T19:53:51.142825] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-16T19:53:51.578017] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:53:51.942825] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-16T19:53:52.742879] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-16T19:53:53.542808] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-16T19:53:53.803841] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-16T19:53:53.917569] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-16T19:53:54.344848] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-16T19:53:54.346824] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-16T19:53:55.142844] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-16T19:53:55.799974] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-16T19:53:55.942811] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-16T19:53:56.742819] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-16T19:53:57.245789] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-16T19:53:57.250380] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T19:53:57.277681] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-16T19:53:57.542827] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-16T19:53:57.965567] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-16T19:53:58.342832] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-16T19:53:58.763409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-16T19:53:59.142814] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-16T19:53:59.942827] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-16T19:54:00.525728] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-16T19:54:00.742829] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-16T19:54:01.145303] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-16T19:54:01.542806] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-16T19:54:02.342878] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-16T19:54:02.970478] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-16T19:54:02.973725] [INFO ] [REMOTE ] LAD: Full fetch complete (35383 records). [2025-10-16T19:54:02.973813] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-16T19:54:03.129557] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-16T19:54:03.163130] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-16T19:54:03.400793] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-16T19:54:03.400879] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-16T19:54:03.401691] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-16T19:54:03.401755] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-16T19:54:03.402636] [DEBUG] [LOCAL ] LAD: Trimmed 35383 records to 23491 (keeping 200 days of data) [2025-10-16T19:54:03.548268] [DEBUG] [LOCAL ] LAD: Primary data saved (23491 records). [2025-10-16T19:54:03.548414] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-16T19:54:03.548508] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. LAD took 35.7s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-16T19:54:03.715808] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:03.715963] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-16T19:54:03.716002] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-16T19:54:03.716112] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-16T19:54:03.716154] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-16T19:54:03.716197] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-16T19:54:03.716232] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-16T19:54:03.926546] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-16T19:54:03.948043] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-16T19:54:04.089295] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:04.110049] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-16T19:54:04.742813] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-16T19:54:05.542822] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-16T19:54:05.999278] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-16T19:54:06.244826] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-16T19:54:06.343958] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-16T19:54:06.343814] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:54:06.902233] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-16T19:54:07.142809] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-16T19:54:07.324840] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-16T19:54:07.325177] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-16T19:54:07.325269] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-16T19:54:07.325316] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-16T19:54:07.325375] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-16T19:54:07.325447] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-16T19:54:07.325510] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-16T19:54:07.325546] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-16T19:54:07.325584] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-16T19:54:07.325628] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. LAR took 3.8s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-16T19:54:07.499275] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:07.515479] [DEBUG] [LOCAL ] LAW: Loaded 14653 existing records from primary storage. [2025-10-16T19:54:07.515808] [INFO ] [MAIN ] LAW: Loaded 14653 existing records. [2025-10-16T19:54:07.698539] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:07.698846] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-16T19:54:07.698895] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-16T19:54:07.699089] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-16T19:54:07.699148] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-16T19:54:07.947991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-16T19:54:08.057725] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:08.742859] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-16T19:54:09.373702] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-16T19:54:09.408419] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-16T19:54:09.542798] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-16T19:54:10.185199] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-16T19:54:10.186180] [INFO ] [REMOTE ] LANV: Full fetch complete (4286 records). [2025-10-16T19:54:10.186252] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-16T19:54:10.355839] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-16T19:54:10.542496] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-16T19:54:10.542583] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-16T19:54:10.542747] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-16T19:54:10.542809] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-16T19:54:10.543221] [DEBUG] [LOCAL ] LANV: Trimmed 4286 records to 2789 (keeping 200 days of data) [2025-10-16T19:54:10.559237] [DEBUG] [LOCAL ] LANV: Primary data saved (2789 records). [2025-10-16T19:54:10.559377] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-16T19:54:10.559468] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LANV took 23.9s. Estimated remaining: 2h 39m 53s. Rate: 7.1 symbols/min [2025-10-16T19:54:10.729371] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:10.769733] [DEBUG] [LOCAL ] LAZ: Loaded 44741 existing records from primary storage. [2025-10-16T19:54:10.770102] [INFO ] [MAIN ] LAZ: Loaded 44741 existing records. [2025-10-16T19:54:10.944298] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:10.944516] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-16T19:54:10.944564] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-16T19:54:10.944898] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-16T19:54:10.944957] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-16T19:54:11.151523] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-16T19:54:11.297950] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:11.942818] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-16T19:54:12.695345] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:54:12.742836] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-16T19:54:12.877513] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-16T19:54:12.991788] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-16T19:54:12.999057] [INFO ] [REMOTE ] LAC: Full fetch complete (76129 records). [2025-10-16T19:54:12.999192] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-16T19:54:13.444239] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-16T19:54:13.444333] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-16T19:54:13.445454] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-16T19:54:13.445517] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-16T19:54:13.447076] [DEBUG] [LOCAL ] LAC: Trimmed 76129 records to 52900 (keeping 200 days of data) [2025-10-16T19:54:13.554888] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-16T19:54:13.744283] [DEBUG] [LOCAL ] LAC: Primary data saved (52900 records). [2025-10-16T19:54:13.744425] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-16T19:54:13.744979] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LAC took 58.2s. Estimated remaining: 2h 39m 39s. Rate: 7.1 symbols/min [2025-10-16T19:54:13.918788] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:13.948766] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-16T19:54:13.984288] [DEBUG] [LOCAL ] LB: Loaded 37383 existing records from primary storage. [2025-10-16T19:54:13.984573] [INFO ] [MAIN ] LB: Loaded 37383 existing records. [2025-10-16T19:54:14.158087] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:14.158299] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-16T19:54:14.158347] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-16T19:54:14.158585] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-16T19:54:14.158675] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-16T19:54:14.332334] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-16T19:54:14.344301] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-16T19:54:14.557402] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:15.142800] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-16T19:54:15.782112] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-16T19:54:15.787452] [INFO ] [REMOTE ] LADR: Full fetch complete (55722 records). [2025-10-16T19:54:15.787559] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-16T19:54:15.947945] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-16T19:54:16.224257] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-16T19:54:16.224514] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-16T19:54:16.225717] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-16T19:54:16.225899] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-16T19:54:16.227384] [DEBUG] [LOCAL ] LADR: Trimmed 55722 records to 39688 (keeping 200 days of data) [2025-10-16T19:54:16.497182] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-16T19:54:16.541292] [DEBUG] [LOCAL ] LADR: Primary data saved (39688 records). [2025-10-16T19:54:16.541449] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-16T19:54:16.541550] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LADR took 34.2s. Estimated remaining: 2h 39m 26s. Rate: 7.1 symbols/min [2025-10-16T19:54:16.742809] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-16T19:54:17.363351] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-16T19:54:17.542803] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-16T19:54:18.126896] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:54:18.342781] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-16T19:54:18.499807] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-16T19:54:19.142884] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-16T19:54:19.860582] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-16T19:54:19.942806] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-16T19:54:19.982223] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-16T19:54:20.742812] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-16T19:54:21.542851] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-16T19:54:21.615174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:54:22.313577] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-16T19:54:22.312422] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:54:22.342764] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-16T19:54:23.142862] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-16T19:54:23.839351] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-16T19:54:23.942770] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-16T19:54:24.668842] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-16T19:54:24.742801] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-16T19:54:25.491022] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-16T19:54:25.542771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-16T19:54:26.222560] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-16T19:54:26.342843] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-16T19:54:26.646099] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-16T19:54:26.929400] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-16T19:54:27.142841] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-16T19:54:27.942813] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-16T19:54:28.559433] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-16T19:54:28.742823] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-16T19:54:28.848248] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-16T19:54:29.542854] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-16T19:54:30.190374] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-16T19:54:30.342829] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-16T19:54:30.434611] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-16T19:54:31.142831] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-16T19:54:31.935911] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-16T19:54:31.949562] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-16T19:54:32.742819] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-16T19:54:32.793477] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-16T19:54:32.960452] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-16T19:54:33.542859] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-16T19:54:33.947551] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:54:34.342888] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-16T19:54:34.472987] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-16T19:54:35.142845] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-16T19:54:35.517708] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-16T19:54:35.942815] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-16T19:54:36.668863] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-16T19:54:36.742789] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-16T19:54:36.914115] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-16T19:54:36.916911] [INFO ] [REMOTE ] LAW: Full fetch complete (20872 records). [2025-10-16T19:54:36.916990] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-16T19:54:37.286043] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-16T19:54:37.286124] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-16T19:54:37.286595] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-16T19:54:37.286636] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-16T19:54:37.287247] [DEBUG] [LOCAL ] LAW: Trimmed 20872 records to 14781 (keeping 200 days of data) [2025-10-16T19:54:37.368047] [DEBUG] [LOCAL ] LAW: Primary data saved (14781 records). [2025-10-16T19:54:37.368189] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-16T19:54:37.368274] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAW took 30.0s. Estimated remaining: 2h 39m 28s. Rate: 7.1 symbols/min [2025-10-16T19:54:37.542827] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-16T19:54:38.126572] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-16T19:54:38.342797] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-16T19:54:38.712069] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-16T19:54:38.717034] [INFO ] [REMOTE ] LB: Full fetch complete (56009 records). [2025-10-16T19:54:38.717129] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-16T19:54:39.144182] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-16T19:54:39.144271] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-16T19:54:39.145534] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-16T19:54:39.145669] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-16T19:54:39.147014] [DEBUG] [LOCAL ] LB: Trimmed 56009 records to 37609 (keeping 200 days of data) [2025-10-16T19:54:39.396009] [DEBUG] [LOCAL ] LB: Primary data saved (37609 records). [2025-10-16T19:54:39.396152] [INFO ] [MAIN ] LB: Full history saved. [2025-10-16T19:54:39.396763] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LB took 25.7s. Estimated remaining: 2h 39m 14s. Rate: 7.1 symbols/min [2025-10-16T19:54:39.809222] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-16T19:54:39.814501] [INFO ] [REMOTE ] LAZ: Full fetch complete (65611 records). [2025-10-16T19:54:39.814614] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-16T19:54:40.199484] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-16T19:54:40.199577] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-16T19:54:40.200569] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-16T19:54:40.200636] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-16T19:54:40.202013] [DEBUG] [LOCAL ] LAZ: Trimmed 65611 records to 44986 (keeping 200 days of data) [2025-10-16T19:54:40.473784] [DEBUG] [LOCAL ] LAZ: Primary data saved (44986 records). [2025-10-16T19:54:40.473926] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-16T19:54:40.474005] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAZ took 29.9s. Estimated remaining: 2h 38m 59s. Rate: 7.1 symbols/min [2025-10-16T19:54:41.114146] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.177419] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.198142] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.199731] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:54:41.250148] [DEBUG] [LOCAL ] LCII: Loaded 27437 existing records from primary storage. [2025-10-16T19:54:41.264598] [INFO ] [MAIN ] LCII: Loaded 27437 existing records. [2025-10-16T19:54:41.416489] [DEBUG] [LOCAL ] LDI: Loaded 44806 existing records from primary storage. [2025-10-16T19:54:41.415886] [DEBUG] [LOCAL ] LBRT: Loaded 52959 existing records from primary storage. [2025-10-16T19:54:41.438244] [INFO ] [MAIN ] LDI: Loaded 44806 existing records. [2025-10-16T19:54:41.427591] [DEBUG] [LOCAL ] LC: Loaded 48164 existing records from primary storage. [2025-10-16T19:54:41.443947] [INFO ] [MAIN ] LC: Loaded 48164 existing records. [2025-10-16T19:54:41.464337] [INFO ] [MAIN ] LBRT: Loaded 52959 existing records. [2025-10-16T19:54:41.699013] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:41.803250] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-16T19:54:41.808631] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-16T19:54:41.921121] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-16T19:54:41.955364] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-16T19:54:41.973458] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.092402] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.133527] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.183973] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.197734] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-16T19:54:42.192533] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:54:42.225504] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-16T19:54:42.197839] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-16T19:54:42.225610] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-16T19:54:42.225855] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-16T19:54:42.225992] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-16T19:54:42.237404] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-16T19:54:42.246795] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-16T19:54:42.247221] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-16T19:54:42.237604] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-16T19:54:43.338476] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.427816] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-16T19:54:43.555823] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.567294] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-16T19:54:43.615846] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.636435] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-16T19:54:43.679412] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:54:43.679971] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-16T19:54:44.583472] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-16T19:54:44.588145] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-16T19:54:45.058758] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-16T19:54:45.067403] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-16T19:54:45.156791] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-16T19:54:45.167203] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-16T19:54:45.384853] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-16T19:54:45.395305] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-16T19:54:45.410098] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-16T19:54:45.542777] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-16T19:54:46.185088] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-16T19:54:46.342779] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-16T19:54:46.667638] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-16T19:54:46.836941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-16T19:54:46.993494] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-16T19:54:47.142818] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-16T19:54:47.262254] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-16T19:54:47.942858] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-16T19:54:48.441696] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-16T19:54:48.742833] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-16T19:54:49.043960] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-16T19:54:49.542815] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-16T19:54:50.351397] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-16T19:54:50.356725] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-16T19:54:51.142827] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-16T19:54:51.198303] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-16T19:54:51.856692] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-16T19:54:51.942785] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-16T19:54:52.742816] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-16T19:54:53.542939] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-16T19:54:54.329531] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-16T19:54:54.342763] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-16T19:54:54.982879] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:54:55.142780] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-16T19:54:55.613211] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:54:55.942823] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-16T19:54:56.086577] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (4.94 seconds). [2025-10-16T19:54:56.742845] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-16T19:54:56.881799] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:54:56.914033] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (4.97 seconds). [2025-10-16T19:54:56.936288] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-16T19:54:57.542851] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-16T19:54:58.342838] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-16T19:54:58.482531] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-16T19:54:59.147916] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-16T19:54:59.165413] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:54:59.249574] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:54:59.942819] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-16T19:55:00.592246] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-16T19:55:00.742777] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-16T19:55:01.207040] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:55:01.542884] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-16T19:55:02.260145] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-16T19:55:02.342811] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-16T19:55:02.709485] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-16T19:55:03.142848] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-16T19:55:03.942820] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-16T19:55:04.413303] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-16T19:55:04.742815] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-16T19:55:05.042893] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-16T19:55:05.174923] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-16T19:55:05.542777] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-16T19:55:05.775130] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-16T19:55:06.342813] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-16T19:55:07.119631] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-16T19:55:07.142785] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-16T19:55:07.942801] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-16T19:55:08.742830] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-16T19:55:08.919750] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-16T19:55:09.219575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-16T19:55:09.224672] [INFO ] [REMOTE ] LCII: Full fetch complete (39158 records). [2025-10-16T19:55:09.224871] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-16T19:55:09.552437] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-16T19:55:09.602800] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-16T19:55:09.603004] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-16T19:55:09.603987] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-16T19:55:09.604068] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-16T19:55:09.605458] [DEBUG] [LOCAL ] LCII: Trimmed 39158 records to 27611 (keeping 200 days of data) [2025-10-16T19:55:09.728886] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-16T19:55:09.820804] [DEBUG] [LOCAL ] LCII: Primary data saved (27611 records). [2025-10-16T19:55:09.820962] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-16T19:55:09.821050] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LCII took 29.3s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-16T19:55:09.992297] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:10.033609] [DEBUG] [LOCAL ] LDOS: Loaded 44998 existing records from primary storage. [2025-10-16T19:55:10.033916] [INFO ] [MAIN ] LDOS: Loaded 44998 existing records. [2025-10-16T19:55:10.208738] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:10.208995] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-16T19:55:10.209143] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-16T19:55:10.209397] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-16T19:55:10.209453] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-16T19:55:10.345814] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-16T19:55:10.602561] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-16T19:55:10.614884] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:11.142828] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-16T19:55:11.563683] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-16T19:55:11.942922] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-16T19:55:12.275285] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-16T19:55:12.282128] [INFO ] [REMOTE ] LDI: Full fetch complete (61828 records). [2025-10-16T19:55:12.282279] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-16T19:55:12.682602] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-16T19:55:12.682818] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-16T19:55:12.683802] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-16T19:55:12.683866] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-16T19:55:12.685163] [DEBUG] [LOCAL ] LDI: Trimmed 61828 records to 45194 (keeping 200 days of data) [2025-10-16T19:55:12.768426] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-16T19:55:12.953110] [DEBUG] [LOCAL ] LDI: Primary data saved (45194 records). [2025-10-16T19:55:12.962882] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-16T19:55:12.963556] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LDI took 32.5s. Estimated remaining: 2h 38m 56s. Rate: 7.1 symbols/min [2025-10-16T19:55:13.040134] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-16T19:55:13.143342] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:13.158496] [DEBUG] [LOCAL ] LDP: Loaded 12815 existing records from primary storage. [2025-10-16T19:55:13.158752] [INFO ] [MAIN ] LDP: Loaded 12815 existing records. [2025-10-16T19:55:13.338351] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:13.338586] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-16T19:55:13.338637] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-16T19:55:13.338856] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-16T19:55:13.338911] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-16T19:55:13.548054] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-16T19:55:13.716854] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-16T19:55:13.729737] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:14.342828] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-16T19:55:14.504696] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-16T19:55:15.142837] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-16T19:55:15.443943] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-16T19:55:15.942847] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-16T19:55:16.306526] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-16T19:55:16.313004] [INFO ] [REMOTE ] LC: Full fetch complete (70679 records). [2025-10-16T19:55:16.313147] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-16T19:55:16.697773] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-16T19:55:16.697845] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-16T19:55:16.698844] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-16T19:55:16.698906] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-16T19:55:16.700164] [DEBUG] [LOCAL ] LC: Trimmed 70679 records to 48551 (keeping 200 days of data) [2025-10-16T19:55:16.747539] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-16T19:55:17.001896] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-16T19:55:17.002583] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-16T19:55:17.016256] [INFO ] [REMOTE ] LBRT: Full fetch complete (76898 records). [2025-10-16T19:55:17.017017] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-16T19:55:17.096025] [DEBUG] [LOCAL ] LC: Primary data saved (48551 records). [2025-10-16T19:55:17.106990] [INFO ] [MAIN ] LC: Full history saved. [2025-10-16T19:55:17.126157] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LC took 36.7s. Estimated remaining: 2h 38m 44s. Rate: 7.1 symbols/min [2025-10-16T19:55:17.477289] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:17.549113] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-16T19:55:17.598142] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-16T19:55:17.598319] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-16T19:55:17.599388] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-16T19:55:17.600859] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-16T19:55:17.602678] [DEBUG] [LOCAL ] LBRT: Trimmed 76898 records to 53348 (keeping 200 days of data) [2025-10-16T19:55:17.740339] [DEBUG] [LOCAL ] LEA: Loaded 41359 existing records from primary storage. [2025-10-16T19:55:17.746260] [INFO ] [MAIN ] LEA: Loaded 41359 existing records. [2025-10-16T19:55:18.042259] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:18.048532] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-16T19:55:18.049022] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-16T19:55:18.053248] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-16T19:55:18.053321] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-16T19:55:18.285013] [DEBUG] [LOCAL ] LBRT: Primary data saved (53348 records). [2025-10-16T19:55:18.310513] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-16T19:55:18.320125] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 37.8s. Estimated remaining: 2h 38m 29s. Rate: 7.1 symbols/min [2025-10-16T19:55:18.618902] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-16T19:55:18.643296] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:18.634823] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-16T19:55:18.694135] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:18.722315] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-16T19:55:18.771453] [DEBUG] [LOCAL ] LEG: Loaded 50170 existing records from primary storage. [2025-10-16T19:55:18.771825] [INFO ] [MAIN ] LEG: Loaded 50170 existing records. [2025-10-16T19:55:18.948849] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:18.949095] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-16T19:55:18.949180] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-16T19:55:18.949538] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-16T19:55:18.949597] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-16T19:55:19.151940] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-16T19:55:19.299163] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:19.480688] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-16T19:55:19.942807] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-16T19:55:20.742892] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-16T19:55:20.906275] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-16T19:55:21.542870] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-16T19:55:21.599820] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-16T19:55:21.631087] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-16T19:55:22.342868] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-16T19:55:23.142820] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-16T19:55:23.320010] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-16T19:55:23.952706] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-16T19:55:23.957676] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-16T19:55:24.017022] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-16T19:55:24.742816] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-16T19:55:25.151421] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-16T19:55:25.319221] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:55:25.542886] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-16T19:55:26.342837] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-16T19:55:27.144070] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-16T19:55:27.160201] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-16T19:55:27.942823] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-16T19:55:28.015033] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-16T19:55:28.650514] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-16T19:55:28.742780] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-16T19:55:29.372006] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:55:29.542791] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-16T19:55:30.279300] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-16T19:55:30.342808] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-16T19:55:31.142799] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-16T19:55:31.182530] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-16T19:55:31.935547] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:55:31.944545] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-16T19:55:32.542566] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-16T19:55:32.742794] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-16T19:55:33.542795] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-16T19:55:33.621533] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-16T19:55:33.661353] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-16T19:55:34.342809] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-16T19:55:35.093607] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-16T19:55:35.142793] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-16T19:55:35.251426] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-16T19:55:35.942858] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-16T19:55:36.742850] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-16T19:55:36.812043] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-16T19:55:37.388144] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-16T19:55:37.532404] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-16T19:55:37.542757] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-16T19:55:38.342829] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-16T19:55:38.395993] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-16T19:55:39.142811] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-16T19:55:39.909816] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-16T19:55:39.912671] [INFO ] [REMOTE ] LDP: Full fetch complete (18973 records). [2025-10-16T19:55:39.912762] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-16T19:55:39.951865] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-16T19:55:40.322048] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-16T19:55:40.363766] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-16T19:55:40.363967] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-16T19:55:40.364408] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-16T19:55:40.364889] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-16T19:55:40.365488] [DEBUG] [LOCAL ] LDP: Trimmed 18973 records to 12892 (keeping 200 days of data) [2025-10-16T19:55:40.446931] [DEBUG] [LOCAL ] LDP: Primary data saved (12892 records). [2025-10-16T19:55:40.447085] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-16T19:55:40.447179] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LDP took 27.5s. Estimated remaining: 2h 38m 33s. Rate: 7.1 symbols/min [2025-10-16T19:55:40.614283] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:40.664867] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-10-16T19:55:40.665181] [INFO ] [MAIN ] LEN: Loaded 53195 existing records. [2025-10-16T19:55:40.747897] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-16T19:55:40.841305] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:40.841523] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-16T19:55:40.841571] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-16T19:55:40.841807] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-16T19:55:40.841864] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-16T19:55:41.198028] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:41.542794] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-16T19:55:41.658976] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-16T19:55:42.246150] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-16T19:55:42.342796] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-16T19:55:43.142787] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-16T19:55:43.437348] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-16T19:55:43.825603] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-16T19:55:43.942847] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-16T19:55:44.708324] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-16T19:55:44.713765] [INFO ] [REMOTE ] LDOS: Full fetch complete (67084 records). [2025-10-16T19:55:44.713878] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-16T19:55:44.748115] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-16T19:55:45.105278] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-16T19:55:45.105385] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-16T19:55:45.106518] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-16T19:55:45.106581] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-16T19:55:45.107909] [DEBUG] [LOCAL ] LDOS: Trimmed 67084 records to 45271 (keeping 200 days of data) [2025-10-16T19:55:45.381956] [DEBUG] [LOCAL ] LDOS: Primary data saved (45271 records). [2025-10-16T19:55:45.382090] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-16T19:55:45.382526] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDOS took 35.6s. Estimated remaining: 2h 38m 21s. Rate: 7.1 symbols/min [2025-10-16T19:55:45.548749] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-16T19:55:45.553211] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:45.570539] [DEBUG] [LOCAL ] LEO: Loaded 16652 existing records from primary storage. [2025-10-16T19:55:45.570810] [INFO ] [MAIN ] LEO: Loaded 16652 existing records. [2025-10-16T19:55:45.760982] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:45.761350] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-16T19:55:45.761592] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-16T19:55:45.761901] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-16T19:55:45.762068] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-16T19:55:45.949183] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-16T19:55:46.164810] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:46.342817] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-16T19:55:46.494002] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-16T19:55:46.991101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-16T19:55:47.033919] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-16T19:55:47.142805] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-16T19:55:47.942788] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-16T19:55:48.124256] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-16T19:55:48.742816] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-16T19:55:49.542858] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-16T19:55:49.704252] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-16T19:55:50.342859] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-16T19:55:50.345377] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-16T19:55:51.147965] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-16T19:55:51.161632] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-16T19:55:51.365701] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-16T19:55:51.942856] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-16T19:55:52.742923] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-16T19:55:52.853162] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-16T19:55:53.421375] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-16T19:55:53.426735] [INFO ] [REMOTE ] LEA: Full fetch complete (60661 records). [2025-10-16T19:55:53.426864] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-16T19:55:53.547988] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-16T19:55:53.872051] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-16T19:55:53.872305] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-16T19:55:53.877818] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-16T19:55:53.880544] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-16T19:55:53.881155] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-16T19:55:53.883108] [DEBUG] [LOCAL ] LEA: Trimmed 60661 records to 41612 (keeping 200 days of data) [2025-10-16T19:55:54.167068] [DEBUG] [LOCAL ] LEA: Primary data saved (41612 records). [2025-10-16T19:55:54.167252] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-16T19:55:54.167378] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LEA took 37.0s. Estimated remaining: 2h 38m 13s. Rate: 7.1 symbols/min [2025-10-16T19:55:54.347993] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-16T19:55:54.349973] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:55:54.410734] [DEBUG] [LOCAL ] LEVI: Loaded 51780 existing records from primary storage. [2025-10-16T19:55:54.411238] [INFO ] [MAIN ] LEVI: Loaded 51780 existing records. [2025-10-16T19:55:54.599881] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:55:54.600227] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-16T19:55:54.600301] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-16T19:55:54.600831] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-16T19:55:54.600902] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-16T19:55:54.982812] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:55:55.142833] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-16T19:55:55.409355] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-16T19:55:55.587029] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-16T19:55:55.942791] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-16T19:55:56.303492] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-16T19:55:56.742826] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-16T19:55:57.542779] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-16T19:55:57.710883] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-16T19:55:57.991702] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-16T19:55:58.056842] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-16T19:55:58.342825] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-16T19:55:59.142874] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-16T19:55:59.942812] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-16T19:56:00.247081] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-16T19:56:00.671402] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-16T19:56:00.742782] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-16T19:56:00.878597] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-16T19:56:01.542862] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-16T19:56:02.342804] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-16T19:56:02.848533] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-16T19:56:03.142796] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-16T19:56:03.323742] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-16T19:56:03.330087] [INFO ] [REMOTE ] LEG: Full fetch complete (73027 records). [2025-10-16T19:56:03.330206] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-16T19:56:03.721101] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-16T19:56:03.721194] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-16T19:56:03.722242] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-16T19:56:03.722305] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-16T19:56:03.723612] [DEBUG] [LOCAL ] LEG: Trimmed 73027 records to 50533 (keeping 200 days of data) [2025-10-16T19:56:03.942783] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-16T19:56:04.028319] [DEBUG] [LOCAL ] LEG: Primary data saved (50533 records). [2025-10-16T19:56:04.028742] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-16T19:56:04.028971] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LEG took 45.7s. Estimated remaining: 2h 38m 6s. Rate: 7.1 symbols/min [2025-10-16T19:56:04.167330] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-16T19:56:04.234442] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:04.253910] [DEBUG] [LOCAL ] LFT: Loaded 18357 existing records from primary storage. [2025-10-16T19:56:04.254157] [INFO ] [MAIN ] LFT: Loaded 18357 existing records. [2025-10-16T19:56:04.426077] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:04.426281] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-16T19:56:04.426328] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-16T19:56:04.426546] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-16T19:56:04.426603] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-16T19:56:04.756228] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-16T19:56:04.788854] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:04.899449] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-16T19:56:04.901956] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-16T19:56:05.542857] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-16T19:56:06.234565] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-16T19:56:06.266292] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-16T19:56:06.342775] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-16T19:56:07.142865] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-16T19:56:07.947941] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-16T19:56:07.964801] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-16T19:56:08.132370] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-16T19:56:08.742788] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-16T19:56:08.886042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-16T19:56:09.450215] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-16T19:56:09.542815] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-16T19:56:10.313459] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-16T19:56:10.342771] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-16T19:56:11.142787] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-16T19:56:11.224856] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-16T19:56:11.942807] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-16T19:56:12.128553] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-16T19:56:12.131016] [INFO ] [REMOTE ] LEO: Full fetch complete (26573 records). [2025-10-16T19:56:12.131108] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-16T19:56:12.508924] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-16T19:56:12.508999] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-16T19:56:12.509547] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-16T19:56:12.509629] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-16T19:56:12.510294] [DEBUG] [LOCAL ] LEO: Trimmed 26573 records to 16748 (keeping 200 days of data) [2025-10-16T19:56:12.604857] [DEBUG] [LOCAL ] LEO: Primary data saved (16748 records). [2025-10-16T19:56:12.605030] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-16T19:56:12.605127] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEO took 27.2s. Estimated remaining: 2h 37m 57s. Rate: 7.1 symbols/min [2025-10-16T19:56:12.749216] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-16T19:56:12.774784] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:12.787348] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-16T19:56:12.787560] [INFO ] [MAIN ] LGI: Loaded 10092 existing records. [2025-10-16T19:56:12.961244] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:12.961452] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-16T19:56:12.961499] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-16T19:56:12.961688] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-16T19:56:12.961745] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-16T19:56:13.317835] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:13.542781] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-16T19:56:13.793059] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:56:14.254947] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-16T19:56:14.342826] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-16T19:56:14.661515] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-16T19:56:15.142797] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-16T19:56:15.920089] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:56:15.942787] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-16T19:56:16.065803] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-16T19:56:16.745036] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-16T19:56:16.746107] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-16T19:56:17.542840] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-16T19:56:18.342836] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-16T19:56:19.112884] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-16T19:56:19.123848] [INFO ] [REMOTE ] LEN: Full fetch complete (77213 records). [2025-10-16T19:56:19.124031] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-16T19:56:19.159064] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-16T19:56:19.292616] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-16T19:56:19.550793] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-16T19:56:19.807523] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-16T19:56:19.807693] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-16T19:56:19.809823] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-16T19:56:19.810003] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-16T19:56:19.812030] [DEBUG] [LOCAL ] LEN: Trimmed 77213 records to 53584 (keeping 200 days of data) [2025-10-16T19:56:19.948906] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-16T19:56:19.965365] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-16T19:56:20.263059] [DEBUG] [LOCAL ] LEN: Primary data saved (53584 records). [2025-10-16T19:56:20.263208] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-16T19:56:20.263316] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEN took 39.8s. Estimated remaining: 2h 37m 48s. Rate: 7.1 symbols/min [2025-10-16T19:56:20.430778] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:20.466013] [DEBUG] [LOCAL ] LH: Loaded 37607 existing records from primary storage. [2025-10-16T19:56:20.466320] [INFO ] [MAIN ] LH: Loaded 37607 existing records. [2025-10-16T19:56:20.637785] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:20.637997] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-16T19:56:20.638048] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-16T19:56:20.638434] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-16T19:56:20.638492] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-16T19:56:20.747954] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-16T19:56:20.986048] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:21.542840] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-16T19:56:21.802979] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-16T19:56:22.082426] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-16T19:56:22.126338] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-16T19:56:22.342846] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-16T19:56:23.142821] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-16T19:56:23.400318] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-16T19:56:23.916246] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-16T19:56:23.942794] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-16T19:56:24.491319] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-16T19:56:24.742882] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-16T19:56:25.546172] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-16T19:56:25.548668] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-16T19:56:26.342827] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-16T19:56:27.029025] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-16T19:56:27.107282] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-16T19:56:27.142787] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-16T19:56:27.942785] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-16T19:56:28.091496] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-16T19:56:28.742813] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-16T19:56:29.426784] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-16T19:56:29.542793] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-16T19:56:30.002695] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-16T19:56:30.342831] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-16T19:56:30.613137] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:56:31.142846] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-16T19:56:31.884385] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:56:31.924482] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-16T19:56:31.942772] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-16T19:56:32.667143] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-16T19:56:32.669527] [INFO ] [REMOTE ] LFT: Full fetch complete (24022 records). [2025-10-16T19:56:32.669605] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-16T19:56:32.747973] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-16T19:56:33.029513] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-16T19:56:33.029586] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-16T19:56:33.030084] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-16T19:56:33.030167] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-16T19:56:33.030816] [DEBUG] [LOCAL ] LFT: Trimmed 24022 records to 18440 (keeping 200 days of data) [2025-10-16T19:56:33.135904] [DEBUG] [LOCAL ] LFT: Primary data saved (18440 records). [2025-10-16T19:56:33.136018] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-16T19:56:33.136093] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LFT took 29.1s. Estimated remaining: 2h 37m 44s. Rate: 7.1 symbols/min [2025-10-16T19:56:33.303159] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:33.347474] [DEBUG] [LOCAL ] LHX: Loaded 48604 existing records from primary storage. [2025-10-16T19:56:33.347791] [INFO ] [MAIN ] LHX: Loaded 48604 existing records. [2025-10-16T19:56:33.452113] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-16T19:56:33.532253] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:33.532461] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-16T19:56:33.532508] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-16T19:56:33.532983] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-16T19:56:33.533041] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-16T19:56:33.552922] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-16T19:56:33.884050] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:34.342831] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-16T19:56:35.124489] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-16T19:56:35.142778] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-16T19:56:35.942855] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-16T19:56:36.296966] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-16T19:56:36.303851] [INFO ] [REMOTE ] LEVI: Full fetch complete (74928 records). [2025-10-16T19:56:36.304015] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-16T19:56:36.708414] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-16T19:56:36.708577] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-16T19:56:36.709755] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-16T19:56:36.709896] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-16T19:56:36.711608] [DEBUG] [LOCAL ] LEVI: Trimmed 74928 records to 52170 (keeping 200 days of data) [2025-10-16T19:56:36.734683] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-16T19:56:36.743220] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-16T19:56:37.051521] [DEBUG] [LOCAL ] LEVI: Primary data saved (52170 records). [2025-10-16T19:56:37.051689] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-16T19:56:37.051785] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEVI took 42.9s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-16T19:56:37.224443] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:37.257750] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-16T19:56:37.288899] [DEBUG] [LOCAL ] LII: Loaded 27767 existing records from primary storage. [2025-10-16T19:56:37.289201] [INFO ] [MAIN ] LII: Loaded 27767 existing records. [2025-10-16T19:56:37.406972] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-16T19:56:37.425220] [INFO ] [REMOTE ] LGI: Full fetch complete (14534 records). [2025-10-16T19:56:37.448139] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-16T19:56:37.509541] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:37.557114] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-16T19:56:37.546632] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-16T19:56:37.576616] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-16T19:56:37.580142] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-16T19:56:37.580218] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-16T19:56:38.171422] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-16T19:56:38.177551] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-16T19:56:38.193433] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-16T19:56:38.198207] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-16T19:56:38.198147] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:38.198957] [DEBUG] [LOCAL ] LGI: Trimmed 14534 records to 10147 (keeping 200 days of data) [2025-10-16T19:56:38.259780] [DEBUG] [LOCAL ] LGI: Primary data saved (10147 records). [2025-10-16T19:56:38.259907] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-16T19:56:38.259984] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LGI took 25.7s. Estimated remaining: 2h 37m 16s. Rate: 7.1 symbols/min [2025-10-16T19:56:38.348883] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-16T19:56:38.430523] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:56:38.472362] [DEBUG] [LOCAL ] LION: Loaded 46349 existing records from primary storage. [2025-10-16T19:56:38.472735] [INFO ] [MAIN ] LION: Loaded 46349 existing records. [2025-10-16T19:56:38.650013] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:56:38.650250] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-16T19:56:38.650297] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-16T19:56:38.650692] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-16T19:56:38.650751] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-16T19:56:39.009469] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:56:39.142799] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-16T19:56:39.347445] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-16T19:56:39.942804] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-16T19:56:40.036106] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-16T19:56:40.062857] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-16T19:56:40.742821] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-16T19:56:41.522192] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-16T19:56:41.542784] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-16T19:56:41.931189] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-16T19:56:42.342821] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-16T19:56:42.557186] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-16T19:56:43.142869] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-16T19:56:43.520996] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-16T19:56:43.942835] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-16T19:56:44.742809] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-16T19:56:44.771021] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-16T19:56:44.994988] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-16T19:56:45.542827] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-16T19:56:46.326890] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-16T19:56:46.342771] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-16T19:56:46.564257] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-16T19:56:47.142865] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-16T19:56:47.942819] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-16T19:56:47.969882] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-16T19:56:48.664390] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-16T19:56:48.742787] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-16T19:56:48.985832] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-16T19:56:49.542819] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-16T19:56:50.217330] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-16T19:56:50.342784] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-16T19:56:50.811535] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-16T19:56:51.142798] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-16T19:56:51.918996] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-16T19:56:51.942802] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-16T19:56:52.024542] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-16T19:56:52.742831] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-16T19:56:53.542791] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-16T19:56:53.624904] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-16T19:56:53.812522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-16T19:56:54.342820] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-16T19:56:54.846251] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-16T19:56:55.142842] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-16T19:56:55.563065] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-16T19:56:55.942812] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-16T19:56:56.712804] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:56:56.742839] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-16T19:56:57.547986] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-16T19:56:57.564843] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-16T19:56:57.946857] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-16T19:56:58.342866] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-16T19:56:58.925788] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-16T19:56:59.142812] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-16T19:56:59.910056] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-16T19:56:59.942775] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-16T19:57:00.470291] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:57:00.742823] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-16T19:57:01.542820] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-16T19:57:01.632355] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-16T19:57:02.042290] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-16T19:57:02.046780] [INFO ] [REMOTE ] LII: Full fetch complete (41445 records). [2025-10-16T19:57:02.046898] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-16T19:57:02.347954] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-16T19:57:02.417162] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-16T19:57:02.417237] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-16T19:57:02.418001] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-16T19:57:02.418063] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-16T19:57:02.419020] [DEBUG] [LOCAL ] LII: Trimmed 41445 records to 28004 (keeping 200 days of data) [2025-10-16T19:57:02.591958] [DEBUG] [LOCAL ] LII: Primary data saved (28004 records). [2025-10-16T19:57:02.592098] [INFO ] [MAIN ] LII: Full history saved. [2025-10-16T19:57:02.592178] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LII took 25.5s. Estimated remaining: 2h 37m 22s. Rate: 7.1 symbols/min [2025-10-16T19:57:02.757472] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:02.764375] [DEBUG] [LOCAL ] LITB: Loaded 4146 existing records from primary storage. [2025-10-16T19:57:02.764566] [INFO ] [MAIN ] LITB: Loaded 4146 existing records. [2025-10-16T19:57:02.937890] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:02.938246] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-16T19:57:02.938302] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-16T19:57:02.938623] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-16T19:57:02.938710] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-16T19:57:03.152710] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-16T19:57:03.296500] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:03.433138] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-16T19:57:03.674628] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-16T19:57:03.942828] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-16T19:57:04.742846] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-16T19:57:05.069196] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-16T19:57:05.070953] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-16T19:57:05.543511] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-16T19:57:05.548881] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-16T19:57:06.127273] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-16T19:57:06.342791] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-16T19:57:06.782624] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-16T19:57:07.142811] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-16T19:57:07.820527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-16T19:57:07.942856] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-16T19:57:08.700370] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-16T19:57:08.742834] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-16T19:57:09.542843] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-16T19:57:10.085294] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-16T19:57:10.104930] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-16T19:57:10.109495] [INFO ] [REMOTE ] LH: Full fetch complete (54931 records). [2025-10-16T19:57:10.109600] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-16T19:57:10.349070] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-16T19:57:10.499045] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-16T19:57:10.499132] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-16T19:57:10.500181] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-16T19:57:10.500248] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-16T19:57:10.501672] [DEBUG] [LOCAL ] LH: Trimmed 54931 records to 37792 (keeping 200 days of data) [2025-10-16T19:57:10.762787] [DEBUG] [LOCAL ] LH: Primary data saved (37792 records). [2025-10-16T19:57:10.762932] [INFO ] [MAIN ] LH: Full history saved. [2025-10-16T19:57:10.763015] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LH took 50.5s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-16T19:57:10.926481] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:10.979291] [DEBUG] [LOCAL ] LLY: Loaded 53261 existing records from primary storage. [2025-10-16T19:57:10.979663] [INFO ] [MAIN ] LLY: Loaded 53261 existing records. [2025-10-16T19:57:11.150395] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-16T19:57:11.150303] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:11.151366] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-16T19:57:11.151417] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-16T19:57:11.151859] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-16T19:57:11.151917] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-16T19:57:11.579006] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:11.942800] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-16T19:57:12.141801] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-16T19:57:12.742817] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-16T19:57:12.869475] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-16T19:57:13.048237] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-16T19:57:13.542812] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-16T19:57:13.995684] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-16T19:57:14.342791] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-16T19:57:14.503800] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-16T19:57:14.692111] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-16T19:57:15.142817] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-16T19:57:15.942827] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-16T19:57:16.742779] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-16T19:57:17.198140] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-16T19:57:17.204123] [INFO ] [REMOTE ] LHX: Full fetch complete (70779 records). [2025-10-16T19:57:17.204232] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-16T19:57:17.550765] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-16T19:57:17.612604] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-16T19:57:17.612717] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-16T19:57:17.613764] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-16T19:57:17.613830] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-16T19:57:17.615398] [DEBUG] [LOCAL ] LHX: Trimmed 70779 records to 48970 (keeping 200 days of data) [2025-10-16T19:57:17.931320] [DEBUG] [LOCAL ] LHX: Primary data saved (48970 records). [2025-10-16T19:57:17.931453] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-16T19:57:17.932116] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LHX took 44.8s. Estimated remaining: 2h 37m 4s. Rate: 7.1 symbols/min [2025-10-16T19:57:18.103112] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:18.153840] [DEBUG] [LOCAL ] LMND: Loaded 52062 existing records from primary storage. [2025-10-16T19:57:18.154135] [INFO ] [MAIN ] LMND: Loaded 52062 existing records. [2025-10-16T19:57:18.344314] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:18.350457] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-16T19:57:18.351185] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-16T19:57:18.351582] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-16T19:57:18.353582] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-16T19:57:18.354455] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-16T19:57:18.354149] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-16T19:57:18.488457] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-16T19:57:18.659061] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-16T19:57:18.700133] [INFO ] [REMOTE ] LION: Full fetch complete (57303 records). [2025-10-16T19:57:18.702461] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-16T19:57:18.882380] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:19.047973] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-16T19:57:19.075895] [INFO ] [REMOTE ] LITB: Full fetch complete (5716 records). [2025-10-16T19:57:19.076004] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-16T19:57:19.144860] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-16T19:57:19.270277] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-16T19:57:19.270673] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-16T19:57:19.271574] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-16T19:57:19.277050] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-16T19:57:19.331148] [DEBUG] [LOCAL ] LION: Trimmed 57303 records to 46694 (keeping 200 days of data) [2025-10-16T19:57:19.689836] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-16T19:57:19.699013] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-16T19:57:19.699290] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-16T19:57:19.725124] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-16T19:57:19.727384] [DEBUG] [LOCAL ] LITB: Trimmed 5716 records to 4203 (keeping 200 days of data) [2025-10-16T19:57:19.766123] [DEBUG] [LOCAL ] LITB: Primary data saved (4203 records). [2025-10-16T19:57:19.768299] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-16T19:57:19.771581] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LITB took 17.2s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-16T19:57:19.951798] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-16T19:57:19.971205] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:19.999704] [DEBUG] [LOCAL ] LION: Primary data saved (46694 records). [2025-10-16T19:57:19.999939] [INFO ] [MAIN ] LION: Full history saved. [2025-10-16T19:57:20.000503] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LION took 41.7s. Estimated remaining: 2h 36m 33s. Rate: 7.1 symbols/min [2025-10-16T19:57:20.192274] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:20.208030] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-16T19:57:20.208496] [INFO ] [MAIN ] LMT: Loaded 49623 existing records. [2025-10-16T19:57:20.397181] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:20.410719] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-16T19:57:20.410818] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-16T19:57:20.411254] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-16T19:57:20.411302] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-16T19:57:20.548191] [DEBUG] [LOCAL ] LNC: Loaded 51556 existing records from primary storage. [2025-10-16T19:57:20.571263] [INFO ] [MAIN ] LNC: Loaded 51556 existing records. [2025-10-16T19:57:20.971975] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:20.991771] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-16T19:57:20.991692] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:20.992108] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-16T19:57:20.991892] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-16T19:57:20.992910] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-16T19:57:20.992972] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-16T19:57:21.347148] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:21.542798] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-16T19:57:21.719551] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-16T19:57:22.015953] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-16T19:57:22.342899] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-16T19:57:22.860056] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-16T19:57:23.142871] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-16T19:57:23.236931] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-16T19:57:23.942808] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-16T19:57:24.109190] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-16T19:57:24.742859] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-16T19:57:25.252874] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-16T19:57:25.503812] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-16T19:57:25.542769] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-16T19:57:26.342898] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-16T19:57:26.807448] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-16T19:57:27.142924] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-16T19:57:27.211345] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-16T19:57:27.942826] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-16T19:57:28.213597] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-16T19:57:28.742793] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-16T19:57:29.163666] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-16T19:57:29.313004] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-16T19:57:29.542833] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-16T19:57:30.182360] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-16T19:57:30.342826] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-16T19:57:31.142813] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-16T19:57:31.739961] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-16T19:57:31.942866] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-16T19:57:32.192580] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-16T19:57:32.742840] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-16T19:57:33.415390] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-16T19:57:33.542794] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-16T19:57:34.186719] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-16T19:57:34.342813] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-16T19:57:34.561455] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-16T19:57:35.142831] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-16T19:57:35.942786] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-16T19:57:36.011006] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-16T19:57:36.076490] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-16T19:57:36.742860] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-16T19:57:37.162946] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-16T19:57:37.543544] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-16T19:57:37.543475] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-16T19:57:38.342818] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-16T19:57:38.486457] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:57:39.142807] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-16T19:57:39.942273] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-16T19:57:39.951888] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-16T19:57:40.742782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-16T19:57:40.809921] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-16T19:57:40.859286] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-16T19:57:41.542850] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-16T19:57:42.068933] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-16T19:57:42.342821] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-16T19:57:43.075161] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-16T19:57:43.142807] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-16T19:57:43.942795] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-16T19:57:44.105561] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-16T19:57:44.461303] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-16T19:57:44.742893] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-16T19:57:45.434530] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-16T19:57:45.542814] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-16T19:57:45.718511] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-16T19:57:46.342835] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-16T19:57:47.017806] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-16T19:57:47.142821] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-16T19:57:47.785506] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-16T19:57:47.942787] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-16T19:57:48.742838] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-16T19:57:49.267320] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-10-16T19:57:49.542822] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-16T19:57:49.766739] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-16T19:57:49.774050] [INFO ] [REMOTE ] LMND: Full fetch complete (75461 records). [2025-10-16T19:57:49.774200] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-16T19:57:50.189592] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-16T19:57:50.189812] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-16T19:57:50.191100] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-16T19:57:50.191187] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-16T19:57:50.193459] [DEBUG] [LOCAL ] LMND: Trimmed 75461 records to 52452 (keeping 200 days of data) [2025-10-16T19:57:50.411432] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-16T19:57:50.453427] [INFO ] [REMOTE ] LMT: Full fetch complete (72452 records). [2025-10-16T19:57:50.488706] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-16T19:57:50.540975] [DEBUG] [LOCAL ] LMND: Primary data saved (52452 records). [2025-10-16T19:57:50.550666] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-16T19:57:50.566771] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LMND took 32.6s. Estimated remaining: 2h 36m 44s. Rate: 7.1 symbols/min [2025-10-16T19:57:50.963068] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:51.125350] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-16T19:57:51.105034] [DEBUG] [LOCAL ] LND: Loaded 4972 existing records from primary storage. [2025-10-16T19:57:51.180903] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-16T19:57:51.176161] [INFO ] [MAIN ] LND: Loaded 4972 existing records. [2025-10-16T19:57:51.181179] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-16T19:57:51.212666] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-16T19:57:51.213223] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-16T19:57:51.213119] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-16T19:57:51.288960] [DEBUG] [LOCAL ] LMT: Trimmed 72452 records to 49981 (keeping 200 days of data) [2025-10-16T19:57:51.432537] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:51.460055] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-16T19:57:51.460180] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-16T19:57:51.465133] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-16T19:57:51.465508] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-16T19:57:52.067036] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:52.083703] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-16T19:57:52.082934] [DEBUG] [LOCAL ] LMT: Primary data saved (49981 records). [2025-10-16T19:57:52.085366] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-16T19:57:52.086186] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LMT took 32.3s. Estimated remaining: 2h 36m 30s. Rate: 7.1 symbols/min [2025-10-16T19:57:52.260365] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:52.296132] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-16T19:57:52.308135] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-16T19:57:52.352124] [DEBUG] [LOCAL ] LNG: Loaded 51216 existing records from primary storage. [2025-10-16T19:57:52.352421] [INFO ] [MAIN ] LNG: Loaded 51216 existing records. [2025-10-16T19:57:52.534807] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:52.535202] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-16T19:57:52.535320] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-16T19:57:52.535928] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-16T19:57:52.536038] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-16T19:57:52.892586] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-16T19:57:52.975062] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-16T19:57:52.975873] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-16T19:57:52.996764] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:53.215088] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-16T19:57:53.222031] [INFO ] [REMOTE ] LLY: Full fetch complete (77251 records). [2025-10-16T19:57:53.222183] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-16T19:57:53.547968] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-16T19:57:53.622073] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-16T19:57:53.622187] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-16T19:57:53.623336] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-16T19:57:53.623399] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-16T19:57:53.624842] [DEBUG] [LOCAL ] LLY: Trimmed 77251 records to 53635 (keeping 200 days of data) [2025-10-16T19:57:53.955942] [DEBUG] [LOCAL ] LLY: Primary data saved (53635 records). [2025-10-16T19:57:53.956113] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-16T19:57:53.956213] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LLY took 43.2s. Estimated remaining: 2h 36m 16s. Rate: 7.1 symbols/min [2025-10-16T19:57:54.122176] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:54.135202] [DEBUG] [LOCAL ] LNN: Loaded 11430 existing records from primary storage. [2025-10-16T19:57:54.135414] [INFO ] [MAIN ] LNN: Loaded 11430 existing records. [2025-10-16T19:57:54.295833] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-16T19:57:54.318789] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:54.318997] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-16T19:57:54.319046] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-16T19:57:54.319204] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-16T19:57:54.319242] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-16T19:57:54.362113] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-16T19:57:54.675418] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:54.822849] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-16T19:57:54.829432] [INFO ] [REMOTE ] LNC: Full fetch complete (74553 records). [2025-10-16T19:57:54.829559] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-16T19:57:55.154555] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-16T19:57:55.210224] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-16T19:57:55.210310] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-16T19:57:55.211475] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-16T19:57:55.211538] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-16T19:57:55.212975] [DEBUG] [LOCAL ] LNC: Trimmed 74553 records to 51933 (keeping 200 days of data) [2025-10-16T19:57:55.515422] [DEBUG] [LOCAL ] LNC: Primary data saved (51933 records). [2025-10-16T19:57:55.515548] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-16T19:57:55.516081] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LNC took 35.5s. Estimated remaining: 2h 36m 1s. Rate: 7.1 symbols/min [2025-10-16T19:57:55.681780] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:57:55.721853] [DEBUG] [LOCAL ] LOAR: Loaded 42140 existing records from primary storage. [2025-10-16T19:57:55.722129] [INFO ] [MAIN ] LOAR: Loaded 42140 existing records. [2025-10-16T19:57:55.898077] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:57:55.898331] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-16T19:57:55.898507] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-16T19:57:55.898788] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-16T19:57:55.898845] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-16T19:57:55.956459] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-16T19:57:55.994357] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-16T19:57:56.266954] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:57:56.295144] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-16T19:57:56.742835] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-16T19:57:56.794789] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-16T19:57:57.542821] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-16T19:57:58.280928] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-16T19:57:58.279458] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-16T19:57:58.342798] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-16T19:57:59.142815] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-16T19:57:59.849723] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-16T19:57:59.942805] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-16T19:58:00.415415] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-16T19:58:00.524033] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-16T19:58:00.742788] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-16T19:58:01.354693] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-16T19:58:01.542825] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-16T19:58:02.073022] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-16T19:58:02.342849] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-16T19:58:03.142791] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-16T19:58:03.657469] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-16T19:58:03.942860] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-16T19:58:04.657831] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-16T19:58:04.742768] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-16T19:58:04.814192] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-16T19:58:05.542851] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-16T19:58:06.245853] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-16T19:58:06.342873] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-16T19:58:06.634775] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T19:58:06.906260] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-16T19:58:07.142820] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-16T19:58:07.942879] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-16T19:58:08.386422] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-16T19:58:08.611540] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-16T19:58:08.613213] [INFO ] [REMOTE ] LND: Full fetch complete (7916 records). [2025-10-16T19:58:08.613300] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-16T19:58:08.757895] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-16T19:58:08.976540] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-16T19:58:08.976613] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-16T19:58:08.976839] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-16T19:58:08.976896] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-16T19:58:08.977294] [DEBUG] [LOCAL ] LND: Trimmed 7916 records to 4994 (keeping 200 days of data) [2025-10-16T19:58:09.003741] [DEBUG] [LOCAL ] LND: Primary data saved (4994 records). [2025-10-16T19:58:09.003807] [INFO ] [MAIN ] LND: Full history saved. [2025-10-16T19:58:09.003876] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LND took 18.4s. Estimated remaining: 2h 35m 57s. Rate: 7.1 symbols/min [2025-10-16T19:58:09.170885] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:09.200989] [DEBUG] [LOCAL ] LOB: Loaded 26728 existing records from primary storage. [2025-10-16T19:58:09.201263] [INFO ] [MAIN ] LOB: Loaded 26728 existing records. [2025-10-16T19:58:09.376801] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:09.377003] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-16T19:58:09.377054] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-16T19:58:09.377313] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-16T19:58:09.377352] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-16T19:58:09.551216] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-16T19:58:09.670613] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-16T19:58:09.741445] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:10.342805] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-16T19:58:10.979683] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-16T19:58:11.122541] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-16T19:58:11.142780] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-16T19:58:11.942823] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-16T19:58:12.753422] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-16T19:58:12.755219] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-16T19:58:12.905434] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-16T19:58:13.542865] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-16T19:58:14.342845] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-16T19:58:14.669240] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-16T19:58:15.142858] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-16T19:58:15.283369] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-16T19:58:15.313620] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-16T19:58:15.942801] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-16T19:58:16.742779] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-16T19:58:16.757904] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-16T19:58:16.975054] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-16T19:58:17.542805] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-16T19:58:17.831520] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-16T19:58:18.342846] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-16T19:58:19.046988] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-16T19:58:19.143077] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-16T19:58:19.422949] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-16T19:58:19.942898] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-16T19:58:20.071983] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-16T19:58:20.742830] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-16T19:58:21.081352] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:58:21.267780] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-16T19:58:21.542836] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-16T19:58:22.342828] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-16T19:58:22.856734] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-16T19:58:23.142824] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-16T19:58:23.806278] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-16T19:58:23.936630] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-16T19:58:23.942756] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-16T19:58:24.699056] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-16T19:58:24.701050] [INFO ] [REMOTE ] LNN: Full fetch complete (15757 records). [2025-10-16T19:58:24.701138] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-16T19:58:24.747946] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-16T19:58:25.063350] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-16T19:58:25.063424] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-16T19:58:25.063732] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-16T19:58:25.063797] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-16T19:58:25.064275] [DEBUG] [LOCAL ] LNN: Trimmed 15757 records to 11521 (keeping 200 days of data) [2025-10-16T19:58:25.136592] [DEBUG] [LOCAL ] LNN: Primary data saved (11521 records). [2025-10-16T19:58:25.136747] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-16T19:58:25.136831] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LNN took 31.2s. Estimated remaining: 2h 35m 55s. Rate: 7.1 symbols/min [2025-10-16T19:58:25.305199] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:25.311015] [DEBUG] [LOCAL ] LOCL: Loaded 3781 existing records from primary storage. [2025-10-16T19:58:25.311179] [INFO ] [MAIN ] LOCL: Loaded 3781 existing records. [2025-10-16T19:58:25.483094] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:25.483308] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-16T19:58:25.483356] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-16T19:58:25.483499] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-16T19:58:25.483556] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-16T19:58:25.548021] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-16T19:58:25.835309] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:26.198340] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-16T19:58:26.342773] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-16T19:58:27.144426] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-16T19:58:27.147719] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-16T19:58:27.211827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-16T19:58:27.942812] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-16T19:58:28.742824] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-16T19:58:28.993972] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-16T19:58:29.163487] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-16T19:58:29.542853] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-16T19:58:30.348490] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-16T19:58:30.363318] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-16T19:58:30.968842] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-16T19:58:31.142808] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-16T19:58:31.430324] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-16T19:58:31.942841] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-16T19:58:32.329906] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-16T19:58:32.742826] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-16T19:58:33.160744] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-16T19:58:33.507259] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-16T19:58:33.542777] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-16T19:58:34.342832] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-16T19:58:35.142832] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-16T19:58:35.363139] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-16T19:58:35.760326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-16T19:58:35.765357] [INFO ] [REMOTE ] LOAR: Full fetch complete (55993 records). [2025-10-16T19:58:35.765498] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-16T19:58:35.943974] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-16T19:58:36.209009] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-16T19:58:36.209616] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-16T19:58:36.210254] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-16T19:58:36.211226] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-16T19:58:36.216453] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-16T19:58:36.217970] [DEBUG] [LOCAL ] LOAR: Trimmed 55993 records to 42364 (keeping 200 days of data) [2025-10-16T19:58:36.311529] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-16T19:58:36.467868] [DEBUG] [LOCAL ] LOAR: Primary data saved (42364 records). [2025-10-16T19:58:36.467994] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-16T19:58:36.468444] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LOAR took 41.0s. Estimated remaining: 2h 35m 49s. Rate: 7.1 symbols/min [2025-10-16T19:58:36.637434] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:36.672001] [DEBUG] [LOCAL ] LOMA: Loaded 32694 existing records from primary storage. [2025-10-16T19:58:36.672266] [INFO ] [MAIN ] LOMA: Loaded 32694 existing records. [2025-10-16T19:58:36.747975] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-16T19:58:36.847870] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:36.848069] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-16T19:58:36.848116] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-16T19:58:36.848422] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-16T19:58:36.848486] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-16T19:58:37.211010] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:37.542806] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-16T19:58:37.878629] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-16T19:58:37.986007] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-16T19:58:38.342814] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-16T19:58:39.142864] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-16T19:58:39.644108] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-16T19:58:39.942818] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-16T19:58:40.333742] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-16T19:58:40.337896] [INFO ] [REMOTE ] LOB: Full fetch complete (38255 records). [2025-10-16T19:58:40.338107] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-16T19:58:40.733604] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-16T19:58:40.733712] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-16T19:58:40.734540] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-16T19:58:40.734582] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-16T19:58:40.735498] [DEBUG] [LOCAL ] LOB: Trimmed 38255 records to 26949 (keeping 200 days of data) [2025-10-16T19:58:40.790335] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-16T19:58:40.903918] [DEBUG] [LOCAL ] LOB: Primary data saved (26949 records). [2025-10-16T19:58:40.904057] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-16T19:58:40.904141] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LOB took 31.9s. Estimated remaining: 2h 35m 37s. Rate: 7.1 symbols/min [2025-10-16T19:58:41.073310] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:41.122361] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-16T19:58:41.122720] [INFO ] [MAIN ] LOW: Loaded 52993 existing records. [2025-10-16T19:58:41.275934] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-16T19:58:41.351275] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:41.351555] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-16T19:58:41.351621] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-16T19:58:41.351886] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-16T19:58:41.351943] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-16T19:58:41.548036] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-16T19:58:41.730754] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:41.748494] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-16T19:58:41.755020] [INFO ] [REMOTE ] LNG: Full fetch complete (74810 records). [2025-10-16T19:58:41.755175] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-16T19:58:42.179456] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-16T19:58:42.179543] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-16T19:58:42.180911] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-16T19:58:42.180979] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-16T19:58:42.182407] [DEBUG] [LOCAL ] LNG: Trimmed 74810 records to 51601 (keeping 200 days of data) [2025-10-16T19:58:42.359972] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-16T19:58:42.407900] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-16T19:58:42.515012] [DEBUG] [LOCAL ] LNG: Primary data saved (51601 records). [2025-10-16T19:58:42.515149] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-16T19:58:42.515679] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LNG took 50.4s. Estimated remaining: 2h 35m 23s. Rate: 7.1 symbols/min [2025-10-16T19:58:42.679743] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:58:42.718743] [DEBUG] [LOCAL ] LPG: Loaded 39643 existing records from primary storage. [2025-10-16T19:58:42.719016] [INFO ] [MAIN ] LPG: Loaded 39643 existing records. [2025-10-16T19:58:42.895988] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:58:42.896581] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-16T19:58:42.896639] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-16T19:58:42.896976] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-16T19:58:42.897045] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-16T19:58:43.147957] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-16T19:58:43.246521] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:58:43.942819] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-16T19:58:44.127035] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-16T19:58:44.523796] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-16T19:58:44.742876] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-16T19:58:45.131343] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-16T19:58:45.542811] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-16T19:58:46.085226] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-16T19:58:46.342825] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-16T19:58:46.770276] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-16T19:58:46.822216] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-16T19:58:47.142842] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-16T19:58:47.423739] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-16T19:58:47.942827] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-16T19:58:48.742842] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-16T19:58:49.542829] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-16T19:58:49.808218] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-16T19:58:50.031480] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-16T19:58:50.051496] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-16T19:58:50.342828] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-16T19:58:51.142850] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-16T19:58:51.934310] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-16T19:58:51.944073] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-16T19:58:52.689408] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-16T19:58:52.722198] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-16T19:58:52.742789] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-16T19:58:53.542796] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-16T19:58:53.584397] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-16T19:58:54.342857] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-16T19:58:55.075901] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-16T19:58:55.142803] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-16T19:58:55.595606] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-16T19:58:55.942872] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-16T19:58:56.372001] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-16T19:58:56.742871] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-16T19:58:57.542830] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-16T19:58:57.754555] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-16T19:58:58.288220] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-16T19:58:58.342798] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-16T19:58:58.517321] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-16T19:58:59.142809] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-16T19:58:59.724513] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-16T19:58:59.942786] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-16T19:59:00.228764] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-16T19:59:00.573408] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-16T19:59:00.574466] [INFO ] [REMOTE ] LOCL: Full fetch complete (4543 records). [2025-10-16T19:59:00.574535] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-16T19:59:00.748555] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-16T19:59:00.939663] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-16T19:59:00.939754] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-16T19:59:00.939907] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-16T19:59:00.939948] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-16T19:59:00.940360] [DEBUG] [LOCAL ] LOCL: Trimmed 4543 records to 3809 (keeping 200 days of data) [2025-10-16T19:59:00.961045] [DEBUG] [LOCAL ] LOCL: Primary data saved (3809 records). [2025-10-16T19:59:00.961108] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-16T19:59:00.961179] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOCL took 35.8s. Estimated remaining: 2h 35m 23s. Rate: 7.1 symbols/min [2025-10-16T19:59:01.129391] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:01.155582] [DEBUG] [LOCAL ] LPL: Loaded 28287 existing records from primary storage. [2025-10-16T19:59:01.155847] [INFO ] [MAIN ] LPL: Loaded 28287 existing records. [2025-10-16T19:59:01.356120] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:01.356365] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-16T19:59:01.356424] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-16T19:59:01.356699] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-16T19:59:01.356772] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-16T19:59:01.547317] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-16T19:59:01.743160] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:02.288063] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-16T19:59:02.342804] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-16T19:59:03.142779] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-16T19:59:03.241109] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-16T19:59:03.928172] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-16T19:59:03.942767] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-16T19:59:04.369393] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-16T19:59:04.742785] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-16T19:59:04.955752] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-16T19:59:05.542807] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-16T19:59:06.203416] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-16T19:59:06.342821] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-16T19:59:07.142863] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-16T19:59:07.299331] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-16T19:59:07.941418] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-16T19:59:07.949326] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-16T19:59:08.357695] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-16T19:59:08.363069] [INFO ] [REMOTE ] LOMA: Full fetch complete (47946 records). [2025-10-16T19:59:08.363218] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-16T19:59:08.747972] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-16T19:59:08.761226] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-16T19:59:08.761321] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-16T19:59:08.762221] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-16T19:59:08.762287] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-16T19:59:08.763566] [DEBUG] [LOCAL ] LOMA: Trimmed 47946 records to 32954 (keeping 200 days of data) [2025-10-16T19:59:08.960286] [DEBUG] [LOCAL ] LOMA: Primary data saved (32954 records). [2025-10-16T19:59:08.960673] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-16T19:59:08.960776] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOMA took 32.5s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-16T19:59:09.085465] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-16T19:59:09.147229] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-08 to 2025-10-16. [2025-10-16T19:59:09.184476] [DEBUG] [LOCAL ] LPX: Loaded 40329 existing records from primary storage. [2025-10-16T19:59:09.184810] [INFO ] [MAIN ] LPX: Loaded 40329 existing records. [2025-10-16T19:59:09.361378] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-30 for 200 day retention. Performing full refresh. [2025-10-16T19:59:09.361720] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-16T19:59:09.361778] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-16T19:59:09.362380] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-16T19:59:09.362441] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-16T19:59:09.547941] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-16T19:59:09.718248] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-30 to 2025-10-16 (requires 11 months of data pull). [2025-10-16T19:59:09.960113] [INFO ] [REMOTE